-- Logs begin at Fri 2021-10-29 15:32:56 UTC, end at Fri 2021-10-29 17:25:42 UTC. -- Oct 29 16:00:23.590746 dv-cinder-815848-2-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 29 16:00:23.601845 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 29 16:00:23.601845 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Oct 29 16:00:23 2021] *** Oct 29 16:00:23.601845 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 29 16:00:23.601845 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 29 16:00:23.601845 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: nodename: dv-cinder-815848-2-iscsi Oct 29 16:00:23.601845 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: machine: x86_64 Oct 29 16:00:23.601845 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: clock source: unix Oct 29 16:00:23.601845 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: pcre jit disabled Oct 29 16:00:23.601845 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: detected number of CPU cores: 4 Oct 29 16:00:23.601845 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: current working directory: / Oct 29 16:00:23.601845 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: detected binary path: /usr/bin/uwsgi-core Oct 29 16:00:23.601845 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: your processes number limit is 47680 Oct 29 16:00:23.601845 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: your memory page size is 4096 bytes Oct 29 16:00:23.601845 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: detected max file descriptor number: 2048 Oct 29 16:00:23.601845 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: lock engine: pthread robust mutexes Oct 29 16:00:23.601845 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: thunder lock: enabled Oct 29 16:00:23.606634 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 29 16:00:23.606634 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 29 16:00:23.646931 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: Python main interpreter initialized at 0x5650d87a99c0 Oct 29 16:00:23.646931 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: python threads support enabled Oct 29 16:00:23.646931 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: your server socket listen backlog is limited to 100 connections Oct 29 16:00:23.646931 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: your mercy for graceful operations on workers is 90 seconds Oct 29 16:00:23.647299 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: mapped 403077 bytes (393 KB) for 2 cores Oct 29 16:00:23.647374 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: *** Operational MODE: preforking *** Oct 29 16:00:23.647645 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: *** uWSGI is running in multiple interpreter mode *** Oct 29 16:00:23.647645 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: spawned uWSGI master process (pid: 79600) Oct 29 16:00:23.647846 dv-cinder-815848-2-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 29 16:00:23.651946 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: spawned uWSGI worker 1 (pid: 79609, cores: 1) Oct 29 16:00:23.651946 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: spawned uWSGI worker 2 (pid: 79610, cores: 1) Oct 29 16:00:23.651946 dv-cinder-815848-2-iscsi devstack@keystone.service[79600]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 29 16:00:28.830962 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 16:00:28.830962 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: from cryptography.utils import int_from_bytes Oct 29 16:00:28.831734 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 16:00:28.831734 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: from cryptography.utils import int_from_bytes Oct 29 16:00:28.880531 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 16:00:28.880715 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 16:00:28.880893 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] command line args: [] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 16:00:28.881155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 16:00:28.881331 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ================================================================================ {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 16:00:28.881580 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] admin_token = **** {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.881825 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] config_dir = [] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.882041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.882223 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] config_source = [] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.882402 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] debug = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.882602 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.883104 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.883204 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.883385 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.883630 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.883931 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] list_limit = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.884037 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] log_config_append = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.884195 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.884375 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] log_dir = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.884548 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] log_file = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.884777 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.885020 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.885263 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.885513 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.885694 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.885867 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.886105 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.886359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.886565 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.886793 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.887021 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.887250 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.887492 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.887753 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.888020 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.888502 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.41/identity {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.888677 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] publish_errors = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.888904 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.889128 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.889306 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.889551 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.889782 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.890040 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] standard_threads = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.890269 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.890509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.890682 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.890856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] use_journal = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.891029 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] use_json = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.891199 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] use_stderr = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.891370 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] use_syslog = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.891596 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:28.891860 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.892101 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.892359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.892596 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.892843 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.893078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.893323 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.893556 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.893801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.894097 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.894348 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.894586 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.894829 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.895062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.895304 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.895547 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.895781 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.896029 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.896273 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.896504 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.896755 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.897021 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.897272 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.897526 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.897749 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.898014 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.898220 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.898446 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.898691 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.898933 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.899160 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.899385 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.899627 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.899871 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.900105 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.900349 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.900578 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.900812 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.901039 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.901270 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.901497 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.901724 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.901967 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.902202 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.902458 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.902686 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.902917 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.903145 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.903377 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.903609 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.903852 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.904079 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.904314 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.904552 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.904784 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.905016 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.905246 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.905472 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.905718 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.905968 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.906207 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.906436 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.906690 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.906923 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.907151 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.907384 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.907617 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.907881 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.908115 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.908357 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.908590 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.908836 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.909067 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.909299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.909530 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.910305 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.910537 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.910766 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.911026 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.911267 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.911505 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.911737 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.911967 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.912196 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.912429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.912658 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.912905 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.913138 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.913384 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.913619 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.913882 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.914218 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.914448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.914681 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] auth.external = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.914915 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.915209 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.915445 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.915674 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] auth.password = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.915901 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] auth.token = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.916137 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.916368 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.916611 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.916838 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.917080 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.917323 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.917548 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.917779 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] credential.caching = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.918048 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.918296 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.918542 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.918776 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.919014 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.919244 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.919485 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.919735 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.919967 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.920217 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.920500 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.920744 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.921005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.921246 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.921511 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.921743 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] federation.caching = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.922001 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.922261 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.922505 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.922732 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.922975 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.923210 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.923457 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.923689 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.923942 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.924174 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.924416 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.924647 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] identity.caching = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.924903 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.925146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.925953 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.926183 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.926429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.926656 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.926890 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.927138 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.927386 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.927615 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.927841 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.928066 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.928308 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.928552 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.928795 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.929047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.929294 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.929560 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.929793 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.930059 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.930289 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.930521 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.930748 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.930977 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.931214 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.931449 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.931693 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.931919 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.932161 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.932404 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.932636 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.932877 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.933117 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.933345 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.933577 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.933803 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.934056 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.934290 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.934533 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.934767 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.935004 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.935250 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.935493 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.935721 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.935946 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.936191 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.936435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.936665 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.936895 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.937125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.937351 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.user = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.937588 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.937998 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.938234 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.938479 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.938725 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.938968 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.939200 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.939427 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.939661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.939894 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.940129 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.940357 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.940603 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.940874 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.941118 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.941364 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.941608 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.941836 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.942102 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.942336 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.942569 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.942802 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.943036 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.943277 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.943520 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.943753 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.944003 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.944231 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.944471 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.944702 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.944939 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.945227 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.945474 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.945714 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.946333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.946333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.946691 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] resource.caching = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.947165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.947519 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.947775 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.948264 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.948514 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.948750 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.948997 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.949234 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.949472 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.949706 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] role.caching = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.950236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] role.driver = sql {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.950470 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.950716 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.950961 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.951208 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.951453 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.951698 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.951943 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.952185 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.952432 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.952664 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.952910 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.953154 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.953398 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.953642 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.954090 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.954324 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.954571 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.954817 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.955062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.955313 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.955542 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.955794 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.956042 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.956275 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.956529 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.956758 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.957000 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.957248 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.957500 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.957743 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.957997 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.958232 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.958459 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.958691 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] token.caching = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.958922 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.959166 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.959398 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.959651 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.959893 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.960125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.960363 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.960668 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.960854 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.961085 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.961320 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.961553 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.961794 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.962058 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.962285 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.962524 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.962786 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.963042 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.connection = **** {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.963281 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.963523 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.963757 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.963995 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.964226 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.964456 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.964688 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.964917 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.965156 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.965420 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.965660 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.965891 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.966156 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.966388 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.966629 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.966855 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.967092 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.967322 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:28.967489 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79610) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 16:00:28.999413 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:28.999636 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:28.999861 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.008584 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.037638 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.037801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.095085 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.236263 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.236482 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.306528 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.306706 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.306885 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.307106 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.307327 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.307542 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.308868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 16:00:29.308868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: from cryptography.utils import int_from_bytes Oct 29 16:00:29.309400 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 29 16:00:29.309400 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: from cryptography.utils import int_from_bytes Oct 29 16:00:29.341174 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.341380 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.341599 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.341817 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.342063 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.342274 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.342483 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.354643 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.360039 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 29 16:00:29.360237 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 29 16:00:29.360432 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] command line args: [] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 29 16:00:29.360723 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 29 16:00:29.360903 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ================================================================================ {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 29 16:00:29.361160 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] admin_token = **** {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.361408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] config_dir = [] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.361597 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.361780 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] config_source = [] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.361987 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] debug = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.362200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.362439 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.362620 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.362907 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.363154 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.364341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] list_limit = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.364341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] log_config_append = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.364341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.364341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] log_dir = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.364341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] log_file = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.364697 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.364906 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.364971 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.365209 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.365387 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.365563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.365808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.366082 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.366318 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.366550 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.366782 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.367013 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.367260 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.367504 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.367706 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.367792 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.367939 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.368166 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.368280 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.41/identity {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.368412 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.368501 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] publish_errors = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.368587 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.368698 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.368780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.368932 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.369012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79610) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.369095 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.369345 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.369582 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.369817 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] standard_threads = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.370072 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.370315 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.370493 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.370668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] use_journal = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.370843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] use_json = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.371017 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] use_stderr = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.371191 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] use_syslog = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.371422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 29 16:00:29.371684 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.371924 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.372184 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.372423 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.372671 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.372909 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.373157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.373392 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.373636 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.373882 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.374156 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.374393 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.374638 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.374873 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.375128 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.375374 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.375610 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.375864 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.376116 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.376351 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.376602 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.376862 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.377111 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.377360 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.377592 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.377821 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.378079 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.378346 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.378597 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.378843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.379073 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.379302 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.379548 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.379794 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.380031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.380278 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.380509 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.380742 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.380972 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.381205 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.381434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.381663 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.381892 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.382151 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.382574 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.382811 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.383049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.383282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.383518 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.383755 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.384002 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.384234 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.384472 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.384707 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.384943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.385180 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.385416 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.385645 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.385893 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.386155 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.386355 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.386442 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.386565 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 29 16:00:29.386647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.386858 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.386948 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.387088 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 29 16:00:29.387176 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.387316 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.387395 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.387552 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.387641 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.387785 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.387867 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.388050 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.388130 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.388287 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.388534 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.388769 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.389017 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.389253 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.389489 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.389725 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.389983 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.390221 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.390455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.390715 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.390960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.391202 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.391434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.391663 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.391893 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.392127 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.392369 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.392607 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.392842 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.393088 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.393325 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.393578 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.393836 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.394790 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.395021 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] auth.external = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.395254 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.395552 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.395834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.396100 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] auth.password = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.396334 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] auth.token = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.396580 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.396816 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.397062 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.397293 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.397538 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.397786 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.398040 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.398278 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] credential.caching = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.398525 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.398775 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.399024 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.399261 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.399505 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.399585 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.399738 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.399821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.399984 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.400074 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.400236 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.400319 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.400471 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.400720 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.401007 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.401254 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.401514 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.401755 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.402039 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.402276 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] federation.caching = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.402512 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.402782 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.403028 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.403256 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.403500 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.403736 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.403987 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.404222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.404474 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.404708 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.404953 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.405188 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] identity.caching = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.405433 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.405678 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.405911 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.406164 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.406417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.406646 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.406882 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.407129 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.407380 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.407609 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.407837 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.408065 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.408307 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.408389 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.408551 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.408794 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.409060 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.409303 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.409668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.410623 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.410864 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.411097 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.411333 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.411564 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.411811 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.412056 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.412215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.412298 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.412498 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.412580 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.412755 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.412836 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.413001 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.413089 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.413246 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.413335 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.413480 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.413562 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.413724 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.413805 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.413995 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.414089 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.414229 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.414444 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.414526 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.414681 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.414761 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.414918 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.415001 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.415153 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.415398 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.415634 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.415919 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.416113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.416361 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.416591 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.416820 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.417073 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.417319 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.417552 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.417786 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.418049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.418281 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.user = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.418526 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.418786 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.419018 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.419264 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.419511 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.419754 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.419988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.420216 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.420448 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.420681 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.420917 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.421145 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.421389 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.421633 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.421876 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.422152 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.422396 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.422625 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.422873 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.423111 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.423346 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.423580 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.423813 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.424058 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.424301 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.424536 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.424787 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.425015 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.425293 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.425530 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.425763 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.426022 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.426270 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.426510 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.426739 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.426978 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.427218 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] resource.caching = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.427467 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.427713 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.427946 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.428190 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.428437 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.428670 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.428914 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.429158 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.429540 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.429775 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] role.caching = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.430049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] role.driver = sql {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.430283 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.430531 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.430778 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.431027 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.431272 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.431518 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.431763 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.432006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.432255 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.432487 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.432732 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.432976 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.433219 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.433464 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.433889 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.434150 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.434399 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.434648 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.434896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.435147 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.435379 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.435633 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.435884 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.436122 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.436352 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.436581 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.436816 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.437196 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.437452 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.437699 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.437969 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.438195 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.438425 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.438661 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] token.caching = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.438899 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.439147 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.439385 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.439639 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.439885 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.440123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.440367 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.440610 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.440892 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.441132 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.441372 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.441608 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.441824 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.441911 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.442127 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.442357 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.442599 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.442862 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.443122 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.connection = **** {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.443365 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.443486 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.443611 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.443768 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.443850 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.444074 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.444308 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.444543 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.444777 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.445191 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.445433 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.445699 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.445964 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.446200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.446447 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.446681 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.446929 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.447170 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.447410 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.447645 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 29 16:00:29.447814 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 29 16:00:29.449171 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.449461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.449753 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.457814 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.458126 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.462592 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.462881 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.463159 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.463433 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.463857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.464136 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.464406 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.464668 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.475091 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.475348 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.475526 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.483622 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.483917 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.484574 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.488668 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.492276 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.492577 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.497559 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.501117 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.504741 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.505040 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.505222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.505372 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.505507 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.505719 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.506021 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.506305 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.525610 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.525901 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.526186 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.526442 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.534627 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.536828 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.537099 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.540138 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.540418 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.540694 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.540981 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.541252 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.545056 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.554623 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.554917 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.555196 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.555470 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.555742 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.556010 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.556300 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.573849 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.578961 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.582795 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.584392 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.584611 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.584849 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.586044 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.586301 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.586568 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.593874 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.595443 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.599216 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.599499 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.599774 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.600044 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.608857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.609138 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.609408 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.617303 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79610) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.617580 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.617855 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.618151 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.618417 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.618690 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.618962 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.619224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.619553 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.619826 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.620096 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.620354 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.620617 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.620872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79610) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.629076 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.629303 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.629523 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.629738 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.629975 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.630192 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.642935 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.643165 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.643384 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.643600 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.643816 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.644221 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.644541 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.652844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.655723 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.655951 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.656172 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.656388 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.656600 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.656812 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.657311 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79609) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 29 16:00:29.661218 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5650d87a99c0 pid: 79610 (default app) Oct 29 16:00:29.664588 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b766511-1d3d-47f7-8ba6-5eb9bf490a97 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:29.664874 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b766511-1d3d-47f7-8ba6-5eb9bf490a97 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:29.665151 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b766511-1d3d-47f7-8ba6-5eb9bf490a97 None None] PATH_INFO: `/v3` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:29.667874 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.668091 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 29 16:00:29.668442 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.668643 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 29 16:00:29.668910 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.669171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.669422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.669671 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.670073 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1/1] 10.222.0.41 () {50 vars in 791 bytes} [Fri Oct 29 16:00:29 2021] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:29.680971 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.681492 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.681894 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.682234 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.690657 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.696765 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.697057 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.697336 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.697613 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.697889 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.698189 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.698457 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.698750 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.699045 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.699295 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.699557 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.828631 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.830256 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.830539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.838673 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.838994 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.839350 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.849984 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.849984 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.855541 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.856041 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.856539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.856954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.857239 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.857524 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.857805 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.858098 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.877406 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.877699 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.882760 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.886462 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.886787 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.891963 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.896118 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.899735 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.900040 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.900325 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.900619 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.900904 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.901182 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.920181 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.920478 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.920746 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.921007 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.928857 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.930569 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.930844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.933836 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.934144 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.934578 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.934861 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.935144 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.950228 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.950528 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.950811 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.951091 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.951386 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.951660 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.951932 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.970928 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.974471 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.978042 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.979731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.981511 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.981794 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.982112 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.989462 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.991105 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:29.994384 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.994683 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.994964 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:29.995244 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:30.005156 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:30.005453 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:30.005733 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:30.013824 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79609) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 29 16:00:30.014066 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:30.014347 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:30.014623 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:30.014894 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:30.015173 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:30.015450 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:30.015717 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:30.015988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:30.016443 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:30.016737 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:30.017013 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:30.017299 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:30.017563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79609) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 29 16:00:30.060039 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5650d87a99c0 pid: 79609 (default app) Oct 29 16:00:37.496599 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5c164-48bc-47bd-8645-15f588e7401e None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:37.497143 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5c164-48bc-47bd-8645-15f588e7401e None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:37.497143 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5c164-48bc-47bd-8645-15f588e7401e None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:37.499207 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 2/2] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:00:37.507847 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f5536-d327-41b1-ae18-e56f1bbcd761 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:37.508429 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f5536-d327-41b1-ae18-e56f1bbcd761 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:37.508429 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f5536-d327-41b1-ae18-e56f1bbcd761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:37.541278 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG oslo_db.sqlalchemy.engines [None req-0a4f5536-d327-41b1-ae18-e56f1bbcd761 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 16:00:37.744873 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG passlib.handlers.bcrypt [None req-0a4f5536-d327-41b1-ae18-e56f1bbcd761 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79609) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 29 16:00:37.745301 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG passlib.handlers.bcrypt [None req-0a4f5536-d327-41b1-ae18-e56f1bbcd761 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79609) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 29 16:00:37.802640 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-0a4f5536-d327-41b1-ae18-e56f1bbcd761 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:37.804305 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-0a4f5536-d327-41b1-ae18-e56f1bbcd761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:37.945547 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1/3] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:00:38.115658 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5c164-48bc-47bd-8645-15f588e7401e None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:38.148504 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG oslo_db.sqlalchemy.engines [None req-a6b5c164-48bc-47bd-8645-15f588e7401e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79610) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 29 16:00:38.285467 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b5c164-48bc-47bd-8645-15f588e7401e None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:38.290085 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e42fa9-6de9-414c-b330-382237ca6787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:38.290824 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e42fa9-6de9-414c-b330-382237ca6787 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:38.291113 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e42fa9-6de9-414c-b330-382237ca6787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:38.291391 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e42fa9-6de9-414c-b330-382237ca6787 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:38.299990 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e42fa9-6de9-414c-b330-382237ca6787 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:38.351172 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.common.rbac_enforcer.enforcer [None req-81e42fa9-6de9-414c-b330-382237ca6787 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 29 16:00:38.351710 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e42fa9-6de9-414c-b330-382237ca6787 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:38.362564 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 3/4] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:00:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:00:38.370792 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f5536-d327-41b1-ae18-e56f1bbcd761 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:38.385551 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f5536-d327-41b1-ae18-e56f1bbcd761 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:38.390409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edff403-3a1e-45b4-9aa0-20fc128a467b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:38.391561 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edff403-3a1e-45b4-9aa0-20fc128a467b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:38.391846 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edff403-3a1e-45b4-9aa0-20fc128a467b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:38.392123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edff403-3a1e-45b4-9aa0-20fc128a467b admin admin] PATH_INFO: `/v3/projects/fe31d02174b84ed29a89c0315c571a54` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:38.394211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edff403-3a1e-45b4-9aa0-20fc128a467b admin admin] RBAC: Authorizing `identity:get_project(project_id=fe31d02174b84ed29a89c0315c571a54)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:38.443854 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5edff403-3a1e-45b4-9aa0-20fc128a467b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 29 16:00:38.444190 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edff403-3a1e-45b4-9aa0-20fc128a467b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:38.448959 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 2/5] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:00:38 2021] GET /identity/v3/projects/fe31d02174b84ed29a89c0315c571a54 => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:40.709303 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3737dc-c264-4f96-984f-ae7cdea943fd None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:40.709879 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3737dc-c264-4f96-984f-ae7cdea943fd None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:40.709879 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3737dc-c264-4f96-984f-ae7cdea943fd None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:40.714407 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 4/6] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:40 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:00:40.720703 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b57ab-f5fa-4cca-88de-70d478c4d44c None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:40.721138 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b57ab-f5fa-4cca-88de-70d478c4d44c None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:40.721264 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b57ab-f5fa-4cca-88de-70d478c4d44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:40.740367 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-573b57ab-f5fa-4cca-88de-70d478c4d44c None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:40.741892 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-573b57ab-f5fa-4cca-88de-70d478c4d44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:40.750301 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 3/7] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:00:40.774084 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3737dc-c264-4f96-984f-ae7cdea943fd None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:40.787086 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3737dc-c264-4f96-984f-ae7cdea943fd None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:40.791631 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420981a-8c83-4708-8e78-186dcd73bed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:40.792277 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420981a-8c83-4708-8e78-186dcd73bed7 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:40.792596 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420981a-8c83-4708-8e78-186dcd73bed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:40.792859 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420981a-8c83-4708-8e78-186dcd73bed7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:40.800830 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420981a-8c83-4708-8e78-186dcd73bed7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:40.802646 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420981a-8c83-4708-8e78-186dcd73bed7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:40.811370 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 5/8] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:00:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:00:40.817706 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b57ab-f5fa-4cca-88de-70d478c4d44c None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:40.827177 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b57ab-f5fa-4cca-88de-70d478c4d44c None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:40.832063 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0fca8-a786-4d79-aa0c-8c261fd18347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:40.832909 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0fca8-a786-4d79-aa0c-8c261fd18347 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:40.833183 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0fca8-a786-4d79-aa0c-8c261fd18347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:40.833451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0fca8-a786-4d79-aa0c-8c261fd18347 admin admin] PATH_INFO: `/v3/users/bfeda756d5b84f81aba1c8d226cdac52` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:40.834889 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0fca8-a786-4d79-aa0c-8c261fd18347 admin admin] RBAC: Authorizing `identity:get_user(user_id=bfeda756d5b84f81aba1c8d226cdac52)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:40.836727 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0fca8-a786-4d79-aa0c-8c261fd18347 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:40.838310 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 4/9] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:00:40 2021] GET /identity/v3/users/bfeda756d5b84f81aba1c8d226cdac52 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:43.157151 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914f21a-26f8-4112-9c2b-9e7f7c6b7451 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:43.157663 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914f21a-26f8-4112-9c2b-9e7f7c6b7451 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:43.157763 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4914f21a-26f8-4112-9c2b-9e7f7c6b7451 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:43.159519 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 6/10] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:00:43.165378 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa201da9-2b14-44f4-a471-24e6870a1529 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:43.165781 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa201da9-2b14-44f4-a471-24e6870a1529 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:43.165964 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa201da9-2b14-44f4-a471-24e6870a1529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:43.184712 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-aa201da9-2b14-44f4-a471-24e6870a1529 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:43.185909 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-aa201da9-2b14-44f4-a471-24e6870a1529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:43.193972 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 5/11] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:00:43.218622 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914f21a-26f8-4112-9c2b-9e7f7c6b7451 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:43.228279 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6c4cc-40de-4e63-9532-447640430d0a None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:43.228566 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6c4cc-40de-4e63-9532-447640430d0a None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:43.228842 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e6c4cc-40de-4e63-9532-447640430d0a None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:43.230704 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4914f21a-26f8-4112-9c2b-9e7f7c6b7451 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:43.230900 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 6/12] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:00:43.234907 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e428f0-96aa-49f7-958e-716501f18eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:43.236093 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e428f0-96aa-49f7-958e-716501f18eca admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:43.236373 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e428f0-96aa-49f7-958e-716501f18eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:43.236634 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed1bf2-b2b1-4f86-bd57-06fb72340d06 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:43.236723 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e428f0-96aa-49f7-958e-716501f18eca admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:43.236920 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed1bf2-b2b1-4f86-bd57-06fb72340d06 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:43.237197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ed1bf2-b2b1-4f86-bd57-06fb72340d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:43.252740 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e428f0-96aa-49f7-958e-716501f18eca admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:00:43.256191 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-17ed1bf2-b2b1-4f86-bd57-06fb72340d06 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:43.257402 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-17ed1bf2-b2b1-4f86-bd57-06fb72340d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:43.260165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-76e428f0-96aa-49f7-958e-716501f18eca admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:00:43.261375 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 7/13] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:00:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:00:43.265001 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 7/14] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:00:43.267629 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e428f0-96aa-49f7-958e-716501f18eca admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:43.278958 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e428f0-96aa-49f7-958e-716501f18eca admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:43.283318 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83186a4-6ef1-4cb4-ad31-2793c2aeac23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:43.283942 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83186a4-6ef1-4cb4-ad31-2793c2aeac23 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:43.284228 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83186a4-6ef1-4cb4-ad31-2793c2aeac23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:43.284509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83186a4-6ef1-4cb4-ad31-2793c2aeac23 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:43.285272 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83186a4-6ef1-4cb4-ad31-2793c2aeac23 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:00:43.285578 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83186a4-6ef1-4cb4-ad31-2793c2aeac23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:43.287385 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING py.warnings [None req-b83186a4-6ef1-4cb4-ad31-2793c2aeac23 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:00:43.287385 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: warnings.warn(msg) Oct 29 16:00:43.287385 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: Oct 29 16:00:43.288304 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83186a4-6ef1-4cb4-ad31-2793c2aeac23 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:43.288615 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed1bf2-b2b1-4f86-bd57-06fb72340d06 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:43.297300 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ed1bf2-b2b1-4f86-bd57-06fb72340d06 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:43.301664 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7de327-c687-4dc7-8692-2536a75e00ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:43.302331 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7de327-c687-4dc7-8692-2536a75e00ee admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:43.302617 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7de327-c687-4dc7-8692-2536a75e00ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:43.302857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 8/15] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:00:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:43.302965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7de327-c687-4dc7-8692-2536a75e00ee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:43.308532 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83186a4-6ef1-4cb4-ad31-2793c2aeac23 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:43.311052 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7de327-c687-4dc7-8692-2536a75e00ee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:43.312825 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7de327-c687-4dc7-8692-2536a75e00ee admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:43.318156 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83186a4-6ef1-4cb4-ad31-2793c2aeac23 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:43.322109 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 8/16] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:00:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:00:43.322510 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea7bb2-293f-4c7d-8c6f-1d638ffb473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:43.323368 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea7bb2-293f-4c7d-8c6f-1d638ffb473c admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:43.323651 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea7bb2-293f-4c7d-8c6f-1d638ffb473c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:43.323931 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea7bb2-293f-4c7d-8c6f-1d638ffb473c admin admin] PATH_INFO: `/v3/users/bfeda756d5b84f81aba1c8d226cdac52` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:43.325892 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea7bb2-293f-4c7d-8c6f-1d638ffb473c admin admin] RBAC: Authorizing `identity:get_user(user_id=bfeda756d5b84f81aba1c8d226cdac52)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:43.327725 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea7bb2-293f-4c7d-8c6f-1d638ffb473c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:43.328264 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7de327-c687-4dc7-8692-2536a75e00ee admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:43.329269 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 9/17] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:00:43 2021] GET /identity/v3/users/bfeda756d5b84f81aba1c8d226cdac52 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:00:43.335603 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea7bb2-293f-4c7d-8c6f-1d638ffb473c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:43.337569 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7de327-c687-4dc7-8692-2536a75e00ee admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:43.341980 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f8e3e-b10f-40d6-816d-effa9444d5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:43.342753 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f8e3e-b10f-40d6-816d-effa9444d5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:43.343038 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f8e3e-b10f-40d6-816d-effa9444d5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:43.343320 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366f8e3e-b10f-40d6-816d-effa9444d5e3 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:43.344513 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f8e3e-b10f-40d6-816d-effa9444d5e3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:43.345058 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea7bb2-293f-4c7d-8c6f-1d638ffb473c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:43.346253 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366f8e3e-b10f-40d6-816d-effa9444d5e3 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:43.347967 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 9/18] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:00:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:00:43.349464 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3a31f-44c8-4579-a0e5-9614f4abe7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:43.350245 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3a31f-44c8-4579-a0e5-9614f4abe7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:43.350529 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3a31f-44c8-4579-a0e5-9614f4abe7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:43.350964 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3a31f-44c8-4579-a0e5-9614f4abe7d4 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:43.352259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3a31f-44c8-4579-a0e5-9614f4abe7d4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:43.354015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3a31f-44c8-4579-a0e5-9614f4abe7d4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:43.355674 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 10/19] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:00:43 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:00:43.362450 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f8e3e-b10f-40d6-816d-effa9444d5e3 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:43.372626 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366f8e3e-b10f-40d6-816d-effa9444d5e3 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:43.377313 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24d93f0-80af-4e83-861f-8da5525a9339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:43.378559 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d93f0-80af-4e83-861f-8da5525a9339 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:43.378844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d93f0-80af-4e83-861f-8da5525a9339 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:43.379119 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24d93f0-80af-4e83-861f-8da5525a9339 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:43.379988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d93f0-80af-4e83-861f-8da5525a9339 admin admin] RBAC: Adding query filter params (role.id=f28d3f93a0524078a592a15459808378, scope.domain.id=default, user.id=bfeda756d5b84f81aba1c8d226cdac52) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:00:43.380301 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d93f0-80af-4e83-861f-8da5525a9339 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:43.382157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING py.warnings [None req-a24d93f0-80af-4e83-861f-8da5525a9339 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:00:43.382157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: warnings.warn(msg) Oct 29 16:00:43.382157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: Oct 29 16:00:43.383366 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24d93f0-80af-4e83-861f-8da5525a9339 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:43.391161 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 10/20] 10.222.0.41 () {56 vars in 1343 bytes} [Fri Oct 29 16:00:43 2021] GET /identity/v3/role_assignments?user.id=bfeda756d5b84f81aba1c8d226cdac52&scope.domain.id=default&role.id=f28d3f93a0524078a592a15459808378 => generated 233 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:45.991067 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea23d05-e8fb-4bc0-b909-27bf1567713f None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:45.992171 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea23d05-e8fb-4bc0-b909-27bf1567713f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:45.992648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea23d05-e8fb-4bc0-b909-27bf1567713f None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:45.994924 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 11/21] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:00:46.001293 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b30f3-3cee-47d5-8048-87ace221c3cf None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:46.002160 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b30f3-3cee-47d5-8048-87ace221c3cf None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:46.002647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971b30f3-3cee-47d5-8048-87ace221c3cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:46.021549 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-971b30f3-3cee-47d5-8048-87ace221c3cf None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:46.023274 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-971b30f3-3cee-47d5-8048-87ace221c3cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:46.037104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 11/22] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:00:46.082328 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea23d05-e8fb-4bc0-b909-27bf1567713f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:46.096301 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea23d05-e8fb-4bc0-b909-27bf1567713f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:46.105579 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311187a-d43b-4b17-8d8c-13a3d5423eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:46.106761 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311187a-d43b-4b17-8d8c-13a3d5423eef admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:46.107253 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311187a-d43b-4b17-8d8c-13a3d5423eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:46.107713 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311187a-d43b-4b17-8d8c-13a3d5423eef admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:46.125810 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311187a-d43b-4b17-8d8c-13a3d5423eef admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:00:46.134007 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-0311187a-d43b-4b17-8d8c-13a3d5423eef admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:00:46.142179 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b30f3-3cee-47d5-8048-87ace221c3cf None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:46.151831 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971b30f3-3cee-47d5-8048-87ace221c3cf None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:46.152407 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 12/23] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:00:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:00:46.165694 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f255a-7306-459b-96db-9082be9c20e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:46.166730 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f255a-7306-459b-96db-9082be9c20e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:46.167170 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f255a-7306-459b-96db-9082be9c20e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:46.167580 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f255a-7306-459b-96db-9082be9c20e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:46.168529 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f255a-7306-459b-96db-9082be9c20e4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:00:46.169002 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f255a-7306-459b-96db-9082be9c20e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:46.170219 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING py.warnings [None req-417f255a-7306-459b-96db-9082be9c20e4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:00:46.170219 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: warnings.warn(msg) Oct 29 16:00:46.170219 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: Oct 29 16:00:46.171423 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417f255a-7306-459b-96db-9082be9c20e4 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:46.187788 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 12/24] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:00:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:46.194463 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311187a-d43b-4b17-8d8c-13a3d5423eef admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:46.204870 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311187a-d43b-4b17-8d8c-13a3d5423eef admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:46.209646 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c5faf-6d95-4e4f-bd7a-96a4adaa8fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:46.210672 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c5faf-6d95-4e4f-bd7a-96a4adaa8fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:46.211109 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c5faf-6d95-4e4f-bd7a-96a4adaa8fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:46.211531 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c5faf-6d95-4e4f-bd7a-96a4adaa8fe1 admin admin] PATH_INFO: `/v3/users/bfeda756d5b84f81aba1c8d226cdac52` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:46.212898 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c5faf-6d95-4e4f-bd7a-96a4adaa8fe1 admin admin] RBAC: Authorizing `identity:get_user(user_id=bfeda756d5b84f81aba1c8d226cdac52)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:46.214907 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465c5faf-6d95-4e4f-bd7a-96a4adaa8fe1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:46.216936 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 13/25] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:00:46 2021] GET /identity/v3/users/bfeda756d5b84f81aba1c8d226cdac52 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:46.223716 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f255a-7306-459b-96db-9082be9c20e4 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:46.234539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f255a-7306-459b-96db-9082be9c20e4 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:46.239829 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dfd47-e750-420f-8de6-e0c81c97e326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:46.240774 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dfd47-e750-420f-8de6-e0c81c97e326 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:46.241195 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dfd47-e750-420f-8de6-e0c81c97e326 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:46.241625 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dfd47-e750-420f-8de6-e0c81c97e326 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:46.243397 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dfd47-e750-420f-8de6-e0c81c97e326 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:46.246314 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dfd47-e750-420f-8de6-e0c81c97e326 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:46.248392 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 13/26] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:00:46 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:46.254357 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c5faf-6d95-4e4f-bd7a-96a4adaa8fe1 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:46.264950 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465c5faf-6d95-4e4f-bd7a-96a4adaa8fe1 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:46.266692 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab586b-c7f4-483f-8c3c-beaa2af88f42 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:46.267800 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab586b-c7f4-483f-8c3c-beaa2af88f42 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:46.268650 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab586b-c7f4-483f-8c3c-beaa2af88f42 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:46.273387 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 14/27] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:46 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:00:46.274657 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339ec49-76b4-4383-a7da-0d94d5009d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:46.275687 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339ec49-76b4-4383-a7da-0d94d5009d1a admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:46.276113 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339ec49-76b4-4383-a7da-0d94d5009d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:46.277427 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b99e60-6486-4b18-a3e3-f15c616ecb6b None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:46.277846 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b99e60-6486-4b18-a3e3-f15c616ecb6b None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:46.278279 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b99e60-6486-4b18-a3e3-f15c616ecb6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:46.280032 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339ec49-76b4-4383-a7da-0d94d5009d1a admin admin] PATH_INFO: `/v3/domains/default/users/bfeda756d5b84f81aba1c8d226cdac52/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:46.284726 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339ec49-76b4-4383-a7da-0d94d5009d1a admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bfeda756d5b84f81aba1c8d226cdac52, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:46.287233 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING py.warnings [None req-a339ec49-76b4-4383-a7da-0d94d5009d1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:00:46.287233 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: warnings.warn(msg) Oct 29 16:00:46.287233 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: Oct 29 16:00:46.291294 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339ec49-76b4-4383-a7da-0d94d5009d1a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:46.304133 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-20b99e60-6486-4b18-a3e3-f15c616ecb6b None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:46.305814 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-20b99e60-6486-4b18-a3e3-f15c616ecb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:46.316614 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 15/28] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:00:46.337757 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c5bc1-d63e-4032-8f24-230ccf45e6b7 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:46.338066 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c5bc1-d63e-4032-8f24-230ccf45e6b7 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:46.338341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c5bc1-d63e-4032-8f24-230ccf45e6b7 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:46.340116 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 16/29] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:00:46.351515 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde78bf-2de7-4d91-b005-59efcf7e3ba7 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:46.351801 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde78bf-2de7-4d91-b005-59efcf7e3ba7 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:46.352081 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde78bf-2de7-4d91-b005-59efcf7e3ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:46.394969 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-2cde78bf-2de7-4d91-b005-59efcf7e3ba7 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:46.396176 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-2cde78bf-2de7-4d91-b005-59efcf7e3ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:46.460269 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 14/30] 10.222.0.41 () {58 vars in 1382 bytes} [Fri Oct 29 16:00:46 2021] PUT /identity/v3/domains/default/users/bfeda756d5b84f81aba1c8d226cdac52/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:00:46.461514 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339ec49-76b4-4383-a7da-0d94d5009d1a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:46.528845 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 17/31] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:00:46.578422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde78bf-2de7-4d91-b005-59efcf7e3ba7 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:46.593687 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde78bf-2de7-4d91-b005-59efcf7e3ba7 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:46.607686 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc88a2-2227-41f0-9ac0-e8a33cbaadf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:46.608386 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc88a2-2227-41f0-9ac0-e8a33cbaadf0 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:46.608675 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc88a2-2227-41f0-9ac0-e8a33cbaadf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:46.608958 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc88a2-2227-41f0-9ac0-e8a33cbaadf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:46.609739 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc88a2-2227-41f0-9ac0-e8a33cbaadf0 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:46.610801 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING py.warnings [None req-3adc88a2-2227-41f0-9ac0-e8a33cbaadf0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:00:46.610801 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: warnings.warn(msg) Oct 29 16:00:46.610801 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: Oct 29 16:00:46.611734 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc88a2-2227-41f0-9ac0-e8a33cbaadf0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:46.638350 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339ec49-76b4-4383-a7da-0d94d5009d1a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:46.647278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd596848-8c39-4769-9a13-f21c32b865a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:46.648176 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd596848-8c39-4769-9a13-f21c32b865a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:46.648467 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd596848-8c39-4769-9a13-f21c32b865a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:46.648749 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd596848-8c39-4769-9a13-f21c32b865a9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:46.665798 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd596848-8c39-4769-9a13-f21c32b865a9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:46.667982 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd596848-8c39-4769-9a13-f21c32b865a9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:46.691360 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-cd596848-8c39-4769-9a13-f21c32b865a9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:00:46.692938 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 15/32] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:00:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:00:46.707945 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd596848-8c39-4769-9a13-f21c32b865a9 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:46.724384 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd596848-8c39-4769-9a13-f21c32b865a9 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:46.740208 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ae5f3-cf49-4f79-9ee1-3e736937d268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:46.740893 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ae5f3-cf49-4f79-9ee1-3e736937d268 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:46.741181 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ae5f3-cf49-4f79-9ee1-3e736937d268 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:46.741462 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ae5f3-cf49-4f79-9ee1-3e736937d268 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:46.742259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ae5f3-cf49-4f79-9ee1-3e736937d268 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:00:46.742572 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ae5f3-cf49-4f79-9ee1-3e736937d268 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:46.743684 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING py.warnings [None req-e12ae5f3-cf49-4f79-9ee1-3e736937d268 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:00:46.743684 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: warnings.warn(msg) Oct 29 16:00:46.743684 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: Oct 29 16:00:46.744617 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ae5f3-cf49-4f79-9ee1-3e736937d268 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:46.792282 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 16/33] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:00:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:46.798155 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 18/34] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:00:46 2021] POST /identity/v3/roles => generated 219 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:00:46.799676 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ae5f3-cf49-4f79-9ee1-3e736937d268 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:46.820641 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ae5f3-cf49-4f79-9ee1-3e736937d268 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:46.831904 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab8a936-98f3-49f3-a07e-5b84b631151c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:46.832507 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8a936-98f3-49f3-a07e-5b84b631151c admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:46.832797 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8a936-98f3-49f3-a07e-5b84b631151c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:46.833074 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab8a936-98f3-49f3-a07e-5b84b631151c admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:46.833828 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8a936-98f3-49f3-a07e-5b84b631151c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:46.834887 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING py.warnings [None req-0ab8a936-98f3-49f3-a07e-5b84b631151c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:00:46.834887 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: warnings.warn(msg) Oct 29 16:00:46.834887 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: Oct 29 16:00:46.836295 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab8a936-98f3-49f3-a07e-5b84b631151c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:46.878806 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 17/35] 10.222.0.41 () {60 vars in 1162 bytes} [Fri Oct 29 16:00:46 2021] POST /identity/v3/projects => generated 301 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:00:47.221730 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3f0f0-e5f5-475d-804d-72ad6a6a3722 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:47.222404 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3f0f0-e5f5-475d-804d-72ad6a6a3722 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:47.222404 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3f0f0-e5f5-475d-804d-72ad6a6a3722 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:47.224333 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 19/36] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:00:47.230924 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3184470-f0be-4ffb-a62b-e43a4ef71be5 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:47.231450 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3184470-f0be-4ffb-a62b-e43a4ef71be5 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:47.231611 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3184470-f0be-4ffb-a62b-e43a4ef71be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:47.250287 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG passlib.handlers.bcrypt [None req-a3184470-f0be-4ffb-a62b-e43a4ef71be5 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79610) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 29 16:00:47.250717 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG passlib.handlers.bcrypt [None req-a3184470-f0be-4ffb-a62b-e43a4ef71be5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79610) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 29 16:00:47.300202 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-a3184470-f0be-4ffb-a62b-e43a4ef71be5 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:47.301842 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a3184470-f0be-4ffb-a62b-e43a4ef71be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:47.395668 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 18/37] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:00:47.420306 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3f0f0-e5f5-475d-804d-72ad6a6a3722 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:47.435423 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3f0f0-e5f5-475d-804d-72ad6a6a3722 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:47.439764 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4a98e-6c9c-4d2c-9729-4bc73d8a3e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:47.441048 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4a98e-6c9c-4d2c-9729-4bc73d8a3e86 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:47.441348 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4a98e-6c9c-4d2c-9729-4bc73d8a3e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:47.441631 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4a98e-6c9c-4d2c-9729-4bc73d8a3e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:47.442501 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4a98e-6c9c-4d2c-9729-4bc73d8a3e86 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:47.444334 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b4a98e-6c9c-4d2c-9729-4bc73d8a3e86 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:47.466084 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 20/38] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:00:47 2021] POST /identity/v3/roles => generated 225 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:00:47.552515 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044cd60-6980-4364-b789-b33678b41e5f None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:47.552811 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044cd60-6980-4364-b789-b33678b41e5f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:47.553087 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044cd60-6980-4364-b789-b33678b41e5f None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:47.555091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 19/39] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:00:47.562275 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8cdf1-241a-45f0-9a1b-9d045bb8af61 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:47.562608 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8cdf1-241a-45f0-9a1b-9d045bb8af61 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:47.562899 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8cdf1-241a-45f0-9a1b-9d045bb8af61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:47.584980 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-08e8cdf1-241a-45f0-9a1b-9d045bb8af61 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:47.586665 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-08e8cdf1-241a-45f0-9a1b-9d045bb8af61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:47.595535 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 21/40] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:00:47.620746 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044cd60-6980-4364-b789-b33678b41e5f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:47.638092 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044cd60-6980-4364-b789-b33678b41e5f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:47.642769 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64379a-40c9-4473-8ceb-f790d140f053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:47.643539 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64379a-40c9-4473-8ceb-f790d140f053 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:47.643828 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64379a-40c9-4473-8ceb-f790d140f053 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:47.644142 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64379a-40c9-4473-8ceb-f790d140f053 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:47.645274 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64379a-40c9-4473-8ceb-f790d140f053 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:47.646437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING py.warnings [None req-0b64379a-40c9-4473-8ceb-f790d140f053 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:00:47.646437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: warnings.warn(msg) Oct 29 16:00:47.646437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: Oct 29 16:00:47.647376 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64379a-40c9-4473-8ceb-f790d140f053 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:47.667785 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 20/41] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:00:47 2021] POST /identity/v3/roles => generated 223 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:00:47.714810 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f9562-abc5-4a10-80f6-32a089bcfa64 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:47.715100 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f9562-abc5-4a10-80f6-32a089bcfa64 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:47.715379 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f9562-abc5-4a10-80f6-32a089bcfa64 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:47.717333 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 22/42] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:00:47.724557 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc8b0e-6599-4eea-b9fb-188f7784c347 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:47.724975 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc8b0e-6599-4eea-b9fb-188f7784c347 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:47.725265 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc8b0e-6599-4eea-b9fb-188f7784c347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:47.747079 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-95cc8b0e-6599-4eea-b9fb-188f7784c347 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:47.748393 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-95cc8b0e-6599-4eea-b9fb-188f7784c347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:47.757582 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 21/43] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:00:47.781768 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f9562-abc5-4a10-80f6-32a089bcfa64 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:47.795039 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f9562-abc5-4a10-80f6-32a089bcfa64 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:47.799629 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cddb37-237f-4d3f-b8bb-0a6325ec5a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:47.801033 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cddb37-237f-4d3f-b8bb-0a6325ec5a5a admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:47.801320 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cddb37-237f-4d3f-b8bb-0a6325ec5a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:47.801595 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cddb37-237f-4d3f-b8bb-0a6325ec5a5a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:47.802956 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cddb37-237f-4d3f-b8bb-0a6325ec5a5a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:47.804668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cddb37-237f-4d3f-b8bb-0a6325ec5a5a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:47.806626 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 23/44] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:00:47 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:47.812848 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc8b0e-6599-4eea-b9fb-188f7784c347 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:47.822280 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc8b0e-6599-4eea-b9fb-188f7784c347 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:47.827288 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1045616-3ea4-400e-83d7-83827764177e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:47.827978 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1045616-3ea4-400e-83d7-83827764177e admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:47.828264 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1045616-3ea4-400e-83d7-83827764177e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:47.828544 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1045616-3ea4-400e-83d7-83827764177e admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:47.829575 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1045616-3ea4-400e-83d7-83827764177e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:47.831658 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1045616-3ea4-400e-83d7-83827764177e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:47.860172 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 22/45] 10.222.0.41 () {60 vars in 1162 bytes} [Fri Oct 29 16:00:47 2021] POST /identity/v3/projects => generated 312 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:00:49.203823 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d6824-bce7-477a-997f-e0aa82f5a64d None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:49.204339 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d6824-bce7-477a-997f-e0aa82f5a64d None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:49.204422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d6824-bce7-477a-997f-e0aa82f5a64d None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:49.206863 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 24/46] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:00:49.213051 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d1502-605e-4e7e-b3c3-7d71a76974d1 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:49.213463 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d1502-605e-4e7e-b3c3-7d71a76974d1 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:49.213611 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d1502-605e-4e7e-b3c3-7d71a76974d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:49.232807 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-498d1502-605e-4e7e-b3c3-7d71a76974d1 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:49.234079 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-498d1502-605e-4e7e-b3c3-7d71a76974d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:49.290917 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 23/47] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:00:49.315060 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d6824-bce7-477a-997f-e0aa82f5a64d None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:49.327647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d6824-bce7-477a-997f-e0aa82f5a64d None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:49.332728 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a3311-8912-46ea-84ab-faaaa0d01b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:49.333507 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a3311-8912-46ea-84ab-faaaa0d01b32 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:49.333792 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a3311-8912-46ea-84ab-faaaa0d01b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:49.334100 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a3311-8912-46ea-84ab-faaaa0d01b32 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:49.344990 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a3311-8912-46ea-84ab-faaaa0d01b32 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:00:49.351871 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-682a3311-8912-46ea-84ab-faaaa0d01b32 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:00:49.353041 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 25/48] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:00:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:00:49.359454 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d1502-605e-4e7e-b3c3-7d71a76974d1 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:49.368449 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d1502-605e-4e7e-b3c3-7d71a76974d1 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:49.372815 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f265f4-0125-49ab-bbca-c92ba8fa315a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:49.373471 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f265f4-0125-49ab-bbca-c92ba8fa315a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:49.373758 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f265f4-0125-49ab-bbca-c92ba8fa315a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:49.374065 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f265f4-0125-49ab-bbca-c92ba8fa315a admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:49.374835 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f265f4-0125-49ab-bbca-c92ba8fa315a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:00:49.375143 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f265f4-0125-49ab-bbca-c92ba8fa315a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:49.376763 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f265f4-0125-49ab-bbca-c92ba8fa315a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:49.385597 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 24/49] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:00:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:00:49.391636 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a3311-8912-46ea-84ab-faaaa0d01b32 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:49.402872 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a3311-8912-46ea-84ab-faaaa0d01b32 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:49.407269 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99872036-cc9f-4a2a-a5e8-0a75c2cdcb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:49.408130 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99872036-cc9f-4a2a-a5e8-0a75c2cdcb17 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:49.408419 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99872036-cc9f-4a2a-a5e8-0a75c2cdcb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:49.408699 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99872036-cc9f-4a2a-a5e8-0a75c2cdcb17 admin admin] PATH_INFO: `/v3/users/bfeda756d5b84f81aba1c8d226cdac52` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:49.410006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99872036-cc9f-4a2a-a5e8-0a75c2cdcb17 admin admin] RBAC: Authorizing `identity:get_user(user_id=bfeda756d5b84f81aba1c8d226cdac52)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:49.411856 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99872036-cc9f-4a2a-a5e8-0a75c2cdcb17 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:49.413639 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 26/50] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:00:49 2021] GET /identity/v3/users/bfeda756d5b84f81aba1c8d226cdac52 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:00:49.419329 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f265f4-0125-49ab-bbca-c92ba8fa315a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:49.428815 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f265f4-0125-49ab-bbca-c92ba8fa315a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:49.433162 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8b3bd-c172-4d44-b4ea-6ce00e8dc76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:49.433943 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8b3bd-c172-4d44-b4ea-6ce00e8dc76b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:49.434249 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8b3bd-c172-4d44-b4ea-6ce00e8dc76b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:49.434530 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8b3bd-c172-4d44-b4ea-6ce00e8dc76b admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:49.435724 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8b3bd-c172-4d44-b4ea-6ce00e8dc76b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:49.437424 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a8b3bd-c172-4d44-b4ea-6ce00e8dc76b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:49.439190 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 25/51] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:00:49 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:49.445300 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99872036-cc9f-4a2a-a5e8-0a75c2cdcb17 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:49.455445 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99872036-cc9f-4a2a-a5e8-0a75c2cdcb17 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:49.460345 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0326db-f659-4f48-978c-86a80de32080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:49.460972 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0326db-f659-4f48-978c-86a80de32080 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:49.461255 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0326db-f659-4f48-978c-86a80de32080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:49.461530 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0326db-f659-4f48-978c-86a80de32080 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:49.462420 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0326db-f659-4f48-978c-86a80de32080 admin admin] RBAC: Adding query filter params (role.id=f28d3f93a0524078a592a15459808378, scope.domain.id=default, user.id=bfeda756d5b84f81aba1c8d226cdac52) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:00:49.462726 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0326db-f659-4f48-978c-86a80de32080 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:49.464576 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0326db-f659-4f48-978c-86a80de32080 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:49.470240 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 27/52] 10.222.0.41 () {56 vars in 1343 bytes} [Fri Oct 29 16:00:49 2021] GET /identity/v3/role_assignments?user.id=bfeda756d5b84f81aba1c8d226cdac52&scope.domain.id=default&role.id=f28d3f93a0524078a592a15459808378 => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:50.092394 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d19752-ca2e-4c34-9c40-104760404136 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:50.092691 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d19752-ca2e-4c34-9c40-104760404136 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:50.092973 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d19752-ca2e-4c34-9c40-104760404136 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:50.094834 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 26/53] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:00:50.101149 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39787eab-a718-4fe8-8efe-8334a31f5005 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:50.101440 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39787eab-a718-4fe8-8efe-8334a31f5005 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:50.101718 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39787eab-a718-4fe8-8efe-8334a31f5005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:50.120125 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-39787eab-a718-4fe8-8efe-8334a31f5005 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:50.121307 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-39787eab-a718-4fe8-8efe-8334a31f5005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:50.128763 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 28/54] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:00:50.151927 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d19752-ca2e-4c34-9c40-104760404136 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:50.164299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d19752-ca2e-4c34-9c40-104760404136 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:50.168509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f331be2-d66d-4b43-bc8e-9962330d85f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:50.169275 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f331be2-d66d-4b43-bc8e-9962330d85f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:50.169558 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f331be2-d66d-4b43-bc8e-9962330d85f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:50.169834 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f331be2-d66d-4b43-bc8e-9962330d85f5 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:50.171038 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f331be2-d66d-4b43-bc8e-9962330d85f5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:50.172722 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f331be2-d66d-4b43-bc8e-9962330d85f5 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:50.174295 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 27/55] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:00:50 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:50.180546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39787eab-a718-4fe8-8efe-8334a31f5005 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:50.189261 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39787eab-a718-4fe8-8efe-8334a31f5005 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:50.193596 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6483105-c577-4ff4-8432-864f6a9713ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:50.194271 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6483105-c577-4ff4-8432-864f6a9713ff admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:50.194555 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6483105-c577-4ff4-8432-864f6a9713ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:50.194833 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6483105-c577-4ff4-8432-864f6a9713ff admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:50.195546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6483105-c577-4ff4-8432-864f6a9713ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:50.196560 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING py.warnings [None req-c6483105-c577-4ff4-8432-864f6a9713ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:00:50.196560 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: warnings.warn(msg) Oct 29 16:00:50.196560 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: Oct 29 16:00:50.197764 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6483105-c577-4ff4-8432-864f6a9713ff admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:50.224120 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 29/56] 10.222.0.41 () {60 vars in 1161 bytes} [Fri Oct 29 16:00:50 2021] POST /identity/v3/projects => generated 298 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:00:52.466567 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76d52c-116f-49bd-89df-4f4ef0189c19 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:52.467094 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76d52c-116f-49bd-89df-4f4ef0189c19 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:52.467181 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d76d52c-116f-49bd-89df-4f4ef0189c19 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:52.468919 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 28/57] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:00:52.475729 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df29f9e-fb99-4453-9513-bcabf40914f5 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:52.476217 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df29f9e-fb99-4453-9513-bcabf40914f5 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:52.476336 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df29f9e-fb99-4453-9513-bcabf40914f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:52.494436 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-1df29f9e-fb99-4453-9513-bcabf40914f5 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:52.495646 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-1df29f9e-fb99-4453-9513-bcabf40914f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:52.556326 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 30/58] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:00:52.582383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76d52c-116f-49bd-89df-4f4ef0189c19 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:52.594874 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d76d52c-116f-49bd-89df-4f4ef0189c19 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:52.600771 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372fdb23-2e1f-47a5-ad56-675c8cb8883e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:52.601597 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fdb23-2e1f-47a5-ad56-675c8cb8883e admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:52.602014 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fdb23-2e1f-47a5-ad56-675c8cb8883e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:52.602314 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372fdb23-2e1f-47a5-ad56-675c8cb8883e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:52.603567 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fdb23-2e1f-47a5-ad56-675c8cb8883e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:52.605582 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372fdb23-2e1f-47a5-ad56-675c8cb8883e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:52.607175 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 29/59] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:00:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:52.613353 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df29f9e-fb99-4453-9513-bcabf40914f5 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:52.622223 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df29f9e-fb99-4453-9513-bcabf40914f5 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:52.626627 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6c895-fed2-4756-b1ef-654ea7c1d224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:52.627283 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6c895-fed2-4756-b1ef-654ea7c1d224 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:52.627577 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6c895-fed2-4756-b1ef-654ea7c1d224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:52.627856 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6c895-fed2-4756-b1ef-654ea7c1d224 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:52.628581 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6c895-fed2-4756-b1ef-654ea7c1d224 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:52.629591 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING py.warnings [None req-66f6c895-fed2-4756-b1ef-654ea7c1d224 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:00:52.629591 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: warnings.warn(msg) Oct 29 16:00:52.629591 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: Oct 29 16:00:52.630874 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6c895-fed2-4756-b1ef-654ea7c1d224 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:52.655488 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 31/60] 10.222.0.41 () {60 vars in 1153 bytes} [Fri Oct 29 16:00:52 2021] POST /identity/v3/users => generated 275 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:00:55.991522 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0ac7c-1014-4ee6-8d85-d658afc15929 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:55.992359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0ac7c-1014-4ee6-8d85-d658afc15929 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:55.992882 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0ac7c-1014-4ee6-8d85-d658afc15929 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:55.994854 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 30/61] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:55 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:00:56.004992 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536b258-d0bc-4d30-9d1a-1321400a73ad None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.005445 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536b258-d0bc-4d30-9d1a-1321400a73ad None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.005754 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3536b258-d0bc-4d30-9d1a-1321400a73ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.031033 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-3536b258-d0bc-4d30-9d1a-1321400a73ad None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:56.032184 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-3536b258-d0bc-4d30-9d1a-1321400a73ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:56.041132 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 32/62] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:00:56.078500 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0ac7c-1014-4ee6-8d85-d658afc15929 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.096039 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0ac7c-1014-4ee6-8d85-d658afc15929 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.106119 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b53b3d-677a-4c65-adf3-fba22831d112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.107245 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b53b3d-677a-4c65-adf3-fba22831d112 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.107731 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b53b3d-677a-4c65-adf3-fba22831d112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.108206 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b53b3d-677a-4c65-adf3-fba22831d112 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.122747 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b53b3d-677a-4c65-adf3-fba22831d112 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:00:56.129991 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-c6b53b3d-677a-4c65-adf3-fba22831d112 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 16:00:56.131463 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 31/63] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/roles/member => generated 84 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:00:56.138099 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536b258-d0bc-4d30-9d1a-1321400a73ad None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.152474 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3536b258-d0bc-4d30-9d1a-1321400a73ad None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.162814 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b94bf-5105-433c-b877-0a5e3f3a11ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.163506 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b94bf-5105-433c-b877-0a5e3f3a11ef admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.163795 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b94bf-5105-433c-b877-0a5e3f3a11ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.164080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7b94bf-5105-433c-b877-0a5e3f3a11ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.164859 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b94bf-5105-433c-b877-0a5e3f3a11ef admin admin] RBAC: Adding query filter params (name=member) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:00:56.165170 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b94bf-5105-433c-b877-0a5e3f3a11ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:56.166818 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7b94bf-5105-433c-b877-0a5e3f3a11ef admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:56.183209 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 33/64] 10.222.0.41 () {56 vars in 1122 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:56.189419 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b53b3d-677a-4c65-adf3-fba22831d112 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.203346 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b53b3d-677a-4c65-adf3-fba22831d112 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.213608 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee877b8d-4315-46a8-9f8c-c8d59cf81af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.214831 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee877b8d-4315-46a8-9f8c-c8d59cf81af3 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.215324 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee877b8d-4315-46a8-9f8c-c8d59cf81af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.215816 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee877b8d-4315-46a8-9f8c-c8d59cf81af3 admin admin] PATH_INFO: `/v3/users/9633a24420954abdbab396f4125ba772` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.240707 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee877b8d-4315-46a8-9f8c-c8d59cf81af3 admin admin] RBAC: Authorizing `identity:get_user(user_id=9633a24420954abdbab396f4125ba772)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:56.243284 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee877b8d-4315-46a8-9f8c-c8d59cf81af3 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:56.245235 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 32/65] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/users/9633a24420954abdbab396f4125ba772 => generated 275 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:56.251541 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b94bf-5105-433c-b877-0a5e3f3a11ef admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.262106 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a02425-87d3-452f-a6bc-897007e7d44c None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.262717 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a02425-87d3-452f-a6bc-897007e7d44c None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.263230 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a02425-87d3-452f-a6bc-897007e7d44c None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.265601 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 33/66] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:00:56.270033 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7b94bf-5105-433c-b877-0a5e3f3a11ef admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.272801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bc50c-f209-4e30-b23a-9101a0223da7 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.273416 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bc50c-f209-4e30-b23a-9101a0223da7 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.273894 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bc50c-f209-4e30-b23a-9101a0223da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.280980 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4b94a-9cbd-415c-ade5-5c79c6076dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.282773 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4b94a-9cbd-415c-ade5-5c79c6076dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.283292 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4b94a-9cbd-415c-ade5-5c79c6076dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.289241 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db4b94a-9cbd-415c-ade5-5c79c6076dd6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.300472 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-8a0bc50c-f209-4e30-b23a-9101a0223da7 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:56.301667 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8a0bc50c-f209-4e30-b23a-9101a0223da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:56.305677 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4b94a-9cbd-415c-ade5-5c79c6076dd6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:56.307995 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db4b94a-9cbd-415c-ade5-5c79c6076dd6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:56.319632 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 34/67] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:00:56.329070 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 34/68] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:00:56.336150 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bc50c-f209-4e30-b23a-9101a0223da7 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.352076 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4b94a-9cbd-415c-ade5-5c79c6076dd6 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.357871 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bc50c-f209-4e30-b23a-9101a0223da7 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.364180 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db4b94a-9cbd-415c-ade5-5c79c6076dd6 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.369013 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab2abc-9e74-47ac-bb08-a5cf1a8f9e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.369902 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab2abc-9e74-47ac-bb08-a5cf1a8f9e5e admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.370212 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab2abc-9e74-47ac-bb08-a5cf1a8f9e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.370486 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab2abc-9e74-47ac-bb08-a5cf1a8f9e5e admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.372476 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab2abc-9e74-47ac-bb08-a5cf1a8f9e5e admin admin] RBAC: Authorizing `identity:get_project(project_id=77d119a645a14cd79d87aae94a06ec80)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:56.374701 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab2abc-9e74-47ac-bb08-a5cf1a8f9e5e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:56.378575 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ec170-c457-4fad-b096-f25f85944fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.379400 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ec170-c457-4fad-b096-f25f85944fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.379680 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ec170-c457-4fad-b096-f25f85944fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.379958 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ec170-c457-4fad-b096-f25f85944fa2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.381103 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 35/69] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80 => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:56.387625 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab2abc-9e74-47ac-bb08-a5cf1a8f9e5e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.400604 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab2abc-9e74-47ac-bb08-a5cf1a8f9e5e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.405390 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003ec170-c457-4fad-b096-f25f85944fa2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:00:56.413012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-003ec170-c457-4fad-b096-f25f85944fa2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:00:56.414296 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 35/70] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:00:56.416372 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674bca8-92bb-40b9-981f-f24413b33bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.417043 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674bca8-92bb-40b9-981f-f24413b33bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.417332 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674bca8-92bb-40b9-981f-f24413b33bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.417614 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4674bca8-92bb-40b9-981f-f24413b33bd2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.418503 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674bca8-92bb-40b9-981f-f24413b33bd2 admin admin] RBAC: Adding query filter params (role.id=4a1afb6391114961afeec5c1d72563f0, scope.project.id=77d119a645a14cd79d87aae94a06ec80, user.id=9633a24420954abdbab396f4125ba772) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:00:56.418820 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674bca8-92bb-40b9-981f-f24413b33bd2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:56.419911 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING py.warnings [None req-4674bca8-92bb-40b9-981f-f24413b33bd2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:00:56.419911 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: warnings.warn(msg) Oct 29 16:00:56.419911 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: Oct 29 16:00:56.421085 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4674bca8-92bb-40b9-981f-f24413b33bd2 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:56.421255 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ec170-c457-4fad-b096-f25f85944fa2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.433623 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 36/71] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/role_assignments?user.id=9633a24420954abdbab396f4125ba772&scope.project.id=77d119a645a14cd79d87aae94a06ec80&role.id=4a1afb6391114961afeec5c1d72563f0 => generated 259 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:00:56.440742 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ec170-c457-4fad-b096-f25f85944fa2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.448222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b433e-4224-405a-a1e0-103d500e3e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.448913 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b433e-4224-405a-a1e0-103d500e3e84 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.449204 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b433e-4224-405a-a1e0-103d500e3e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.449487 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427b433e-4224-405a-a1e0-103d500e3e84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.450572 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b433e-4224-405a-a1e0-103d500e3e84 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:00:56.450887 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b433e-4224-405a-a1e0-103d500e3e84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:56.452637 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427b433e-4224-405a-a1e0-103d500e3e84 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:56.465963 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 36/72] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:56.473630 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674bca8-92bb-40b9-981f-f24413b33bd2 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.483874 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4674bca8-92bb-40b9-981f-f24413b33bd2 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.494628 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f76f27-da4a-42cf-b703-828fb158c932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.495522 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f76f27-da4a-42cf-b703-828fb158c932 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.495813 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f76f27-da4a-42cf-b703-828fb158c932 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.496094 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f76f27-da4a-42cf-b703-828fb158c932 admin admin] PATH_INFO: `/v3/users/bfeda756d5b84f81aba1c8d226cdac52` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.497388 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f76f27-da4a-42cf-b703-828fb158c932 admin admin] RBAC: Authorizing `identity:get_user(user_id=bfeda756d5b84f81aba1c8d226cdac52)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:56.499269 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f76f27-da4a-42cf-b703-828fb158c932 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:56.500935 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 37/73] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/users/bfeda756d5b84f81aba1c8d226cdac52 => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:56.507811 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b433e-4224-405a-a1e0-103d500e3e84 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.524397 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427b433e-4224-405a-a1e0-103d500e3e84 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.535101 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364906de-a5e6-4498-bfef-9ad0ab9e6eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.535725 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364906de-a5e6-4498-bfef-9ad0ab9e6eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.536017 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364906de-a5e6-4498-bfef-9ad0ab9e6eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.536300 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364906de-a5e6-4498-bfef-9ad0ab9e6eb1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.548944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364906de-a5e6-4498-bfef-9ad0ab9e6eb1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:56.550948 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364906de-a5e6-4498-bfef-9ad0ab9e6eb1 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:56.564386 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 37/74] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:00:56.571708 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f76f27-da4a-42cf-b703-828fb158c932 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.575928 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4fb1f-3d77-4036-8223-3c0c36b4ce91 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.576438 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4fb1f-3d77-4036-8223-3c0c36b4ce91 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.576886 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f4fb1f-3d77-4036-8223-3c0c36b4ce91 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.578981 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 38/75] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:56 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:00:56.587843 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f76f27-da4a-42cf-b703-828fb158c932 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.589169 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f8bcb-17ff-4230-aaad-30fd50c619b2 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.589669 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f8bcb-17ff-4230-aaad-30fd50c619b2 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.590163 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f8bcb-17ff-4230-aaad-30fd50c619b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.602825 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23f9b7-35e3-47d9-94af-016052fc579a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.603716 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23f9b7-35e3-47d9-94af-016052fc579a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.604002 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23f9b7-35e3-47d9-94af-016052fc579a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.604284 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb23f9b7-35e3-47d9-94af-016052fc579a admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.605670 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23f9b7-35e3-47d9-94af-016052fc579a admin admin] RBAC: Authorizing `identity:get_project(project_id=77d119a645a14cd79d87aae94a06ec80)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:56.607849 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb23f9b7-35e3-47d9-94af-016052fc579a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:56.609702 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 38/76] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80 => generated 298 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:56.619658 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-ce8f8bcb-17ff-4230-aaad-30fd50c619b2 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:56.621537 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ce8f8bcb-17ff-4230-aaad-30fd50c619b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:56.624500 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23f9b7-35e3-47d9-94af-016052fc579a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.631999 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 39/77] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:00:56.647123 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb23f9b7-35e3-47d9-94af-016052fc579a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.656803 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caee1b1f-2a32-4c98-81af-d180116ca822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.657477 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee1b1f-2a32-4c98-81af-d180116ca822 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.657766 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee1b1f-2a32-4c98-81af-d180116ca822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.658172 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caee1b1f-2a32-4c98-81af-d180116ca822 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.659326 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee1b1f-2a32-4c98-81af-d180116ca822 admin admin] RBAC: Adding query filter params (role.id=f28d3f93a0524078a592a15459808378, scope.project.id=77d119a645a14cd79d87aae94a06ec80, user.id=bfeda756d5b84f81aba1c8d226cdac52) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:00:56.659645 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee1b1f-2a32-4c98-81af-d180116ca822 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:56.660109 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f8bcb-17ff-4230-aaad-30fd50c619b2 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.661537 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caee1b1f-2a32-4c98-81af-d180116ca822 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:56.670231 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f8bcb-17ff-4230-aaad-30fd50c619b2 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.671820 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 39/78] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/role_assignments?user.id=bfeda756d5b84f81aba1c8d226cdac52&scope.project.id=77d119a645a14cd79d87aae94a06ec80&role.id=f28d3f93a0524078a592a15459808378 => generated 259 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:00:56.685317 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4174a7-2801-4a76-ab27-6840dab7bc51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.685779 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c991a33-7cf4-4e5f-bade-0f0e18b26286 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.686112 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c991a33-7cf4-4e5f-bade-0f0e18b26286 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.686403 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c991a33-7cf4-4e5f-bade-0f0e18b26286 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.687154 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4174a7-2801-4a76-ab27-6840dab7bc51 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.687630 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4174a7-2801-4a76-ab27-6840dab7bc51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.688087 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4174a7-2801-4a76-ab27-6840dab7bc51 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.688548 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 40/79] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:00:56.695951 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e817d3a-69ed-4879-a3ee-92c00b9ac3f2 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.696242 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e817d3a-69ed-4879-a3ee-92c00b9ac3f2 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.696522 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e817d3a-69ed-4879-a3ee-92c00b9ac3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.703848 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4174a7-2801-4a76-ab27-6840dab7bc51 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:00:56.712990 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-2d4174a7-2801-4a76-ab27-6840dab7bc51 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 16:00:56.714669 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 40/80] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:00:56.722268 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4174a7-2801-4a76-ab27-6840dab7bc51 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.733880 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4174a7-2801-4a76-ab27-6840dab7bc51 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.739287 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4373cc7-6387-45e8-a2b5-a812e41dd966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.740722 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4373cc7-6387-45e8-a2b5-a812e41dd966 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.741341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4373cc7-6387-45e8-a2b5-a812e41dd966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.741853 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4373cc7-6387-45e8-a2b5-a812e41dd966 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.743035 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4373cc7-6387-45e8-a2b5-a812e41dd966 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:00:56.743594 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4373cc7-6387-45e8-a2b5-a812e41dd966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:56.745586 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4373cc7-6387-45e8-a2b5-a812e41dd966 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:56.749159 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-7e817d3a-69ed-4879-a3ee-92c00b9ac3f2 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:56.750497 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7e817d3a-69ed-4879-a3ee-92c00b9ac3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:56.762234 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 41/81] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:56.766122 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4373cc7-6387-45e8-a2b5-a812e41dd966 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.785196 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 41/82] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 29 16:00:56.786722 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f565ad3-5fb1-4bfb-a887-8daa5a304a15 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.787084 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f565ad3-5fb1-4bfb-a887-8daa5a304a15 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.787444 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f565ad3-5fb1-4bfb-a887-8daa5a304a15 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.789684 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 42/83] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:00:56.797054 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4373cc7-6387-45e8-a2b5-a812e41dd966 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.799375 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e9c9d-b446-400b-bc45-5c8374107198 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.799719 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e9c9d-b446-400b-bc45-5c8374107198 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.799973 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e9c9d-b446-400b-bc45-5c8374107198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.811406 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a983b5-7acd-414b-b5b3-2f684f09e9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.812340 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a983b5-7acd-414b-b5b3-2f684f09e9db admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.812620 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a983b5-7acd-414b-b5b3-2f684f09e9db admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.812897 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a983b5-7acd-414b-b5b3-2f684f09e9db admin admin] PATH_INFO: `/v3/users/9633a24420954abdbab396f4125ba772` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.815911 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a983b5-7acd-414b-b5b3-2f684f09e9db admin admin] RBAC: Authorizing `identity:get_user(user_id=9633a24420954abdbab396f4125ba772)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:56.818752 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a983b5-7acd-414b-b5b3-2f684f09e9db admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:56.820932 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 42/84] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/users/9633a24420954abdbab396f4125ba772 => generated 275 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:00:56.822103 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a983b5-7acd-414b-b5b3-2f684f09e9db admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.826314 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-3c1e9c9d-b446-400b-bc45-5c8374107198 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:56.827735 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3c1e9c9d-b446-400b-bc45-5c8374107198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:56.834749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a983b5-7acd-414b-b5b3-2f684f09e9db admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.839140 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 43/85] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:00:56.840338 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e9c9d-b446-400b-bc45-5c8374107198 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.842925 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f988ca-f81a-419c-9b2c-8fafc6eda8cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.843799 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f988ca-f81a-419c-9b2c-8fafc6eda8cc admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.844056 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f988ca-f81a-419c-9b2c-8fafc6eda8cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.844338 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f988ca-f81a-419c-9b2c-8fafc6eda8cc admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.853471 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e9c9d-b446-400b-bc45-5c8374107198 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.859605 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f988ca-f81a-419c-9b2c-8fafc6eda8cc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:00:56.860003 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d1cab-0744-45e5-bf46-8545d14ef330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.860878 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d1cab-0744-45e5-bf46-8545d14ef330 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.861347 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d1cab-0744-45e5-bf46-8545d14ef330 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.861830 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d1cab-0744-45e5-bf46-8545d14ef330 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.867007 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-80f988ca-f81a-419c-9b2c-8fafc6eda8cc admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 16:00:56.873574 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 43/86] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:00:56.873574 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f988ca-f81a-419c-9b2c-8fafc6eda8cc admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.880539 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d1cab-0744-45e5-bf46-8545d14ef330 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:56.881941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f988ca-f81a-419c-9b2c-8fafc6eda8cc admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.882564 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d1cab-0744-45e5-bf46-8545d14ef330 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:56.886805 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bd164-e01d-4093-993a-95e80c1e01c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.887918 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bd164-e01d-4093-993a-95e80c1e01c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.888211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bd164-e01d-4093-993a-95e80c1e01c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.889177 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2bd164-e01d-4093-993a-95e80c1e01c2 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.890881 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bd164-e01d-4093-993a-95e80c1e01c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:56.892688 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2bd164-e01d-4093-993a-95e80c1e01c2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:56.893112 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 44/87] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:00:56.894702 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d1cab-0744-45e5-bf46-8545d14ef330 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.895104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 44/88] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:56.900736 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bd164-e01d-4093-993a-95e80c1e01c2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.910357 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d1cab-0744-45e5-bf46-8545d14ef330 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.911463 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2bd164-e01d-4093-993a-95e80c1e01c2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.915657 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c0570-e1c3-47f0-b403-76ae5bff1f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.916359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c0570-e1c3-47f0-b403-76ae5bff1f47 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.916649 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c0570-e1c3-47f0-b403-76ae5bff1f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.916818 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f444d0-c871-4ba3-ba08-aa161e4cdf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.916934 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c0570-e1c3-47f0-b403-76ae5bff1f47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.917729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c0570-e1c3-47f0-b403-76ae5bff1f47 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:00:56.918105 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c0570-e1c3-47f0-b403-76ae5bff1f47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:56.918274 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f444d0-c871-4ba3-ba08-aa161e4cdf2c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.918689 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f444d0-c871-4ba3-ba08-aa161e4cdf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.919101 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f444d0-c871-4ba3-ba08-aa161e4cdf2c admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.919777 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c0570-e1c3-47f0-b403-76ae5bff1f47 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:56.920817 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f444d0-c871-4ba3-ba08-aa161e4cdf2c admin admin] RBAC: Authorizing `identity:get_project(project_id=77d119a645a14cd79d87aae94a06ec80)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:56.923206 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f444d0-c871-4ba3-ba08-aa161e4cdf2c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:56.929504 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 45/90] 10.222.0.41 () {56 vars in 1122 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:56.929782 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 45/90] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:56.930481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c0570-e1c3-47f0-b403-76ae5bff1f47 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.932954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f444d0-c871-4ba3-ba08-aa161e4cdf2c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.942764 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c0570-e1c3-47f0-b403-76ae5bff1f47 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.944348 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f444d0-c871-4ba3-ba08-aa161e4cdf2c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.948332 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d71a4-1112-4024-b8fc-71be1eb9e6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.948850 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d71a4-1112-4024-b8fc-71be1eb9e6e0 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.949138 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d71a4-1112-4024-b8fc-71be1eb9e6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.949474 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d71a4-1112-4024-b8fc-71be1eb9e6e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.950583 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d71a4-1112-4024-b8fc-71be1eb9e6e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:56.952383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793c223-d8f0-4c61-aac2-0387002ebec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.952616 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981d71a4-1112-4024-b8fc-71be1eb9e6e0 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:56.953480 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793c223-d8f0-4c61-aac2-0387002ebec8 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.954002 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793c223-d8f0-4c61-aac2-0387002ebec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.954498 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793c223-d8f0-4c61-aac2-0387002ebec8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.955582 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793c223-d8f0-4c61-aac2-0387002ebec8 admin admin] RBAC: Adding query filter params (role.id=8eba80d4381a47ffb74df6e1f9dda34a, scope.project.id=77d119a645a14cd79d87aae94a06ec80, user.id=9633a24420954abdbab396f4125ba772) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:00:56.956531 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793c223-d8f0-4c61-aac2-0387002ebec8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:56.958584 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793c223-d8f0-4c61-aac2-0387002ebec8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:56.965880 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 46/91] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/role_assignments?user.id=9633a24420954abdbab396f4125ba772&scope.project.id=77d119a645a14cd79d87aae94a06ec80&role.id=8eba80d4381a47ffb74df6e1f9dda34a => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:00:56.966922 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793c223-d8f0-4c61-aac2-0387002ebec8 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:56.978549 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793c223-d8f0-4c61-aac2-0387002ebec8 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:56.988143 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1aac8-c730-44fe-a7b6-bb660f5a36f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:56.989205 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1aac8-c730-44fe-a7b6-bb660f5a36f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:56.989907 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1aac8-c730-44fe-a7b6-bb660f5a36f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:56.991702 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e1aac8-c730-44fe-a7b6-bb660f5a36f1 admin admin] PATH_INFO: `/v3/users/9633a24420954abdbab396f4125ba772` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:56.993183 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 46/92] 10.222.0.41 () {60 vars in 1162 bytes} [Fri Oct 29 16:00:56 2021] POST /identity/v3/projects => generated 302 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:00:56.994261 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1aac8-c730-44fe-a7b6-bb660f5a36f1 admin admin] RBAC: Authorizing `identity:get_user(user_id=9633a24420954abdbab396f4125ba772)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:56.996767 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e1aac8-c730-44fe-a7b6-bb660f5a36f1 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:56.999098 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 47/93] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:00:56 2021] GET /identity/v3/users/9633a24420954abdbab396f4125ba772 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:57.007219 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d71a4-1112-4024-b8fc-71be1eb9e6e0 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:57.100241 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981d71a4-1112-4024-b8fc-71be1eb9e6e0 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:57.105289 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ac796-948d-446b-baff-0591ba9e1103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:57.106024 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ac796-948d-446b-baff-0591ba9e1103 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:57.106314 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ac796-948d-446b-baff-0591ba9e1103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:57.106596 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ac796-948d-446b-baff-0591ba9e1103 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:57.120664 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ac796-948d-446b-baff-0591ba9e1103 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:57.122632 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347ac796-948d-446b-baff-0591ba9e1103 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:57.136566 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 47/94] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:00:57 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:00:57.143183 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1aac8-c730-44fe-a7b6-bb660f5a36f1 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:57.159948 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e1aac8-c730-44fe-a7b6-bb660f5a36f1 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:57.176179 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ff92c4-17be-467c-b686-325cac2397f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:57.177124 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff92c4-17be-467c-b686-325cac2397f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:57.177416 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff92c4-17be-467c-b686-325cac2397f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:57.177702 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ff92c4-17be-467c-b686-325cac2397f3 admin admin] PATH_INFO: `/v3/projects/04cbc33f4bf74d74bcf6ce860dd3a783` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:57.182977 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff92c4-17be-467c-b686-325cac2397f3 admin admin] RBAC: Authorizing `identity:get_project(project_id=04cbc33f4bf74d74bcf6ce860dd3a783)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:57.185268 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ff92c4-17be-467c-b686-325cac2397f3 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:57.187668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 48/95] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:00:57 2021] GET /identity/v3/projects/04cbc33f4bf74d74bcf6ce860dd3a783 => generated 312 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:57.194904 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ac796-948d-446b-baff-0591ba9e1103 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:57.207784 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ac796-948d-446b-baff-0591ba9e1103 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:57.218428 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0de6e-a8e0-4526-b047-e8a458311774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:57.219108 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0de6e-a8e0-4526-b047-e8a458311774 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:57.219393 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0de6e-a8e0-4526-b047-e8a458311774 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:57.219671 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0de6e-a8e0-4526-b047-e8a458311774 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:57.220545 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0de6e-a8e0-4526-b047-e8a458311774 admin admin] RBAC: Adding query filter params (role.id=4a1afb6391114961afeec5c1d72563f0, scope.project.id=04cbc33f4bf74d74bcf6ce860dd3a783, user.id=9633a24420954abdbab396f4125ba772) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:00:57.220857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0de6e-a8e0-4526-b047-e8a458311774 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:57.222889 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0de6e-a8e0-4526-b047-e8a458311774 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:57.234926 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 48/96] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:00:57 2021] GET /identity/v3/role_assignments?user.id=9633a24420954abdbab396f4125ba772&scope.project.id=04cbc33f4bf74d74bcf6ce860dd3a783&role.id=4a1afb6391114961afeec5c1d72563f0 => generated 259 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:59.320940 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d02c3-249f-4b7d-8e48-4147dc76d467 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:59.321442 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d02c3-249f-4b7d-8e48-4147dc76d467 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:59.321545 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d02c3-249f-4b7d-8e48-4147dc76d467 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:59.323463 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 49/97] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:00:59.329752 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42bb62-b9aa-4489-8172-e1b7fad55377 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:59.330197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42bb62-b9aa-4489-8172-e1b7fad55377 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:59.330365 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42bb62-b9aa-4489-8172-e1b7fad55377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:59.354252 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-1f42bb62-b9aa-4489-8172-e1b7fad55377 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:59.355435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1f42bb62-b9aa-4489-8172-e1b7fad55377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:59.368675 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 49/98] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:00:59.411527 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d02c3-249f-4b7d-8e48-4147dc76d467 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:59.431540 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d02c3-249f-4b7d-8e48-4147dc76d467 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:59.436038 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45588b2-48bc-41c4-ae15-a588c7e05c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:59.436845 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45588b2-48bc-41c4-ae15-a588c7e05c39 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:59.437132 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45588b2-48bc-41c4-ae15-a588c7e05c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:59.437407 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45588b2-48bc-41c4-ae15-a588c7e05c39 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:59.453106 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45588b2-48bc-41c4-ae15-a588c7e05c39 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:00:59.464284 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-c45588b2-48bc-41c4-ae15-a588c7e05c39 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 16:00:59.465524 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 50/99] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:00:59 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:00:59.472128 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42bb62-b9aa-4489-8172-e1b7fad55377 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:59.487418 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42bb62-b9aa-4489-8172-e1b7fad55377 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:59.491845 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93c5f4-64f1-486a-8d76-2f8899d583ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:59.492510 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93c5f4-64f1-486a-8d76-2f8899d583ca admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:59.492792 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93c5f4-64f1-486a-8d76-2f8899d583ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:59.493069 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f93c5f4-64f1-486a-8d76-2f8899d583ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:59.493846 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93c5f4-64f1-486a-8d76-2f8899d583ca admin admin] RBAC: Adding query filter params (name=member) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:00:59.494171 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93c5f4-64f1-486a-8d76-2f8899d583ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:59.495796 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f93c5f4-64f1-486a-8d76-2f8899d583ca admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:59.516163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 50/100] 10.222.0.41 () {56 vars in 1122 bytes} [Fri Oct 29 16:00:59 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:59.522631 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45588b2-48bc-41c4-ae15-a588c7e05c39 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:59.535508 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45588b2-48bc-41c4-ae15-a588c7e05c39 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:59.544335 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87748b69-7a3a-4a97-9cd4-15a07b9e9a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:59.545244 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87748b69-7a3a-4a97-9cd4-15a07b9e9a5c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:59.545532 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87748b69-7a3a-4a97-9cd4-15a07b9e9a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:59.545815 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87748b69-7a3a-4a97-9cd4-15a07b9e9a5c admin admin] PATH_INFO: `/v3/users/9633a24420954abdbab396f4125ba772` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:59.550966 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87748b69-7a3a-4a97-9cd4-15a07b9e9a5c admin admin] RBAC: Authorizing `identity:get_user(user_id=9633a24420954abdbab396f4125ba772)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:59.553266 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87748b69-7a3a-4a97-9cd4-15a07b9e9a5c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:59.555124 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 51/101] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:00:59 2021] GET /identity/v3/users/9633a24420954abdbab396f4125ba772 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:59.561628 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93c5f4-64f1-486a-8d76-2f8899d583ca admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:59.575784 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f93c5f4-64f1-486a-8d76-2f8899d583ca admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:59.580303 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d05aed9-c5fc-45bf-86dc-b1d514a85451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:59.581209 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05aed9-c5fc-45bf-86dc-b1d514a85451 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:59.581488 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05aed9-c5fc-45bf-86dc-b1d514a85451 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:59.581765 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d05aed9-c5fc-45bf-86dc-b1d514a85451 admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:59.583260 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05aed9-c5fc-45bf-86dc-b1d514a85451 admin admin] RBAC: Authorizing `identity:get_project(project_id=77d119a645a14cd79d87aae94a06ec80)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:59.585406 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d05aed9-c5fc-45bf-86dc-b1d514a85451 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:59.587450 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 51/102] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:00:59 2021] GET /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:00:59.594085 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87748b69-7a3a-4a97-9cd4-15a07b9e9a5c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:59.607099 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87748b69-7a3a-4a97-9cd4-15a07b9e9a5c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:59.618236 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd47c3-1268-4dc3-8d47-e4894e279ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:59.619142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd47c3-1268-4dc3-8d47-e4894e279ff7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:59.619430 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd47c3-1268-4dc3-8d47-e4894e279ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:59.619711 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd47c3-1268-4dc3-8d47-e4894e279ff7 admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80/users/9633a24420954abdbab396f4125ba772/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:59.627333 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd47c3-1268-4dc3-8d47-e4894e279ff7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d119a645a14cd79d87aae94a06ec80, user_id=9633a24420954abdbab396f4125ba772, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:00:59.628954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING py.warnings [None req-68fd47c3-1268-4dc3-8d47-e4894e279ff7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:00:59.628954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: warnings.warn(msg) Oct 29 16:00:59.628954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: Oct 29 16:00:59.630965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd47c3-1268-4dc3-8d47-e4894e279ff7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:00:59.667515 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 52/103] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:00:59 2021] PUT /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80/users/9633a24420954abdbab396f4125ba772/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:00:59.755736 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c92f5-d87b-49e8-b0d4-68e60d8e4432 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:59.756045 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c92f5-d87b-49e8-b0d4-68e60d8e4432 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:59.756297 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722c92f5-d87b-49e8-b0d4-68e60d8e4432 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:59.758123 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 52/104] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:00:59.780216 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fe85e-aad8-40c6-8a35-2d257a33e955 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:59.780843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fe85e-aad8-40c6-8a35-2d257a33e955 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:59.781327 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93fe85e-aad8-40c6-8a35-2d257a33e955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:59.811252 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e93fe85e-aad8-40c6-8a35-2d257a33e955 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:59.813026 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e93fe85e-aad8-40c6-8a35-2d257a33e955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:59.841247 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dd409-54e1-484c-a21d-c4305f99bddb None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:59.841537 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dd409-54e1-484c-a21d-c4305f99bddb None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:59.841699 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952dd409-54e1-484c-a21d-c4305f99bddb None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:59.843523 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 53/105] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:00:59.850364 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530f691-c2df-4dad-b2a4-d5d9d1aaa714 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:59.850711 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530f691-c2df-4dad-b2a4-d5d9d1aaa714 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:59.850933 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530f691-c2df-4dad-b2a4-d5d9d1aaa714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:59.883281 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-a530f691-c2df-4dad-b2a4-d5d9d1aaa714 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:59.885832 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a530f691-c2df-4dad-b2a4-d5d9d1aaa714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:00:59.908310 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 53/106] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:00:59.944260 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fe85e-aad8-40c6-8a35-2d257a33e955 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:59.953980 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93fe85e-aad8-40c6-8a35-2d257a33e955 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:00:59.959399 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e87397-6c4b-48c2-8c15-08a26cca7f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:00:59.960464 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e87397-6c4b-48c2-8c15-08a26cca7f81 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:59.960896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e87397-6c4b-48c2-8c15-08a26cca7f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:59.961315 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e87397-6c4b-48c2-8c15-08a26cca7f81 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:59.963255 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 54/107] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:00:59.964627 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae9989-ef88-48a0-a743-d227ed94de72 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:59.964918 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae9989-ef88-48a0-a743-d227ed94de72 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:59.965197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ae9989-ef88-48a0-a743-d227ed94de72 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:59.966964 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 55/108] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:00:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:00:59.973718 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8730a-3b19-4eb9-accc-4d82475ec576 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:00:59.974031 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8730a-3b19-4eb9-accc-4d82475ec576 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:00:59.974311 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b8730a-3b19-4eb9-accc-4d82475ec576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:00:59.976070 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e87397-6c4b-48c2-8c15-08a26cca7f81 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:00:59.983848 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-e6e87397-6c4b-48c2-8c15-08a26cca7f81 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 16:00:59.985389 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 54/109] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:00:59 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:00:59.992324 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e87397-6c4b-48c2-8c15-08a26cca7f81 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:00:59.993153 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-37b8730a-3b19-4eb9-accc-4d82475ec576 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:00:59.994392 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-37b8730a-3b19-4eb9-accc-4d82475ec576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:00.002245 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 56/110] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:00:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:00.002966 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8730a-3b19-4eb9-accc-4d82475ec576 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:00.005181 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e87397-6c4b-48c2-8c15-08a26cca7f81 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:00.010282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac39e2-6d88-48f1-a300-41c151f4833e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:00.011279 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac39e2-6d88-48f1-a300-41c151f4833e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:00.011763 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac39e2-6d88-48f1-a300-41c151f4833e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:00.012321 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac39e2-6d88-48f1-a300-41c151f4833e admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:00.013109 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac39e2-6d88-48f1-a300-41c151f4833e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:00.013422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac39e2-6d88-48f1-a300-41c151f4833e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:00.015109 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac39e2-6d88-48f1-a300-41c151f4833e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:00.024117 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b8730a-3b19-4eb9-accc-4d82475ec576 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:00.026515 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 55/111] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:00:59 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:00.031867 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30a68c-c18a-419c-86c5-60bf10aa33c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:00.032661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30a68c-c18a-419c-86c5-60bf10aa33c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:00.032944 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30a68c-c18a-419c-86c5-60bf10aa33c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:00.033215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b30a68c-c18a-419c-86c5-60bf10aa33c3 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:00.033665 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac39e2-6d88-48f1-a300-41c151f4833e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:00.045402 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac39e2-6d88-48f1-a300-41c151f4833e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:00.051731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634d482-2e05-42f7-9888-e9efa636a61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:00.052892 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b30a68c-c18a-419c-86c5-60bf10aa33c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:00.053400 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634d482-2e05-42f7-9888-e9efa636a61a admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:00.053973 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634d482-2e05-42f7-9888-e9efa636a61a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:00.054451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634d482-2e05-42f7-9888-e9efa636a61a admin admin] PATH_INFO: `/v3/users/9633a24420954abdbab396f4125ba772` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:00.056006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634d482-2e05-42f7-9888-e9efa636a61a admin admin] RBAC: Authorizing `identity:get_user(user_id=9633a24420954abdbab396f4125ba772)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:00.058513 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634d482-2e05-42f7-9888-e9efa636a61a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:00.059756 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-9b30a68c-c18a-419c-86c5-60bf10aa33c3 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:01:00.060634 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 56/112] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:01:00 2021] GET /identity/v3/users/9633a24420954abdbab396f4125ba772 => generated 275 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:00.060961 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 57/113] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:00.066487 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634d482-2e05-42f7-9888-e9efa636a61a admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:00.066706 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30a68c-c18a-419c-86c5-60bf10aa33c3 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:00.079024 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b30a68c-c18a-419c-86c5-60bf10aa33c3 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:00.079182 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634d482-2e05-42f7-9888-e9efa636a61a admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:00.084099 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fda768-a1b4-4057-8966-67eaad3b92fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:00.084240 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca312217-a887-4768-b195-f9ec8c41b46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:00.085117 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca312217-a887-4768-b195-f9ec8c41b46a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:00.085222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fda768-a1b4-4057-8966-67eaad3b92fb admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:00.085309 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca312217-a887-4768-b195-f9ec8c41b46a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:00.085380 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fda768-a1b4-4057-8966-67eaad3b92fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:00.085569 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca312217-a887-4768-b195-f9ec8c41b46a admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:00.085666 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fda768-a1b4-4057-8966-67eaad3b92fb admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:00.086765 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca312217-a887-4768-b195-f9ec8c41b46a admin admin] RBAC: Authorizing `identity:get_project(project_id=77d119a645a14cd79d87aae94a06ec80)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:00.088840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca312217-a887-4768-b195-f9ec8c41b46a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:00.090546 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 58/114] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:00 2021] GET /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80 => generated 298 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:00.094112 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca312217-a887-4768-b195-f9ec8c41b46a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:00.101560 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fda768-a1b4-4057-8966-67eaad3b92fb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:00.104590 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca312217-a887-4768-b195-f9ec8c41b46a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:00.108546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-b2fda768-a1b4-4057-8966-67eaad3b92fb admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 16:01:00.109112 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d705e4-48d4-4969-8c87-9dc5ec20ccb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:00.109887 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 57/115] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:00 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:00.114125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d705e4-48d4-4969-8c87-9dc5ec20ccb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:00.114125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d705e4-48d4-4969-8c87-9dc5ec20ccb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:00.114125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d705e4-48d4-4969-8c87-9dc5ec20ccb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:00.114307 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2d478-97fd-4749-9299-9f970b609dbd None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:00.114390 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d705e4-48d4-4969-8c87-9dc5ec20ccb5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:00.114459 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2d478-97fd-4749-9299-9f970b609dbd None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:00.114459 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2d478-97fd-4749-9299-9f970b609dbd None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:00.114573 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d705e4-48d4-4969-8c87-9dc5ec20ccb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:00.114573 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d705e4-48d4-4969-8c87-9dc5ec20ccb5 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:00.114695 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 58/116] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:00.114802 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2d478-97fd-4749-9299-9f970b609dbd None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:00.122987 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 59/117] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:00.123992 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d705e4-48d4-4969-8c87-9dc5ec20ccb5 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:00.130468 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2d478-97fd-4749-9299-9f970b609dbd None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:00.135299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d705e4-48d4-4969-8c87-9dc5ec20ccb5 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:00.135451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366e347-e7b2-444a-812d-cc8a724d099d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:00.136180 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366e347-e7b2-444a-812d-cc8a724d099d admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:00.136466 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366e347-e7b2-444a-812d-cc8a724d099d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:00.136787 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366e347-e7b2-444a-812d-cc8a724d099d admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80/users/9633a24420954abdbab396f4125ba772/roles/8eba80d4381a47ffb74df6e1f9dda34a` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:00.138936 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366e347-e7b2-444a-812d-cc8a724d099d admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d119a645a14cd79d87aae94a06ec80, user_id=9633a24420954abdbab396f4125ba772, role_id=8eba80d4381a47ffb74df6e1f9dda34a)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:00.139662 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd2571-7127-4a01-8ecc-518bd77ca13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:00.140298 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd2571-7127-4a01-8ecc-518bd77ca13e admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:00.140572 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd2571-7127-4a01-8ecc-518bd77ca13e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:00.140849 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd2571-7127-4a01-8ecc-518bd77ca13e admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:00.141601 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd2571-7127-4a01-8ecc-518bd77ca13e admin admin] RBAC: Adding query filter params (name=member) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:00.141693 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f366e347-e7b2-444a-812d-cc8a724d099d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:00.141904 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd2571-7127-4a01-8ecc-518bd77ca13e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:00.144049 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd2571-7127-4a01-8ecc-518bd77ca13e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:00.153640 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 60/118] 10.222.0.41 () {56 vars in 1122 bytes} [Fri Oct 29 16:01:00 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:00.154989 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079dd7c-78da-44ef-82de-6c38ac6f9d67 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:00.155279 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079dd7c-78da-44ef-82de-6c38ac6f9d67 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:00.155557 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7079dd7c-78da-44ef-82de-6c38ac6f9d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:00.162622 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 59/119] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:01:00 2021] PUT /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80/users/9633a24420954abdbab396f4125ba772/roles/8eba80d4381a47ffb74df6e1f9dda34a => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:01:00.170211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366e347-e7b2-444a-812d-cc8a724d099d admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:00.174533 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-7079dd7c-78da-44ef-82de-6c38ac6f9d67 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:00.175755 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7079dd7c-78da-44ef-82de-6c38ac6f9d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:00.243702 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 61/120] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:00 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:00.244489 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079dd7c-78da-44ef-82de-6c38ac6f9d67 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:00.252122 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366e347-e7b2-444a-812d-cc8a724d099d admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:00.253828 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7079dd7c-78da-44ef-82de-6c38ac6f9d67 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:00.256992 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89177df-82bd-4c87-a985-a1b828cd4981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:00.258180 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89177df-82bd-4c87-a985-a1b828cd4981 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:00.258473 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89177df-82bd-4c87-a985-a1b828cd4981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:00.258678 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aaac20-36bc-47df-b776-e487c08eb886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:00.258805 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89177df-82bd-4c87-a985-a1b828cd4981 admin admin] PATH_INFO: `/v3/users/bfeda756d5b84f81aba1c8d226cdac52` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:00.259602 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaac20-36bc-47df-b776-e487c08eb886 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:00.259892 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaac20-36bc-47df-b776-e487c08eb886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:00.259991 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89177df-82bd-4c87-a985-a1b828cd4981 admin admin] RBAC: Authorizing `identity:get_user(user_id=bfeda756d5b84f81aba1c8d226cdac52)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:00.260165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aaac20-36bc-47df-b776-e487c08eb886 admin admin] PATH_INFO: `/v3/users/9633a24420954abdbab396f4125ba772` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:00.261497 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aaac20-36bc-47df-b776-e487c08eb886 admin admin] RBAC: Authorizing `identity:get_user(user_id=9633a24420954abdbab396f4125ba772)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:00.261911 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89177df-82bd-4c87-a985-a1b828cd4981 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:00.263941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 60/121] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:01:00 2021] GET /identity/v3/users/bfeda756d5b84f81aba1c8d226cdac52 => generated 247 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:00.264055 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aaac20-36bc-47df-b776-e487c08eb886 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:00.265688 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 62/122] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:01:00 2021] GET /identity/v3/users/9633a24420954abdbab396f4125ba772 => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:00.271555 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89177df-82bd-4c87-a985-a1b828cd4981 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:00.283194 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aaac20-36bc-47df-b776-e487c08eb886 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:00.286984 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89177df-82bd-4c87-a985-a1b828cd4981 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:00.292540 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff7707-c12b-4bc4-aa24-2fc2ddbee108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:00.293680 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff7707-c12b-4bc4-aa24-2fc2ddbee108 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:00.293996 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff7707-c12b-4bc4-aa24-2fc2ddbee108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:00.294288 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff7707-c12b-4bc4-aa24-2fc2ddbee108 admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:00.295340 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aaac20-36bc-47df-b776-e487c08eb886 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:00.295534 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff7707-c12b-4bc4-aa24-2fc2ddbee108 admin admin] RBAC: Authorizing `identity:get_project(project_id=77d119a645a14cd79d87aae94a06ec80)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:00.297627 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff7707-c12b-4bc4-aa24-2fc2ddbee108 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:00.299390 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 61/123] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:00 2021] GET /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:00.300079 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7ea57-7aa9-4175-be85-916f706cfe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:00.300188 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff7707-c12b-4bc4-aa24-2fc2ddbee108 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:00.301034 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7ea57-7aa9-4175-be85-916f706cfe30 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:00.301302 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7ea57-7aa9-4175-be85-916f706cfe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:00.301648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7ea57-7aa9-4175-be85-916f706cfe30 admin admin] PATH_INFO: `/v3/projects/04cbc33f4bf74d74bcf6ce860dd3a783` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:00.302908 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7ea57-7aa9-4175-be85-916f706cfe30 admin admin] RBAC: Authorizing `identity:get_project(project_id=04cbc33f4bf74d74bcf6ce860dd3a783)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:00.304985 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7ea57-7aa9-4175-be85-916f706cfe30 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:00.306819 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 63/124] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:00 2021] GET /identity/v3/projects/04cbc33f4bf74d74bcf6ce860dd3a783 => generated 312 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:00.307615 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7ea57-7aa9-4175-be85-916f706cfe30 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:00.320687 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff7707-c12b-4bc4-aa24-2fc2ddbee108 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:00.323400 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7ea57-7aa9-4175-be85-916f706cfe30 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:00.329061 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617d51a-f707-40be-bf63-c8f51e9e8434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:00.329622 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4d8e0-380e-40fe-a78c-34565976edc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:00.330294 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4d8e0-380e-40fe-a78c-34565976edc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:00.331307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4d8e0-380e-40fe-a78c-34565976edc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:00.331390 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4d8e0-380e-40fe-a78c-34565976edc9 admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80/users/bfeda756d5b84f81aba1c8d226cdac52/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:00.331931 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617d51a-f707-40be-bf63-c8f51e9e8434 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:00.332520 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617d51a-f707-40be-bf63-c8f51e9e8434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:00.333030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9617d51a-f707-40be-bf63-c8f51e9e8434 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:00.333445 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4d8e0-380e-40fe-a78c-34565976edc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d119a645a14cd79d87aae94a06ec80, user_id=bfeda756d5b84f81aba1c8d226cdac52, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:00.334658 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617d51a-f707-40be-bf63-c8f51e9e8434 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:00.336495 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4d8e0-380e-40fe-a78c-34565976edc9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:00.336756 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9617d51a-f707-40be-bf63-c8f51e9e8434 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:00.338665 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 62/125] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:00 2021] GET /identity/v3/domains/default => generated 199 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:00.339874 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617d51a-f707-40be-bf63-c8f51e9e8434 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:00.351958 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9617d51a-f707-40be-bf63-c8f51e9e8434 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:00.356155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 64/126] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:01:00 2021] PUT /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80/users/bfeda756d5b84f81aba1c8d226cdac52/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:01:00.357271 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4d8e0-380e-40fe-a78c-34565976edc9 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:00.426157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f0301-7112-4651-a511-c850361abc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:00.427286 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f0301-7112-4651-a511-c850361abc16 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:00.427578 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f0301-7112-4651-a511-c850361abc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:00.427852 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f0301-7112-4651-a511-c850361abc16 admin admin] PATH_INFO: `/v3/projects/04cbc33f4bf74d74bcf6ce860dd3a783/users/9633a24420954abdbab396f4125ba772/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:00.430877 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f0301-7112-4651-a511-c850361abc16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04cbc33f4bf74d74bcf6ce860dd3a783, user_id=9633a24420954abdbab396f4125ba772, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:00.432942 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4d8e0-380e-40fe-a78c-34565976edc9 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:00.433678 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f0301-7112-4651-a511-c850361abc16 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:00.438219 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e569ab-65fc-452d-a57b-20c09ba9f85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:00.439320 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e569ab-65fc-452d-a57b-20c09ba9f85f admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:00.439654 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e569ab-65fc-452d-a57b-20c09ba9f85f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:00.440504 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e569ab-65fc-452d-a57b-20c09ba9f85f admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:00.441413 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e569ab-65fc-452d-a57b-20c09ba9f85f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:00.446181 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING py.warnings [None req-68e569ab-65fc-452d-a57b-20c09ba9f85f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:01:00.446181 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: warnings.warn(msg) Oct 29 16:01:00.446181 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: Oct 29 16:01:00.446181 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e569ab-65fc-452d-a57b-20c09ba9f85f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:00.459555 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 63/127] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:01:00 2021] PUT /identity/v3/projects/04cbc33f4bf74d74bcf6ce860dd3a783/users/9633a24420954abdbab396f4125ba772/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:01:00.509403 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 65/128] 10.222.0.41 () {60 vars in 1153 bytes} [Fri Oct 29 16:01:00 2021] POST /identity/v3/users => generated 283 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:01:02.391803 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77072cc-8ed1-4981-b790-4e53adfa0629 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:02.392355 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77072cc-8ed1-4981-b790-4e53adfa0629 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:02.392355 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77072cc-8ed1-4981-b790-4e53adfa0629 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:02.394733 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 64/129] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:02.408307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aa8e8-540a-4358-a8cb-5d26b9969e8b None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:02.409398 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aa8e8-540a-4358-a8cb-5d26b9969e8b None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:02.409501 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69aa8e8-540a-4358-a8cb-5d26b9969e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:02.427350 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-a69aa8e8-540a-4358-a8cb-5d26b9969e8b None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:02.428554 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a69aa8e8-540a-4358-a8cb-5d26b9969e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:02.499035 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 66/130] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:02.539731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77072cc-8ed1-4981-b790-4e53adfa0629 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:02.552591 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77072cc-8ed1-4981-b790-4e53adfa0629 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:02.561637 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd0522-e68e-44d4-8b34-84623ff413f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:02.562480 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd0522-e68e-44d4-8b34-84623ff413f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:02.562762 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd0522-e68e-44d4-8b34-84623ff413f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:02.563041 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bd0522-e68e-44d4-8b34-84623ff413f1 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:02.574490 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bd0522-e68e-44d4-8b34-84623ff413f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:02.581635 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-05bd0522-e68e-44d4-8b34-84623ff413f1 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 16:01:02.582883 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 65/131] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:02 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:02.589269 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69aa8e8-540a-4358-a8cb-5d26b9969e8b None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:02.599235 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69aa8e8-540a-4358-a8cb-5d26b9969e8b None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:02.609699 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f526a-cf79-4e50-90de-a2076a596189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:02.610453 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f526a-cf79-4e50-90de-a2076a596189 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:02.610742 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f526a-cf79-4e50-90de-a2076a596189 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:02.611026 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89f526a-cf79-4e50-90de-a2076a596189 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:02.612850 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f526a-cf79-4e50-90de-a2076a596189 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:02.613199 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f526a-cf79-4e50-90de-a2076a596189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:02.615046 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89f526a-cf79-4e50-90de-a2076a596189 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:02.629396 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 67/132] 10.222.0.41 () {56 vars in 1122 bytes} [Fri Oct 29 16:01:02 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:02.635721 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd0522-e68e-44d4-8b34-84623ff413f1 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:02.649302 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bd0522-e68e-44d4-8b34-84623ff413f1 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:02.654057 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a110a-a7bf-4a60-bc2b-6b65a7dbdaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:02.655021 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a110a-a7bf-4a60-bc2b-6b65a7dbdaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:02.655309 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a110a-a7bf-4a60-bc2b-6b65a7dbdaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:02.655650 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a110a-a7bf-4a60-bc2b-6b65a7dbdaf2 admin admin] PATH_INFO: `/v3/users/9633a24420954abdbab396f4125ba772` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:02.656891 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a110a-a7bf-4a60-bc2b-6b65a7dbdaf2 admin admin] RBAC: Authorizing `identity:get_user(user_id=9633a24420954abdbab396f4125ba772)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:02.660009 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a110a-a7bf-4a60-bc2b-6b65a7dbdaf2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:02.661904 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 66/133] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:01:02 2021] GET /identity/v3/users/9633a24420954abdbab396f4125ba772 => generated 275 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:02.667876 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f526a-cf79-4e50-90de-a2076a596189 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:02.678393 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89f526a-cf79-4e50-90de-a2076a596189 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:02.685951 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c8ebf-ffd6-422c-a628-83ef62204bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:02.686610 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c8ebf-ffd6-422c-a628-83ef62204bbb admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:02.686895 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c8ebf-ffd6-422c-a628-83ef62204bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:02.687175 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09c8ebf-ffd6-422c-a628-83ef62204bbb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:02.695701 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c8ebf-ffd6-422c-a628-83ef62204bbb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:02.697485 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09c8ebf-ffd6-422c-a628-83ef62204bbb admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:02.707222 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 68/134] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:02 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:01:02.713396 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a110a-a7bf-4a60-bc2b-6b65a7dbdaf2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:02.724581 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a110a-a7bf-4a60-bc2b-6b65a7dbdaf2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:02.732937 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990c287-c588-4c08-a1ba-bf43134ce85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:02.733814 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990c287-c588-4c08-a1ba-bf43134ce85e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:02.734123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990c287-c588-4c08-a1ba-bf43134ce85e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:02.734400 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990c287-c588-4c08-a1ba-bf43134ce85e admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:02.735622 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990c287-c588-4c08-a1ba-bf43134ce85e admin admin] RBAC: Authorizing `identity:get_project(project_id=77d119a645a14cd79d87aae94a06ec80)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:02.738325 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990c287-c588-4c08-a1ba-bf43134ce85e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:02.740030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 67/135] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:02 2021] GET /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:02.746474 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c8ebf-ffd6-422c-a628-83ef62204bbb admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:02.755670 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09c8ebf-ffd6-422c-a628-83ef62204bbb admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:02.766217 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2f7cc-58ba-48e3-84a2-86c1921bd9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:02.766889 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2f7cc-58ba-48e3-84a2-86c1921bd9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:02.767177 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2f7cc-58ba-48e3-84a2-86c1921bd9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:02.767459 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2f7cc-58ba-48e3-84a2-86c1921bd9b1 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:02.768357 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2f7cc-58ba-48e3-84a2-86c1921bd9b1 admin admin] RBAC: Adding query filter params (role.id=4a1afb6391114961afeec5c1d72563f0, scope.project.id=77d119a645a14cd79d87aae94a06ec80, user.id=9633a24420954abdbab396f4125ba772) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:02.768706 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2f7cc-58ba-48e3-84a2-86c1921bd9b1 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:02.770573 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2f7cc-58ba-48e3-84a2-86c1921bd9b1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:02.777405 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 69/136] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:02 2021] GET /identity/v3/role_assignments?user.id=9633a24420954abdbab396f4125ba772&scope.project.id=77d119a645a14cd79d87aae94a06ec80&role.id=4a1afb6391114961afeec5c1d72563f0 => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:03.375744 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0e039-4384-44d6-8782-572a323daf34 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:03.376015 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0e039-4384-44d6-8782-572a323daf34 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:03.376389 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0e039-4384-44d6-8782-572a323daf34 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:03.378904 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 68/137] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:03.390772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269070b-4168-4a74-8619-f2a7ffec4b1a None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:03.391064 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269070b-4168-4a74-8619-f2a7ffec4b1a None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:03.391334 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2269070b-4168-4a74-8619-f2a7ffec4b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:03.410758 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-2269070b-4168-4a74-8619-f2a7ffec4b1a None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:03.411954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-2269070b-4168-4a74-8619-f2a7ffec4b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:03.422894 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 70/138] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:03.447199 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0e039-4384-44d6-8782-572a323daf34 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:03.461434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0e039-4384-44d6-8782-572a323daf34 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:03.465844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b8b4d-975d-48b1-a46c-c3b49a66ccf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:03.466706 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b8b4d-975d-48b1-a46c-c3b49a66ccf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:03.466993 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b8b4d-975d-48b1-a46c-c3b49a66ccf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:03.467269 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b8b4d-975d-48b1-a46c-c3b49a66ccf2 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:03.478249 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b8b4d-975d-48b1-a46c-c3b49a66ccf2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:03.486912 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-b25b8b4d-975d-48b1-a46c-c3b49a66ccf2 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 16:01:03.488176 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 69/139] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:03 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:03.494476 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269070b-4168-4a74-8619-f2a7ffec4b1a None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:03.504084 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2269070b-4168-4a74-8619-f2a7ffec4b1a None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:03.508573 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc48469-dcf7-4287-91f7-844e13a9e5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:03.509233 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc48469-dcf7-4287-91f7-844e13a9e5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:03.509517 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc48469-dcf7-4287-91f7-844e13a9e5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:03.509796 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc48469-dcf7-4287-91f7-844e13a9e5a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:03.510636 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc48469-dcf7-4287-91f7-844e13a9e5a1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:03.510944 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc48469-dcf7-4287-91f7-844e13a9e5a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:03.512558 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc48469-dcf7-4287-91f7-844e13a9e5a1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:03.521909 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 71/140] 10.222.0.41 () {56 vars in 1122 bytes} [Fri Oct 29 16:01:03 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:03.527977 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b8b4d-975d-48b1-a46c-c3b49a66ccf2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:03.537946 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b8b4d-975d-48b1-a46c-c3b49a66ccf2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:03.542449 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e2a14-98d1-4c74-89b2-e322ed91cc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:03.543318 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e2a14-98d1-4c74-89b2-e322ed91cc29 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:03.543600 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e2a14-98d1-4c74-89b2-e322ed91cc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:03.543877 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8e2a14-98d1-4c74-89b2-e322ed91cc29 admin admin] PATH_INFO: `/v3/users/9633a24420954abdbab396f4125ba772` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:03.545111 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e2a14-98d1-4c74-89b2-e322ed91cc29 admin admin] RBAC: Authorizing `identity:get_user(user_id=9633a24420954abdbab396f4125ba772)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:03.547308 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8e2a14-98d1-4c74-89b2-e322ed91cc29 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:03.548920 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 70/141] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:01:03 2021] GET /identity/v3/users/9633a24420954abdbab396f4125ba772 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:03.555020 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc48469-dcf7-4287-91f7-844e13a9e5a1 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:03.565443 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc48469-dcf7-4287-91f7-844e13a9e5a1 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:03.569935 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16261d72-4ab2-420c-9ec0-307700da80db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:03.570587 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16261d72-4ab2-420c-9ec0-307700da80db admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:03.570876 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16261d72-4ab2-420c-9ec0-307700da80db admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:03.571156 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16261d72-4ab2-420c-9ec0-307700da80db admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:03.582223 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16261d72-4ab2-420c-9ec0-307700da80db admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:03.584018 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16261d72-4ab2-420c-9ec0-307700da80db admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:03.593525 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 72/142] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:03.599771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e2a14-98d1-4c74-89b2-e322ed91cc29 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:03.610171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8e2a14-98d1-4c74-89b2-e322ed91cc29 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:03.617018 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759efdad-dcfe-4acc-a158-167a81543057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:03.617882 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759efdad-dcfe-4acc-a158-167a81543057 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:03.618203 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759efdad-dcfe-4acc-a158-167a81543057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:03.618477 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759efdad-dcfe-4acc-a158-167a81543057 admin admin] PATH_INFO: `/v3/projects/04cbc33f4bf74d74bcf6ce860dd3a783` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:03.621043 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759efdad-dcfe-4acc-a158-167a81543057 admin admin] RBAC: Authorizing `identity:get_project(project_id=04cbc33f4bf74d74bcf6ce860dd3a783)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:03.623188 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759efdad-dcfe-4acc-a158-167a81543057 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:03.624874 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 71/143] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:03 2021] GET /identity/v3/projects/04cbc33f4bf74d74bcf6ce860dd3a783 => generated 312 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:03.631837 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16261d72-4ab2-420c-9ec0-307700da80db admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:03.641035 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16261d72-4ab2-420c-9ec0-307700da80db admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:03.644600 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a81d17-063e-4c42-a2ae-02ba16f39152 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:03.644887 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a81d17-063e-4c42-a2ae-02ba16f39152 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:03.645167 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a81d17-063e-4c42-a2ae-02ba16f39152 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:03.648791 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 72/144] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:03 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:03.650344 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ced3b-5f38-4ddf-b905-85bf354e9401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:03.650995 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ced3b-5f38-4ddf-b905-85bf354e9401 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:03.651275 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ced3b-5f38-4ddf-b905-85bf354e9401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:03.651553 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ced3b-5f38-4ddf-b905-85bf354e9401 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:03.652394 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ced3b-5f38-4ddf-b905-85bf354e9401 admin admin] RBAC: Adding query filter params (role.id=4a1afb6391114961afeec5c1d72563f0, scope.project.id=04cbc33f4bf74d74bcf6ce860dd3a783, user.id=9633a24420954abdbab396f4125ba772) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:03.652702 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ced3b-5f38-4ddf-b905-85bf354e9401 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:03.654593 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ced3b-5f38-4ddf-b905-85bf354e9401 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:03.656621 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223bdd8-b0ab-413f-8f42-955ef5c78976 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:03.656903 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223bdd8-b0ab-413f-8f42-955ef5c78976 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:03.657181 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223bdd8-b0ab-413f-8f42-955ef5c78976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:03.671432 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 73/145] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:03 2021] GET /identity/v3/role_assignments?user.id=9633a24420954abdbab396f4125ba772&scope.project.id=04cbc33f4bf74d74bcf6ce860dd3a783&role.id=4a1afb6391114961afeec5c1d72563f0 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:03.686566 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-9223bdd8-b0ab-413f-8f42-955ef5c78976 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:03.687778 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-9223bdd8-b0ab-413f-8f42-955ef5c78976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:03.699384 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 73/146] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:03 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:03.742156 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ced3b-5f38-4ddf-b905-85bf354e9401 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:03.752014 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ced3b-5f38-4ddf-b905-85bf354e9401 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:03.757852 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9453ce3-da4a-44a8-851d-fdc7f4947da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:03.758977 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9453ce3-da4a-44a8-851d-fdc7f4947da0 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:03.759448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9453ce3-da4a-44a8-851d-fdc7f4947da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:03.759911 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9453ce3-da4a-44a8-851d-fdc7f4947da0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:03.781221 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9453ce3-da4a-44a8-851d-fdc7f4947da0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:03.788826 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-a9453ce3-da4a-44a8-851d-fdc7f4947da0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:01:03.790346 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 74/147] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:03.797598 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223bdd8-b0ab-413f-8f42-955ef5c78976 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:03.806808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223bdd8-b0ab-413f-8f42-955ef5c78976 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:03.818042 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e974d-080d-4984-b092-3c303a2d4d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:03.818743 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e974d-080d-4984-b092-3c303a2d4d25 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:03.819052 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e974d-080d-4984-b092-3c303a2d4d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:03.819307 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e974d-080d-4984-b092-3c303a2d4d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:03.820163 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e974d-080d-4984-b092-3c303a2d4d25 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:03.820477 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e974d-080d-4984-b092-3c303a2d4d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:03.822155 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e974d-080d-4984-b092-3c303a2d4d25 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:03.832085 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 74/148] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:03.839547 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9453ce3-da4a-44a8-851d-fdc7f4947da0 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:03.850732 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9453ce3-da4a-44a8-851d-fdc7f4947da0 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:03.855433 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ebdde-130b-4a11-b5ee-7a3d9ea408a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:03.856343 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ebdde-130b-4a11-b5ee-7a3d9ea408a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:03.856629 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ebdde-130b-4a11-b5ee-7a3d9ea408a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:03.856909 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ebdde-130b-4a11-b5ee-7a3d9ea408a8 admin admin] PATH_INFO: `/v3/users/bfeda756d5b84f81aba1c8d226cdac52` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:03.858285 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ebdde-130b-4a11-b5ee-7a3d9ea408a8 admin admin] RBAC: Authorizing `identity:get_user(user_id=bfeda756d5b84f81aba1c8d226cdac52)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:03.860153 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765ebdde-130b-4a11-b5ee-7a3d9ea408a8 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:03.861909 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 75/149] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:01:03 2021] GET /identity/v3/users/bfeda756d5b84f81aba1c8d226cdac52 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:03.868712 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e974d-080d-4984-b092-3c303a2d4d25 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:03.879080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e974d-080d-4984-b092-3c303a2d4d25 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:03.890126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809e72b-1bdd-405c-b00d-a8c99e42360f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:03.890728 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809e72b-1bdd-405c-b00d-a8c99e42360f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:03.891015 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809e72b-1bdd-405c-b00d-a8c99e42360f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:03.891293 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809e72b-1bdd-405c-b00d-a8c99e42360f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:03.900833 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809e72b-1bdd-405c-b00d-a8c99e42360f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:03.902701 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c809e72b-1bdd-405c-b00d-a8c99e42360f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:03.918006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 75/150] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:03 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:03.924585 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ebdde-130b-4a11-b5ee-7a3d9ea408a8 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:03.934722 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765ebdde-130b-4a11-b5ee-7a3d9ea408a8 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:03.942128 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a16ca5-b820-4d12-a557-9c49f2591842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:03.942995 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a16ca5-b820-4d12-a557-9c49f2591842 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:03.943286 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a16ca5-b820-4d12-a557-9c49f2591842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:03.943549 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a16ca5-b820-4d12-a557-9c49f2591842 admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:03.944800 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a16ca5-b820-4d12-a557-9c49f2591842 admin admin] RBAC: Authorizing `identity:get_project(project_id=77d119a645a14cd79d87aae94a06ec80)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:03.946910 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a16ca5-b820-4d12-a557-9c49f2591842 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:03.948900 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 76/151] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:03 2021] GET /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:03.956448 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809e72b-1bdd-405c-b00d-a8c99e42360f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:03.965949 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c809e72b-1bdd-405c-b00d-a8c99e42360f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:03.974460 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9600fd4-2291-411f-a85b-d91d6d02ae03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:03.975137 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9600fd4-2291-411f-a85b-d91d6d02ae03 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:03.975470 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9600fd4-2291-411f-a85b-d91d6d02ae03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:03.975786 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9600fd4-2291-411f-a85b-d91d6d02ae03 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:03.976645 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9600fd4-2291-411f-a85b-d91d6d02ae03 admin admin] RBAC: Adding query filter params (role.id=f28d3f93a0524078a592a15459808378, scope.project.id=77d119a645a14cd79d87aae94a06ec80, user.id=bfeda756d5b84f81aba1c8d226cdac52) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:03.977004 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9600fd4-2291-411f-a85b-d91d6d02ae03 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:03.978868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9600fd4-2291-411f-a85b-d91d6d02ae03 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:03.985693 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 76/152] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:03 2021] GET /identity/v3/role_assignments?user.id=bfeda756d5b84f81aba1c8d226cdac52&scope.project.id=77d119a645a14cd79d87aae94a06ec80&role.id=f28d3f93a0524078a592a15459808378 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:04.172823 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e48eba-d839-40b0-b8c0-8e0e85097370 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:04.173139 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e48eba-d839-40b0-b8c0-8e0e85097370 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:04.173295 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e48eba-d839-40b0-b8c0-8e0e85097370 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:04.175548 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 77/153] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:04.181702 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac85aa-ecaf-4085-a567-a84afc9e3db3 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:04.182062 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac85aa-ecaf-4085-a567-a84afc9e3db3 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:04.182333 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ac85aa-ecaf-4085-a567-a84afc9e3db3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:04.206366 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-b9ac85aa-ecaf-4085-a567-a84afc9e3db3 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:04.207313 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b9ac85aa-ecaf-4085-a567-a84afc9e3db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:04.222249 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 77/154] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:04 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:04.246983 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e48eba-d839-40b0-b8c0-8e0e85097370 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:04.263713 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e48eba-d839-40b0-b8c0-8e0e85097370 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:04.268972 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f20c7-6395-4db9-8a04-913868a0c79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:04.269646 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f20c7-6395-4db9-8a04-913868a0c79e admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:04.269957 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f20c7-6395-4db9-8a04-913868a0c79e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:04.270240 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f20c7-6395-4db9-8a04-913868a0c79e admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:04.281657 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f20c7-6395-4db9-8a04-913868a0c79e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:04.293131 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-ed9f20c7-6395-4db9-8a04-913868a0c79e admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 16:01:04.294411 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 78/155] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:01:04 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:04.300835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac85aa-ecaf-4085-a567-a84afc9e3db3 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:04.310227 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ac85aa-ecaf-4085-a567-a84afc9e3db3 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:04.318166 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9635ab0-756e-42b9-9446-bbca5caa6216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:04.318853 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9635ab0-756e-42b9-9446-bbca5caa6216 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:04.319215 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9635ab0-756e-42b9-9446-bbca5caa6216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:04.319494 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9635ab0-756e-42b9-9446-bbca5caa6216 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:04.320338 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9635ab0-756e-42b9-9446-bbca5caa6216 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:04.320647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9635ab0-756e-42b9-9446-bbca5caa6216 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:04.322317 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9635ab0-756e-42b9-9446-bbca5caa6216 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:04.332378 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 78/156] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:04 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:04.338252 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f20c7-6395-4db9-8a04-913868a0c79e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:04.348355 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f20c7-6395-4db9-8a04-913868a0c79e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:04.358071 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeee55-bef1-4c78-95fd-435ed01b54a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:04.358941 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeee55-bef1-4c78-95fd-435ed01b54a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:04.359224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeee55-bef1-4c78-95fd-435ed01b54a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:04.359502 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aeee55-bef1-4c78-95fd-435ed01b54a7 admin admin] PATH_INFO: `/v3/users/9633a24420954abdbab396f4125ba772` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:04.360744 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeee55-bef1-4c78-95fd-435ed01b54a7 admin admin] RBAC: Authorizing `identity:get_user(user_id=9633a24420954abdbab396f4125ba772)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:04.363005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37aeee55-bef1-4c78-95fd-435ed01b54a7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:04.364871 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 79/157] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:01:04 2021] GET /identity/v3/users/9633a24420954abdbab396f4125ba772 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:04.370998 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9635ab0-756e-42b9-9446-bbca5caa6216 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:04.387378 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9635ab0-756e-42b9-9446-bbca5caa6216 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:04.392329 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd3914-f19e-4d86-87a5-8a0198f7bd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:04.393602 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd3914-f19e-4d86-87a5-8a0198f7bd94 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:04.393891 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd3914-f19e-4d86-87a5-8a0198f7bd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:04.398477 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd3914-f19e-4d86-87a5-8a0198f7bd94 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:04.407192 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd3914-f19e-4d86-87a5-8a0198f7bd94 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:04.409080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd3914-f19e-4d86-87a5-8a0198f7bd94 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:04.422557 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 79/158] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:04 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:04.428926 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeee55-bef1-4c78-95fd-435ed01b54a7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:04.439321 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37aeee55-bef1-4c78-95fd-435ed01b54a7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:04.450810 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f6f02-878a-4d3c-b740-5fb4ba5e5a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:04.451671 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f6f02-878a-4d3c-b740-5fb4ba5e5a2c admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:04.451949 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f6f02-878a-4d3c-b740-5fb4ba5e5a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:04.452223 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f6f02-878a-4d3c-b740-5fb4ba5e5a2c admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:04.453436 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f6f02-878a-4d3c-b740-5fb4ba5e5a2c admin admin] RBAC: Authorizing `identity:get_project(project_id=77d119a645a14cd79d87aae94a06ec80)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:04.456106 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f6f02-878a-4d3c-b740-5fb4ba5e5a2c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:04.457882 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 80/159] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:04 2021] GET /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:04.464822 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd3914-f19e-4d86-87a5-8a0198f7bd94 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:04.474101 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd3914-f19e-4d86-87a5-8a0198f7bd94 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:04.484868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb421327-9757-4837-a99e-de10d0578848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:04.485532 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb421327-9757-4837-a99e-de10d0578848 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:04.485815 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb421327-9757-4837-a99e-de10d0578848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:04.486124 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb421327-9757-4837-a99e-de10d0578848 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:04.487010 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb421327-9757-4837-a99e-de10d0578848 admin admin] RBAC: Adding query filter params (role.id=8eba80d4381a47ffb74df6e1f9dda34a, scope.project.id=77d119a645a14cd79d87aae94a06ec80, user.id=9633a24420954abdbab396f4125ba772) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:04.487316 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb421327-9757-4837-a99e-de10d0578848 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:04.489190 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb421327-9757-4837-a99e-de10d0578848 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:04.495674 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 80/160] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:04 2021] GET /identity/v3/role_assignments?user.id=9633a24420954abdbab396f4125ba772&scope.project.id=77d119a645a14cd79d87aae94a06ec80&role.id=8eba80d4381a47ffb74df6e1f9dda34a => generated 608 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:05.079611 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fdd69-9d90-4a1c-b93a-986568c9ac55 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.079973 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fdd69-9d90-4a1c-b93a-986568c9ac55 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.080164 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4fdd69-9d90-4a1c-b93a-986568c9ac55 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.081984 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 81/161] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:05.088094 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71868cc2-f6fb-49a3-b185-bf28f67ad829 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.088386 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71868cc2-f6fb-49a3-b185-bf28f67ad829 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.088662 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71868cc2-f6fb-49a3-b185-bf28f67ad829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.109540 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-71868cc2-f6fb-49a3-b185-bf28f67ad829 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:05.111113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-71868cc2-f6fb-49a3-b185-bf28f67ad829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:05.124837 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 81/162] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:05.149815 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fdd69-9d90-4a1c-b93a-986568c9ac55 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:05.162916 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4fdd69-9d90-4a1c-b93a-986568c9ac55 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:05.170444 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f9508-758b-40fe-9c73-a1d298f51b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:05.171232 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f9508-758b-40fe-9c73-a1d298f51b77 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.171512 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f9508-758b-40fe-9c73-a1d298f51b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.171788 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f9508-758b-40fe-9c73-a1d298f51b77 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.183343 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f9508-758b-40fe-9c73-a1d298f51b77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:05.192139 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-891f9508-758b-40fe-9c73-a1d298f51b77 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 16:01:05.193367 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 82/163] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:05 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:05.200018 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71868cc2-f6fb-49a3-b185-bf28f67ad829 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:05.211937 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71868cc2-f6fb-49a3-b185-bf28f67ad829 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:05.217809 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7020e-770d-41b0-96c4-35bcfbfbc44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:05.218735 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7020e-770d-41b0-96c4-35bcfbfbc44b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.219181 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7020e-770d-41b0-96c4-35bcfbfbc44b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.219605 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd7020e-770d-41b0-96c4-35bcfbfbc44b admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.220515 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7020e-770d-41b0-96c4-35bcfbfbc44b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:05.220960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7020e-770d-41b0-96c4-35bcfbfbc44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:05.223391 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd7020e-770d-41b0-96c4-35bcfbfbc44b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:05.238287 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 82/164] 10.222.0.41 () {56 vars in 1122 bytes} [Fri Oct 29 16:01:05 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:05.239878 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f9508-758b-40fe-9c73-a1d298f51b77 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:05.255808 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f9508-758b-40fe-9c73-a1d298f51b77 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:05.260871 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad092640-7fe9-491e-8cf3-33169074475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:05.261978 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad092640-7fe9-491e-8cf3-33169074475b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.262448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad092640-7fe9-491e-8cf3-33169074475b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.262876 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad092640-7fe9-491e-8cf3-33169074475b admin admin] PATH_INFO: `/v3/users/b6985df347344ceb8b5a19e9ed66bcf1` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.281605 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad092640-7fe9-491e-8cf3-33169074475b admin admin] RBAC: Authorizing `identity:get_user(user_id=b6985df347344ceb8b5a19e9ed66bcf1)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:05.284637 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad092640-7fe9-491e-8cf3-33169074475b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:05.286618 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 83/165] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:01:05 2021] GET /identity/v3/users/b6985df347344ceb8b5a19e9ed66bcf1 => generated 283 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:05.292898 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7020e-770d-41b0-96c4-35bcfbfbc44b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:05.303834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd7020e-770d-41b0-96c4-35bcfbfbc44b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:05.311176 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cc3aa-cc74-49d3-a070-5c6c8d4991b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:05.312197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cc3aa-cc74-49d3-a070-5c6c8d4991b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.312643 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cc3aa-cc74-49d3-a070-5c6c8d4991b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.313091 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3cc3aa-cc74-49d3-a070-5c6c8d4991b1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.324502 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cc3aa-cc74-49d3-a070-5c6c8d4991b1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:05.326639 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3cc3aa-cc74-49d3-a070-5c6c8d4991b1 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:05.337371 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 83/166] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:05.345877 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad092640-7fe9-491e-8cf3-33169074475b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:05.357338 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad092640-7fe9-491e-8cf3-33169074475b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:05.362574 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776fe674-21dc-47e5-9e1a-d6c2557e3202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:05.363744 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fe674-21dc-47e5-9e1a-d6c2557e3202 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.364259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fe674-21dc-47e5-9e1a-d6c2557e3202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.364738 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776fe674-21dc-47e5-9e1a-d6c2557e3202 admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.366290 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fe674-21dc-47e5-9e1a-d6c2557e3202 admin admin] RBAC: Authorizing `identity:get_project(project_id=98d7e030a12e408899c86d19f869ade2)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:05.368632 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776fe674-21dc-47e5-9e1a-d6c2557e3202 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:05.370594 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 84/167] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:05 2021] GET /identity/v3/projects/98d7e030a12e408899c86d19f869ade2 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:05.379144 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cc3aa-cc74-49d3-a070-5c6c8d4991b1 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:05.393950 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3cc3aa-cc74-49d3-a070-5c6c8d4991b1 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:05.401948 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da708e6-ad46-4acb-be0d-3c798540f27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:05.403047 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da708e6-ad46-4acb-be0d-3c798540f27b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.403560 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da708e6-ad46-4acb-be0d-3c798540f27b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.404049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da708e6-ad46-4acb-be0d-3c798540f27b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.405716 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da708e6-ad46-4acb-be0d-3c798540f27b admin admin] RBAC: Adding query filter params (role.id=4a1afb6391114961afeec5c1d72563f0, scope.project.id=98d7e030a12e408899c86d19f869ade2, user.id=b6985df347344ceb8b5a19e9ed66bcf1) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:05.406329 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da708e6-ad46-4acb-be0d-3c798540f27b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:05.409260 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da708e6-ad46-4acb-be0d-3c798540f27b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:05.417143 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 84/168] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:05 2021] GET /identity/v3/role_assignments?user.id=b6985df347344ceb8b5a19e9ed66bcf1&scope.project.id=98d7e030a12e408899c86d19f869ade2&role.id=4a1afb6391114961afeec5c1d72563f0 => generated 259 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:05.494882 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b5726-3868-4f02-8685-ee52d4ef204a None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.495925 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b5726-3868-4f02-8685-ee52d4ef204a None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.496477 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b5726-3868-4f02-8685-ee52d4ef204a None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.498769 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 85/169] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:05.505808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66a504-f17c-42ee-8ff5-2a3bf0440235 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.506364 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66a504-f17c-42ee-8ff5-2a3bf0440235 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.506364 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c66a504-f17c-42ee-8ff5-2a3bf0440235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.534483 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-6c66a504-f17c-42ee-8ff5-2a3bf0440235 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:05.536200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-6c66a504-f17c-42ee-8ff5-2a3bf0440235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:05.544950 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 85/170] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:05.571330 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b5726-3868-4f02-8685-ee52d4ef204a None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:05.586798 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b5726-3868-4f02-8685-ee52d4ef204a None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:05.592829 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9e2c2-d09e-4d35-a2d7-99f6bd393311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:05.594031 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9e2c2-d09e-4d35-a2d7-99f6bd393311 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.594577 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9e2c2-d09e-4d35-a2d7-99f6bd393311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.595216 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9e2c2-d09e-4d35-a2d7-99f6bd393311 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.609590 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae9e2c2-d09e-4d35-a2d7-99f6bd393311 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:05.617523 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-bae9e2c2-d09e-4d35-a2d7-99f6bd393311 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:01:05.619207 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 86/171] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:05 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:05.626065 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66a504-f17c-42ee-8ff5-2a3bf0440235 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:05.637423 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c66a504-f17c-42ee-8ff5-2a3bf0440235 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:05.642792 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35fdc5-1912-4126-8cb1-6ce5c029cd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:05.644582 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35fdc5-1912-4126-8cb1-6ce5c029cd8c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.645079 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35fdc5-1912-4126-8cb1-6ce5c029cd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.645618 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab35fdc5-1912-4126-8cb1-6ce5c029cd8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.646819 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35fdc5-1912-4126-8cb1-6ce5c029cd8c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:05.647488 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35fdc5-1912-4126-8cb1-6ce5c029cd8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:05.649868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab35fdc5-1912-4126-8cb1-6ce5c029cd8c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:05.663300 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 86/172] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:05 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:05.671451 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9e2c2-d09e-4d35-a2d7-99f6bd393311 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:05.685988 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9e2c2-d09e-4d35-a2d7-99f6bd393311 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:05.691472 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06bf15-786d-4ad4-9498-45ad146bad50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:05.692982 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06bf15-786d-4ad4-9498-45ad146bad50 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.693513 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06bf15-786d-4ad4-9498-45ad146bad50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.694030 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06bf15-786d-4ad4-9498-45ad146bad50 admin admin] PATH_INFO: `/v3/users/bfeda756d5b84f81aba1c8d226cdac52` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.695778 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06bf15-786d-4ad4-9498-45ad146bad50 admin admin] RBAC: Authorizing `identity:get_user(user_id=bfeda756d5b84f81aba1c8d226cdac52)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:05.698185 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a06bf15-786d-4ad4-9498-45ad146bad50 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:05.700762 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 87/173] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:01:05 2021] GET /identity/v3/users/bfeda756d5b84f81aba1c8d226cdac52 => generated 247 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:05.708127 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35fdc5-1912-4126-8cb1-6ce5c029cd8c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:05.719260 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab35fdc5-1912-4126-8cb1-6ce5c029cd8c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:05.725476 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a826f-6682-4073-b1c2-f10396b38176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:05.726591 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a826f-6682-4073-b1c2-f10396b38176 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.727074 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a826f-6682-4073-b1c2-f10396b38176 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.727553 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a826f-6682-4073-b1c2-f10396b38176 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.738150 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a826f-6682-4073-b1c2-f10396b38176 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:05.740355 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a826f-6682-4073-b1c2-f10396b38176 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:05.751222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 87/174] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:05 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:05.757751 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06bf15-786d-4ad4-9498-45ad146bad50 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:05.769067 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06bf15-786d-4ad4-9498-45ad146bad50 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:05.787954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0843c0e-55b2-4c04-8688-8ff7af1cf681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:05.789170 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0843c0e-55b2-4c04-8688-8ff7af1cf681 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.789682 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0843c0e-55b2-4c04-8688-8ff7af1cf681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.790255 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0843c0e-55b2-4c04-8688-8ff7af1cf681 admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.793020 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0843c0e-55b2-4c04-8688-8ff7af1cf681 admin admin] RBAC: Authorizing `identity:get_project(project_id=98d7e030a12e408899c86d19f869ade2)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:05.797732 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0843c0e-55b2-4c04-8688-8ff7af1cf681 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:05.802170 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 88/175] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:05 2021] GET /identity/v3/projects/98d7e030a12e408899c86d19f869ade2 => generated 302 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:05.811572 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a826f-6682-4073-b1c2-f10396b38176 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:05.821507 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a826f-6682-4073-b1c2-f10396b38176 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:05.826739 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095c033-1dac-4410-9642-eb48ebe4284d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:05.827649 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095c033-1dac-4410-9642-eb48ebe4284d admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.828186 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095c033-1dac-4410-9642-eb48ebe4284d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.828674 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095c033-1dac-4410-9642-eb48ebe4284d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.829700 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095c033-1dac-4410-9642-eb48ebe4284d admin admin] RBAC: Adding query filter params (role.id=f28d3f93a0524078a592a15459808378, scope.project.id=98d7e030a12e408899c86d19f869ade2, user.id=bfeda756d5b84f81aba1c8d226cdac52) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:05.830251 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095c033-1dac-4410-9642-eb48ebe4284d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:05.832480 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095c033-1dac-4410-9642-eb48ebe4284d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:05.839197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 88/176] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:05 2021] GET /identity/v3/role_assignments?user.id=bfeda756d5b84f81aba1c8d226cdac52&scope.project.id=98d7e030a12e408899c86d19f869ade2&role.id=f28d3f93a0524078a592a15459808378 => generated 259 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:05.851827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440ad59-414c-491b-9d99-d8db051624c8 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.852073 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440ad59-414c-491b-9d99-d8db051624c8 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.852314 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440ad59-414c-491b-9d99-d8db051624c8 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.854383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 89/177] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:05.860658 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2351d0-bd55-453f-8b16-c1ad32426f35 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.860947 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2351d0-bd55-453f-8b16-c1ad32426f35 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.861233 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2351d0-bd55-453f-8b16-c1ad32426f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.880789 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-3b2351d0-bd55-453f-8b16-c1ad32426f35 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:05.882121 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-3b2351d0-bd55-453f-8b16-c1ad32426f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:05.888969 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da7b61-4e23-4030-b42d-132a655aef34 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.889255 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da7b61-4e23-4030-b42d-132a655aef34 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.889533 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da7b61-4e23-4030-b42d-132a655aef34 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.890253 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 89/178] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:05.891842 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 90/179] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:01:05.898134 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d0dff-2934-4f57-9078-adaf26d9aa6a None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.898426 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d0dff-2934-4f57-9078-adaf26d9aa6a None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.898709 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d0dff-2934-4f57-9078-adaf26d9aa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.916447 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da7b61-4e23-4030-b42d-132a655aef34 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:05.919149 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-648d0dff-2934-4f57-9078-adaf26d9aa6a None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:05.920462 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-648d0dff-2934-4f57-9078-adaf26d9aa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:05.929230 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 90/180] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:05.930274 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da7b61-4e23-4030-b42d-132a655aef34 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:05.935112 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aac1cd-f581-4ee9-a272-bb659b4b3440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:05.936015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aac1cd-f581-4ee9-a272-bb659b4b3440 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.936391 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aac1cd-f581-4ee9-a272-bb659b4b3440 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.936758 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aac1cd-f581-4ee9-a272-bb659b4b3440 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.938137 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aac1cd-f581-4ee9-a272-bb659b4b3440 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:05.940000 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aac1cd-f581-4ee9-a272-bb659b4b3440 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:05.941986 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 91/181] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:05 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:05.948443 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d0dff-2934-4f57-9078-adaf26d9aa6a None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:05.957901 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aac1cd-f581-4ee9-a272-bb659b4b3440 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:05.959110 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d0dff-2934-4f57-9078-adaf26d9aa6a None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:05.963841 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3aabf6-fa9c-4212-a328-4f4fab0c614b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:05.964560 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aabf6-fa9c-4212-a328-4f4fab0c614b admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.964850 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aabf6-fa9c-4212-a328-4f4fab0c614b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.965123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3aabf6-fa9c-4212-a328-4f4fab0c614b admin admin] PATH_INFO: `/v3/groups` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.965888 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3aabf6-fa9c-4212-a328-4f4fab0c614b admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:05.966961 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING py.warnings [None req-4d3aabf6-fa9c-4212-a328-4f4fab0c614b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:01:05.966961 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: warnings.warn(msg) Oct 29 16:01:05.966961 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: Oct 29 16:01:05.968336 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3aabf6-fa9c-4212-a328-4f4fab0c614b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:05.970261 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aac1cd-f581-4ee9-a272-bb659b4b3440 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:05.976386 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe17e2-dd65-43b6-813c-7ca89cab3177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:05.977796 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe17e2-dd65-43b6-813c-7ca89cab3177 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:05.978382 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe17e2-dd65-43b6-813c-7ca89cab3177 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:05.978847 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe17e2-dd65-43b6-813c-7ca89cab3177 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:05.988980 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 91/182] 10.222.0.41 () {60 vars in 1155 bytes} [Fri Oct 29 16:01:05 2021] POST /identity/v3/groups => generated 229 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:01:06.002722 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe17e2-dd65-43b6-813c-7ca89cab3177 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:06.011600 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-79fe17e2-dd65-43b6-813c-7ca89cab3177 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 16:01:06.013238 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 92/183] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:01:05 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:06.020916 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3aabf6-fa9c-4212-a328-4f4fab0c614b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:06.031881 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3aabf6-fa9c-4212-a328-4f4fab0c614b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:06.037486 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b01610-3f7a-4625-815d-c045fdc109fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:06.038308 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b01610-3f7a-4625-815d-c045fdc109fb admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:06.038689 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b01610-3f7a-4625-815d-c045fdc109fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:06.039025 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b01610-3f7a-4625-815d-c045fdc109fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:06.039949 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b01610-3f7a-4625-815d-c045fdc109fb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:06.040322 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b01610-3f7a-4625-815d-c045fdc109fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:06.042175 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b01610-3f7a-4625-815d-c045fdc109fb admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:06.052302 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 92/184] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:06 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:06.059043 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe17e2-dd65-43b6-813c-7ca89cab3177 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:06.071752 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe17e2-dd65-43b6-813c-7ca89cab3177 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:06.077280 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fa52d-8880-4358-a06a-618bf56f9ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:06.078285 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fa52d-8880-4358-a06a-618bf56f9ccb admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:06.078564 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fa52d-8880-4358-a06a-618bf56f9ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:06.078912 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fa52d-8880-4358-a06a-618bf56f9ccb admin admin] PATH_INFO: `/v3/users/b6985df347344ceb8b5a19e9ed66bcf1` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:06.080184 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96fa52d-8880-4358-a06a-618bf56f9ccb admin admin] RBAC: Authorizing `identity:get_user(user_id=b6985df347344ceb8b5a19e9ed66bcf1)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:06.083151 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96fa52d-8880-4358-a06a-618bf56f9ccb admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:06.085185 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 93/185] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:01:06 2021] GET /identity/v3/users/b6985df347344ceb8b5a19e9ed66bcf1 => generated 283 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:06.091462 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b01610-3f7a-4625-815d-c045fdc109fb admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:06.103497 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b01610-3f7a-4625-815d-c045fdc109fb admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:06.108181 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a474aa-a78a-4943-9ce7-ceaaa2a8fff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:06.108901 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a474aa-a78a-4943-9ce7-ceaaa2a8fff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:06.109181 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a474aa-a78a-4943-9ce7-ceaaa2a8fff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:06.109495 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a474aa-a78a-4943-9ce7-ceaaa2a8fff5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:06.119536 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a474aa-a78a-4943-9ce7-ceaaa2a8fff5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:06.122118 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a474aa-a78a-4943-9ce7-ceaaa2a8fff5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:06.132604 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 93/186] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:06.139666 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fa52d-8880-4358-a06a-618bf56f9ccb admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:06.150604 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fa52d-8880-4358-a06a-618bf56f9ccb admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:06.155410 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eaf72d-17c5-4e23-a9b3-7b1d1355507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:06.156316 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eaf72d-17c5-4e23-a9b3-7b1d1355507b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:06.156594 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eaf72d-17c5-4e23-a9b3-7b1d1355507b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:06.156871 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eaf72d-17c5-4e23-a9b3-7b1d1355507b admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:06.158224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eaf72d-17c5-4e23-a9b3-7b1d1355507b admin admin] RBAC: Authorizing `identity:get_project(project_id=98d7e030a12e408899c86d19f869ade2)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:06.160907 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eaf72d-17c5-4e23-a9b3-7b1d1355507b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:06.163010 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 94/187] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:06 2021] GET /identity/v3/projects/98d7e030a12e408899c86d19f869ade2 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:06.170097 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a474aa-a78a-4943-9ce7-ceaaa2a8fff5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:06.180223 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a474aa-a78a-4943-9ce7-ceaaa2a8fff5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:06.184910 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df636ed-9f25-4fb4-a9cb-60c914d46464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:06.185615 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df636ed-9f25-4fb4-a9cb-60c914d46464 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:06.185893 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df636ed-9f25-4fb4-a9cb-60c914d46464 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:06.186236 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df636ed-9f25-4fb4-a9cb-60c914d46464 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:06.187162 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df636ed-9f25-4fb4-a9cb-60c914d46464 admin admin] RBAC: Adding query filter params (role.id=8eba80d4381a47ffb74df6e1f9dda34a, scope.project.id=98d7e030a12e408899c86d19f869ade2, user.id=b6985df347344ceb8b5a19e9ed66bcf1) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:06.187523 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df636ed-9f25-4fb4-a9cb-60c914d46464 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:06.189463 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df636ed-9f25-4fb4-a9cb-60c914d46464 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:06.196623 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 94/188] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:06 2021] GET /identity/v3/role_assignments?user.id=b6985df347344ceb8b5a19e9ed66bcf1&scope.project.id=98d7e030a12e408899c86d19f869ade2&role.id=8eba80d4381a47ffb74df6e1f9dda34a => generated 259 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:08.316423 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccb209-8629-4d7a-946e-995fe171cc33 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:08.317177 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccb209-8629-4d7a-946e-995fe171cc33 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:08.317177 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccb209-8629-4d7a-946e-995fe171cc33 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:08.319174 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 95/189] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:01:08.325755 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854f3ea-90a1-4187-a579-ef9352f548c3 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:08.326526 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854f3ea-90a1-4187-a579-ef9352f548c3 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:08.326526 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854f3ea-90a1-4187-a579-ef9352f548c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:08.345133 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-7854f3ea-90a1-4187-a579-ef9352f548c3 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:08.346946 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-7854f3ea-90a1-4187-a579-ef9352f548c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:08.359218 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 95/190] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:08.382588 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccb209-8629-4d7a-946e-995fe171cc33 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:08.396180 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccb209-8629-4d7a-946e-995fe171cc33 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:08.400581 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c13d8-06ee-47d6-bfbd-10f7c0aeca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:08.401487 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c13d8-06ee-47d6-bfbd-10f7c0aeca04 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:08.401766 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c13d8-06ee-47d6-bfbd-10f7c0aeca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:08.402116 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64c13d8-06ee-47d6-bfbd-10f7c0aeca04 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:08.413896 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64c13d8-06ee-47d6-bfbd-10f7c0aeca04 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:08.420749 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-e64c13d8-06ee-47d6-bfbd-10f7c0aeca04 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:01:08.426033 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 96/191] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:08 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:08.428796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854f3ea-90a1-4187-a579-ef9352f548c3 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:08.438137 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854f3ea-90a1-4187-a579-ef9352f548c3 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:08.442615 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a51259-0432-4689-82d4-0dd1d4ef30ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:08.443290 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a51259-0432-4689-82d4-0dd1d4ef30ba admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:08.443547 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a51259-0432-4689-82d4-0dd1d4ef30ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:08.443830 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a51259-0432-4689-82d4-0dd1d4ef30ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:08.444601 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a51259-0432-4689-82d4-0dd1d4ef30ba admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:08.444902 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a51259-0432-4689-82d4-0dd1d4ef30ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:08.446567 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a51259-0432-4689-82d4-0dd1d4ef30ba admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:08.456371 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 96/192] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:08 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:08.462806 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c13d8-06ee-47d6-bfbd-10f7c0aeca04 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:08.473552 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64c13d8-06ee-47d6-bfbd-10f7c0aeca04 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:08.478031 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98262f07-50fd-4150-baed-62528d8a9922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:08.478894 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98262f07-50fd-4150-baed-62528d8a9922 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:08.479168 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98262f07-50fd-4150-baed-62528d8a9922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:08.479435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98262f07-50fd-4150-baed-62528d8a9922 admin admin] PATH_INFO: `/v3/users/bfeda756d5b84f81aba1c8d226cdac52` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:08.480688 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98262f07-50fd-4150-baed-62528d8a9922 admin admin] RBAC: Authorizing `identity:get_user(user_id=bfeda756d5b84f81aba1c8d226cdac52)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:08.482545 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98262f07-50fd-4150-baed-62528d8a9922 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:08.487461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 97/193] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:01:08 2021] GET /identity/v3/users/bfeda756d5b84f81aba1c8d226cdac52 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:08.490791 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a51259-0432-4689-82d4-0dd1d4ef30ba admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:08.500653 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a51259-0432-4689-82d4-0dd1d4ef30ba admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:08.505206 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58f97d2-1a10-4062-982f-47f2a70ce2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:08.506091 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f97d2-1a10-4062-982f-47f2a70ce2cf admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:08.506345 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f97d2-1a10-4062-982f-47f2a70ce2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:08.506623 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58f97d2-1a10-4062-982f-47f2a70ce2cf admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:08.507861 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f97d2-1a10-4062-982f-47f2a70ce2cf admin admin] RBAC: Authorizing `identity:get_project(project_id=98d7e030a12e408899c86d19f869ade2)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:08.509960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58f97d2-1a10-4062-982f-47f2a70ce2cf admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:08.511911 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 97/194] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:08 2021] GET /identity/v3/projects/98d7e030a12e408899c86d19f869ade2 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:08.518909 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98262f07-50fd-4150-baed-62528d8a9922 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:08.530226 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98262f07-50fd-4150-baed-62528d8a9922 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:08.535573 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152457d8-59bf-4133-b673-a14df2dc93b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:08.536484 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152457d8-59bf-4133-b673-a14df2dc93b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:08.536740 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152457d8-59bf-4133-b673-a14df2dc93b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:08.537027 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152457d8-59bf-4133-b673-a14df2dc93b5 admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2/users/bfeda756d5b84f81aba1c8d226cdac52/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:08.539288 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152457d8-59bf-4133-b673-a14df2dc93b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d7e030a12e408899c86d19f869ade2, user_id=bfeda756d5b84f81aba1c8d226cdac52, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:08.542146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152457d8-59bf-4133-b673-a14df2dc93b5 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:08.564341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 98/195] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:01:08 2021] PUT /identity/v3/projects/98d7e030a12e408899c86d19f869ade2/users/bfeda756d5b84f81aba1c8d226cdac52/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:01:08.729808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd8f7-38d5-4e42-83a2-f1245fe82c9f None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:08.730238 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd8f7-38d5-4e42-83a2-f1245fe82c9f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:08.730412 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cd8f7-38d5-4e42-83a2-f1245fe82c9f None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:08.732447 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 98/196] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:01:08.739125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03d389-d421-4180-ad1c-b523882569c0 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:08.739481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03d389-d421-4180-ad1c-b523882569c0 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:08.739705 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03d389-d421-4180-ad1c-b523882569c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:08.759782 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-5f03d389-d421-4180-ad1c-b523882569c0 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:08.761010 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-5f03d389-d421-4180-ad1c-b523882569c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:08.823543 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5587e05-0a18-4f53-bbf8-6753f6f9ab47 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:08.823839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5587e05-0a18-4f53-bbf8-6753f6f9ab47 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:08.824111 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5587e05-0a18-4f53-bbf8-6753f6f9ab47 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:08.826250 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 99/197] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:08.829191 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 99/198] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:08.833239 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f86efc-812f-4b5d-9be3-0f2a95ba799d None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:08.834049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f86efc-812f-4b5d-9be3-0f2a95ba799d None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:08.834517 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f86efc-812f-4b5d-9be3-0f2a95ba799d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:08.853142 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03d389-d421-4180-ad1c-b523882569c0 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:08.858198 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-a5f86efc-812f-4b5d-9be3-0f2a95ba799d None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:08.859705 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a5f86efc-812f-4b5d-9be3-0f2a95ba799d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:08.862563 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03d389-d421-4180-ad1c-b523882569c0 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:08.867275 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79ef6d-9a73-4621-bb46-eb6611820ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:08.868063 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79ef6d-9a73-4621-bb46-eb6611820ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:08.868344 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79ef6d-9a73-4621-bb46-eb6611820ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:08.868613 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa79ef6d-9a73-4621-bb46-eb6611820ef8 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:08.869505 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 100/199] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:08 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:08.869819 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79ef6d-9a73-4621-bb46-eb6611820ef8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:08.871844 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa79ef6d-9a73-4621-bb46-eb6611820ef8 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:08.873738 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 100/200] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:08 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:08.881974 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f86efc-812f-4b5d-9be3-0f2a95ba799d None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:08.890084 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f86efc-812f-4b5d-9be3-0f2a95ba799d None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:08.893994 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79ef6d-9a73-4621-bb46-eb6611820ef8 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:08.895630 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501d321-41ec-4587-bbad-641bba74e0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:08.896323 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501d321-41ec-4587-bbad-641bba74e0ff admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:08.896602 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501d321-41ec-4587-bbad-641bba74e0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:08.896876 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f501d321-41ec-4587-bbad-641bba74e0ff admin admin] PATH_INFO: `/v3/groups` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:08.897602 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501d321-41ec-4587-bbad-641bba74e0ff admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:08.899632 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f501d321-41ec-4587-bbad-641bba74e0ff admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:08.904920 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa79ef6d-9a73-4621-bb46-eb6611820ef8 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:08.912553 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3b4e9-409a-40ea-ae8f-3632ec05fed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:08.913679 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3b4e9-409a-40ea-ae8f-3632ec05fed3 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:08.913981 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3b4e9-409a-40ea-ae8f-3632ec05fed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:08.914394 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3b4e9-409a-40ea-ae8f-3632ec05fed3 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:08.918800 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 101/201] 10.222.0.41 () {60 vars in 1155 bytes} [Fri Oct 29 16:01:08 2021] POST /identity/v3/groups => generated 226 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:01:08.934646 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d3b4e9-409a-40ea-ae8f-3632ec05fed3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:08.944211 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-15d3b4e9-409a-40ea-ae8f-3632ec05fed3 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 16:01:08.945971 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 101/202] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:08 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:08.954109 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501d321-41ec-4587-bbad-641bba74e0ff admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:08.967296 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f501d321-41ec-4587-bbad-641bba74e0ff admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:08.973516 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b7e23-3a25-4c51-83e8-1a0cdffecdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:08.974609 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b7e23-3a25-4c51-83e8-1a0cdffecdf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:08.975096 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b7e23-3a25-4c51-83e8-1a0cdffecdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:08.975763 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b7e23-3a25-4c51-83e8-1a0cdffecdf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:08.976857 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b7e23-3a25-4c51-83e8-1a0cdffecdf7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:08.977334 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b7e23-3a25-4c51-83e8-1a0cdffecdf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:08.979650 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b7e23-3a25-4c51-83e8-1a0cdffecdf7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:08.992111 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 102/203] 10.222.0.41 () {56 vars in 1122 bytes} [Fri Oct 29 16:01:08 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:09.001392 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3b4e9-409a-40ea-ae8f-3632ec05fed3 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:09.015407 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d3b4e9-409a-40ea-ae8f-3632ec05fed3 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:09.022094 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f5618-7477-4811-81f1-04ee031836d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:09.023576 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f5618-7477-4811-81f1-04ee031836d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:09.024093 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f5618-7477-4811-81f1-04ee031836d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:09.024636 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f5618-7477-4811-81f1-04ee031836d2 admin admin] PATH_INFO: `/v3/users/b6985df347344ceb8b5a19e9ed66bcf1` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:09.026292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f5618-7477-4811-81f1-04ee031836d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=b6985df347344ceb8b5a19e9ed66bcf1)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:09.029183 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f5618-7477-4811-81f1-04ee031836d2 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:09.031563 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 102/204] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:01:08 2021] GET /identity/v3/users/b6985df347344ceb8b5a19e9ed66bcf1 => generated 283 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:09.038821 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b7e23-3a25-4c51-83e8-1a0cdffecdf7 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:09.051875 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b7e23-3a25-4c51-83e8-1a0cdffecdf7 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:09.058315 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee1b60-2310-41ad-a1a6-bc52944a7779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:09.059606 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee1b60-2310-41ad-a1a6-bc52944a7779 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:09.060211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee1b60-2310-41ad-a1a6-bc52944a7779 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:09.060876 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee1b60-2310-41ad-a1a6-bc52944a7779 admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:09.062745 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee1b60-2310-41ad-a1a6-bc52944a7779 admin admin] RBAC: Authorizing `identity:get_project(project_id=98d7e030a12e408899c86d19f869ade2)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:09.066439 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee1b60-2310-41ad-a1a6-bc52944a7779 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:09.069199 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 103/205] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:09 2021] GET /identity/v3/projects/98d7e030a12e408899c86d19f869ade2 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:09.077494 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f5618-7477-4811-81f1-04ee031836d2 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:09.090398 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f5618-7477-4811-81f1-04ee031836d2 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:09.096604 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a73b8b6-44de-4a92-9230-47aed45d4712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:09.097854 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73b8b6-44de-4a92-9230-47aed45d4712 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:09.098334 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73b8b6-44de-4a92-9230-47aed45d4712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:09.098756 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a73b8b6-44de-4a92-9230-47aed45d4712 admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2/users/b6985df347344ceb8b5a19e9ed66bcf1/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:09.101855 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73b8b6-44de-4a92-9230-47aed45d4712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d7e030a12e408899c86d19f869ade2, user_id=b6985df347344ceb8b5a19e9ed66bcf1, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:09.105340 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a73b8b6-44de-4a92-9230-47aed45d4712 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:09.123649 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 103/206] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:01:09 2021] PUT /identity/v3/projects/98d7e030a12e408899c86d19f869ade2/users/b6985df347344ceb8b5a19e9ed66bcf1/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:01:09.211250 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf50f8-794e-4399-8b8c-09f2cefe95cc None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:09.211916 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf50f8-794e-4399-8b8c-09f2cefe95cc None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:09.212434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf50f8-794e-4399-8b8c-09f2cefe95cc None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:09.214785 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 104/207] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:09.221609 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fb7d8-e22e-4f6c-8e12-bd93e21a7e7f None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:09.221953 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fb7d8-e22e-4f6c-8e12-bd93e21a7e7f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:09.222253 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9fb7d8-e22e-4f6c-8e12-bd93e21a7e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:09.243899 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-3b9fb7d8-e22e-4f6c-8e12-bd93e21a7e7f None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:09.245016 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3b9fb7d8-e22e-4f6c-8e12-bd93e21a7e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:09.322594 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 104/208] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:09.347956 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf50f8-794e-4399-8b8c-09f2cefe95cc None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:09.377087 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf50f8-794e-4399-8b8c-09f2cefe95cc None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:09.384369 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0bd6d-c8ab-4fba-b893-474a265c3a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:09.385186 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0bd6d-c8ab-4fba-b893-474a265c3a23 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:09.385463 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0bd6d-c8ab-4fba-b893-474a265c3a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:09.385734 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0bd6d-c8ab-4fba-b893-474a265c3a23 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:09.397580 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0bd6d-c8ab-4fba-b893-474a265c3a23 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:09.405012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-94d0bd6d-c8ab-4fba-b893-474a265c3a23 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 16:01:09.406567 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 105/209] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:01:09 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:09.413805 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fb7d8-e22e-4f6c-8e12-bd93e21a7e7f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:09.423502 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9fb7d8-e22e-4f6c-8e12-bd93e21a7e7f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:09.428605 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9b8a6-cd6b-4916-928a-f2e83db64504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:09.429314 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9b8a6-cd6b-4916-928a-f2e83db64504 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:09.429598 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9b8a6-cd6b-4916-928a-f2e83db64504 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:09.429873 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff9b8a6-cd6b-4916-928a-f2e83db64504 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:09.430744 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9b8a6-cd6b-4916-928a-f2e83db64504 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:09.431046 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9b8a6-cd6b-4916-928a-f2e83db64504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:09.432744 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff9b8a6-cd6b-4916-928a-f2e83db64504 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:09.442248 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 105/210] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:09 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:09.448755 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0bd6d-c8ab-4fba-b893-474a265c3a23 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:09.459977 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0bd6d-c8ab-4fba-b893-474a265c3a23 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:09.464415 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1b927-8ce1-4f36-99aa-7cc75f277336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:09.465331 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1b927-8ce1-4f36-99aa-7cc75f277336 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:09.465659 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1b927-8ce1-4f36-99aa-7cc75f277336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:09.465959 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1b927-8ce1-4f36-99aa-7cc75f277336 admin admin] PATH_INFO: `/v3/users/b6985df347344ceb8b5a19e9ed66bcf1` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:09.467296 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1b927-8ce1-4f36-99aa-7cc75f277336 admin admin] RBAC: Authorizing `identity:get_user(user_id=b6985df347344ceb8b5a19e9ed66bcf1)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:09.469530 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1b927-8ce1-4f36-99aa-7cc75f277336 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:09.472117 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 106/211] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:01:09 2021] GET /identity/v3/users/b6985df347344ceb8b5a19e9ed66bcf1 => generated 283 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:09.478336 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9b8a6-cd6b-4916-928a-f2e83db64504 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:09.489309 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff9b8a6-cd6b-4916-928a-f2e83db64504 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:09.494059 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038978b-4de7-4899-8ffb-016b23393ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:09.494908 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038978b-4de7-4899-8ffb-016b23393ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:09.495224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038978b-4de7-4899-8ffb-016b23393ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:09.495509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038978b-4de7-4899-8ffb-016b23393ce2 admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:09.496849 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038978b-4de7-4899-8ffb-016b23393ce2 admin admin] RBAC: Authorizing `identity:get_project(project_id=98d7e030a12e408899c86d19f869ade2)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:09.499107 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038978b-4de7-4899-8ffb-016b23393ce2 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:09.501279 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 106/212] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:09 2021] GET /identity/v3/projects/98d7e030a12e408899c86d19f869ade2 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:09.507944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1b927-8ce1-4f36-99aa-7cc75f277336 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:09.518280 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1b927-8ce1-4f36-99aa-7cc75f277336 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:09.522920 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95959459-f7dc-4a26-aa36-6835db55cdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:09.523906 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95959459-f7dc-4a26-aa36-6835db55cdba admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:09.524180 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95959459-f7dc-4a26-aa36-6835db55cdba admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:09.524502 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95959459-f7dc-4a26-aa36-6835db55cdba admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2/users/b6985df347344ceb8b5a19e9ed66bcf1/roles/8eba80d4381a47ffb74df6e1f9dda34a` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:09.526877 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95959459-f7dc-4a26-aa36-6835db55cdba admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d7e030a12e408899c86d19f869ade2, user_id=b6985df347344ceb8b5a19e9ed66bcf1, role_id=8eba80d4381a47ffb74df6e1f9dda34a)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:09.529747 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95959459-f7dc-4a26-aa36-6835db55cdba admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:09.551190 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 107/213] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:01:09 2021] PUT /identity/v3/projects/98d7e030a12e408899c86d19f869ade2/users/b6985df347344ceb8b5a19e9ed66bcf1/roles/8eba80d4381a47ffb74df6e1f9dda34a => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:01:11.170256 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fef7c1-e233-4f0f-b1e8-747fbe702cab None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:11.170755 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fef7c1-e233-4f0f-b1e8-747fbe702cab None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:11.170828 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fef7c1-e233-4f0f-b1e8-747fbe702cab None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:11.172787 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 107/214] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:11.179400 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67abc0-0ae0-4405-baa1-78df664217f7 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:11.179863 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67abc0-0ae0-4405-baa1-78df664217f7 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:11.179934 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f67abc0-0ae0-4405-baa1-78df664217f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:11.202513 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-6f67abc0-0ae0-4405-baa1-78df664217f7 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:11.203742 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-6f67abc0-0ae0-4405-baa1-78df664217f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:11.277404 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 108/215] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:11 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:11.311032 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fef7c1-e233-4f0f-b1e8-747fbe702cab None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:11.328612 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fef7c1-e233-4f0f-b1e8-747fbe702cab None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:11.333604 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177fdea-110a-4ca8-91cd-60385085b644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:11.334418 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177fdea-110a-4ca8-91cd-60385085b644 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:11.334696 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177fdea-110a-4ca8-91cd-60385085b644 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:11.334967 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177fdea-110a-4ca8-91cd-60385085b644 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:11.354609 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177fdea-110a-4ca8-91cd-60385085b644 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:11.361607 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-9177fdea-110a-4ca8-91cd-60385085b644 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:01:11.363075 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 108/216] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:11.369508 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67abc0-0ae0-4405-baa1-78df664217f7 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:11.378843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f67abc0-0ae0-4405-baa1-78df664217f7 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:11.386123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697745a-0d34-4b1e-98e3-6173b4af4f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:11.386813 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697745a-0d34-4b1e-98e3-6173b4af4f84 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:11.387093 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697745a-0d34-4b1e-98e3-6173b4af4f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:11.387367 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697745a-0d34-4b1e-98e3-6173b4af4f84 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:11.388142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697745a-0d34-4b1e-98e3-6173b4af4f84 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:11.388442 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697745a-0d34-4b1e-98e3-6173b4af4f84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:11.390299 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8697745a-0d34-4b1e-98e3-6173b4af4f84 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:11.402836 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 109/217] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:11.406507 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177fdea-110a-4ca8-91cd-60385085b644 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:11.423456 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177fdea-110a-4ca8-91cd-60385085b644 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:11.428016 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12b541-8fef-432f-9933-2876b1125386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:11.428876 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12b541-8fef-432f-9933-2876b1125386 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:11.429194 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12b541-8fef-432f-9933-2876b1125386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:11.429404 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c12b541-8fef-432f-9933-2876b1125386 admin admin] PATH_INFO: `/v3/users/bfeda756d5b84f81aba1c8d226cdac52` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:11.434752 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12b541-8fef-432f-9933-2876b1125386 admin admin] RBAC: Authorizing `identity:get_user(user_id=bfeda756d5b84f81aba1c8d226cdac52)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:11.436579 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c12b541-8fef-432f-9933-2876b1125386 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:11.438350 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 109/218] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:01:11 2021] GET /identity/v3/users/bfeda756d5b84f81aba1c8d226cdac52 => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:11.444609 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697745a-0d34-4b1e-98e3-6173b4af4f84 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:11.455017 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697745a-0d34-4b1e-98e3-6173b4af4f84 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:11.466810 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db161bd5-e616-4dc7-8a29-4f609ddde565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:11.466810 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db161bd5-e616-4dc7-8a29-4f609ddde565 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:11.467268 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db161bd5-e616-4dc7-8a29-4f609ddde565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:11.467409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db161bd5-e616-4dc7-8a29-4f609ddde565 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:11.477165 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db161bd5-e616-4dc7-8a29-4f609ddde565 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:11.479023 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db161bd5-e616-4dc7-8a29-4f609ddde565 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:11.488719 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 110/219] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:11 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:01:11.495580 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12b541-8fef-432f-9933-2876b1125386 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:11.511430 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c12b541-8fef-432f-9933-2876b1125386 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:11.516441 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a89ed8-d3b0-4599-a6ae-d1eeebb262da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:11.517300 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a89ed8-d3b0-4599-a6ae-d1eeebb262da admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:11.517578 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a89ed8-d3b0-4599-a6ae-d1eeebb262da admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:11.518408 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a89ed8-d3b0-4599-a6ae-d1eeebb262da admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:11.522960 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a89ed8-d3b0-4599-a6ae-d1eeebb262da admin admin] RBAC: Authorizing `identity:get_project(project_id=98d7e030a12e408899c86d19f869ade2)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:11.525072 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a89ed8-d3b0-4599-a6ae-d1eeebb262da admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:11.527282 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 110/220] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:11 2021] GET /identity/v3/projects/98d7e030a12e408899c86d19f869ade2 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:11.534289 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db161bd5-e616-4dc7-8a29-4f609ddde565 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:11.543601 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db161bd5-e616-4dc7-8a29-4f609ddde565 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:11.554068 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba76bc-635c-47ea-835b-9e833cc53fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:11.554740 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba76bc-635c-47ea-835b-9e833cc53fea admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:11.555020 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba76bc-635c-47ea-835b-9e833cc53fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:11.555289 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba76bc-635c-47ea-835b-9e833cc53fea admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:11.556138 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba76bc-635c-47ea-835b-9e833cc53fea admin admin] RBAC: Adding query filter params (role.id=f28d3f93a0524078a592a15459808378, scope.project.id=98d7e030a12e408899c86d19f869ade2, user.id=bfeda756d5b84f81aba1c8d226cdac52) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:11.556444 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba76bc-635c-47ea-835b-9e833cc53fea admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:11.558325 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba76bc-635c-47ea-835b-9e833cc53fea admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:11.569331 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 111/221] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:11 2021] GET /identity/v3/role_assignments?user.id=bfeda756d5b84f81aba1c8d226cdac52&scope.project.id=98d7e030a12e408899c86d19f869ade2&role.id=f28d3f93a0524078a592a15459808378 => generated 608 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:13.132359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e37a72-dff3-438d-8f34-552967e1afc4 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.133534 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e37a72-dff3-438d-8f34-552967e1afc4 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.134063 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e37a72-dff3-438d-8f34-552967e1afc4 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.136109 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 111/222] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:13 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:13.143275 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec932cf1-3fdc-4f85-bf42-6bdcca266d6f None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.144172 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec932cf1-3fdc-4f85-bf42-6bdcca266d6f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.144662 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec932cf1-3fdc-4f85-bf42-6bdcca266d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.168625 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-ec932cf1-3fdc-4f85-bf42-6bdcca266d6f None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:13.170171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ec932cf1-3fdc-4f85-bf42-6bdcca266d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:13.178721 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 112/223] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:13.216733 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed868882-3c84-4d6f-9992-281a1abf0f6a None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.217360 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed868882-3c84-4d6f-9992-281a1abf0f6a None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.217827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed868882-3c84-4d6f-9992-281a1abf0f6a None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.219858 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 112/224] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:13.221990 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec932cf1-3fdc-4f85-bf42-6bdcca266d6f None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:13.231657 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec932cf1-3fdc-4f85-bf42-6bdcca266d6f None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:13.238694 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6330f56f-d3ff-4079-b330-de9d13cbab61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:13.239522 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330f56f-d3ff-4079-b330-de9d13cbab61 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.239801 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330f56f-d3ff-4079-b330-de9d13cbab61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.240072 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6330f56f-d3ff-4079-b330-de9d13cbab61 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.241090 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003042d-802c-47f2-8f4a-518f6e90f3ac None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.241600 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003042d-802c-47f2-8f4a-518f6e90f3ac None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.242123 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003042d-802c-47f2-8f4a-518f6e90f3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.262868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6330f56f-d3ff-4079-b330-de9d13cbab61 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:13.272273 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-4003042d-802c-47f2-8f4a-518f6e90f3ac None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:13.272452 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-6330f56f-d3ff-4079-b330-de9d13cbab61 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 16:01:13.273903 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 113/225] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:01:13 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:13.274451 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-4003042d-802c-47f2-8f4a-518f6e90f3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:13.275474 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e3b2e-a007-4ac2-8799-a2bfaec72905 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.275846 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e3b2e-a007-4ac2-8799-a2bfaec72905 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.276125 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29e3b2e-a007-4ac2-8799-a2bfaec72905 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.283248 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 114/226] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:13 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:13.286485 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e3b2e-a007-4ac2-8799-a2bfaec72905 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:13.300605 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 113/227] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:13.305612 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29e3b2e-a007-4ac2-8799-a2bfaec72905 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:13.314421 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdeb3c9-1c50-4c1e-8733-8e8ffeaa59f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:13.315333 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeb3c9-1c50-4c1e-8733-8e8ffeaa59f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.315612 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeb3c9-1c50-4c1e-8733-8e8ffeaa59f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.315877 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdeb3c9-1c50-4c1e-8733-8e8ffeaa59f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.316663 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdeb3c9-1c50-4c1e-8733-8e8ffeaa59f5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:13.316965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdeb3c9-1c50-4c1e-8733-8e8ffeaa59f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:13.318616 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdeb3c9-1c50-4c1e-8733-8e8ffeaa59f5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:13.332197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 115/228] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:13 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:13.338917 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003042d-802c-47f2-8f4a-518f6e90f3ac None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:13.341937 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41109bd8-ed47-47b3-a58f-741f6e071546 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.342466 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41109bd8-ed47-47b3-a58f-741f6e071546 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.342824 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41109bd8-ed47-47b3-a58f-741f6e071546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.358646 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003042d-802c-47f2-8f4a-518f6e90f3ac None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:13.369167 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-41109bd8-ed47-47b3-a58f-741f6e071546 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:13.370550 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-41109bd8-ed47-47b3-a58f-741f6e071546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:13.371048 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a02841-c290-4477-b8ef-2713cdda97d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:13.372164 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a02841-c290-4477-b8ef-2713cdda97d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.372803 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a02841-c290-4477-b8ef-2713cdda97d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.373268 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a02841-c290-4477-b8ef-2713cdda97d9 admin admin] PATH_INFO: `/v3/users/b6985df347344ceb8b5a19e9ed66bcf1` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.378852 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a02841-c290-4477-b8ef-2713cdda97d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=b6985df347344ceb8b5a19e9ed66bcf1)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:13.381424 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a02841-c290-4477-b8ef-2713cdda97d9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:13.381557 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 116/229] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:13.382511 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41109bd8-ed47-47b3-a58f-741f6e071546 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:13.384338 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 114/230] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:01:13 2021] GET /identity/v3/users/b6985df347344ceb8b5a19e9ed66bcf1 => generated 283 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:13.399867 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41109bd8-ed47-47b3-a58f-741f6e071546 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:13.404015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a02841-c290-4477-b8ef-2713cdda97d9 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:13.405267 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac2786-bcac-4fa8-ad6d-d4259e864e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:13.406313 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac2786-bcac-4fa8-ad6d-d4259e864e0c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.406600 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac2786-bcac-4fa8-ad6d-d4259e864e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.406869 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac2786-bcac-4fa8-ad6d-d4259e864e0c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.429221 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a02841-c290-4477-b8ef-2713cdda97d9 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:13.431337 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac2786-bcac-4fa8-ad6d-d4259e864e0c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:13.438333 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-aaac2786-bcac-4fa8-ad6d-d4259e864e0c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 16:01:13.443449 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb895bd1-1d70-47f7-aa3a-001a1bdf7e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:13.444103 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb895bd1-1d70-47f7-aa3a-001a1bdf7e6d admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.444382 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb895bd1-1d70-47f7-aa3a-001a1bdf7e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.444679 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb895bd1-1d70-47f7-aa3a-001a1bdf7e6d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.449839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 117/231] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:13 2021] GET /identity/v3/roles/member => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:13.451109 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac2786-bcac-4fa8-ad6d-d4259e864e0c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:13.459441 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb895bd1-1d70-47f7-aa3a-001a1bdf7e6d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:13.461250 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb895bd1-1d70-47f7-aa3a-001a1bdf7e6d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:13.470609 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac2786-bcac-4fa8-ad6d-d4259e864e0c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:13.481051 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21f5ff-5952-42b2-824a-45f3f8fab6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:13.481867 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21f5ff-5952-42b2-824a-45f3f8fab6aa admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.483545 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 115/232] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:01:13.484467 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb895bd1-1d70-47f7-aa3a-001a1bdf7e6d admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:13.489904 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21f5ff-5952-42b2-824a-45f3f8fab6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.490220 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21f5ff-5952-42b2-824a-45f3f8fab6aa admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.503370 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb895bd1-1d70-47f7-aa3a-001a1bdf7e6d admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:13.510749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21f5ff-5952-42b2-824a-45f3f8fab6aa admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:13.518277 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-4e21f5ff-5952-42b2-824a-45f3f8fab6aa admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 16:01:13.519514 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 118/233] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:13 2021] GET /identity/v3/roles/member => generated 84 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:13.520294 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21f5ff-5952-42b2-824a-45f3f8fab6aa admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:13.522974 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dcc26-8b77-4e36-a1c7-84c7f09e49d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:13.523647 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dcc26-8b77-4e36-a1c7-84c7f09e49d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.523921 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dcc26-8b77-4e36-a1c7-84c7f09e49d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.524189 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99dcc26-8b77-4e36-a1c7-84c7f09e49d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.524963 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dcc26-8b77-4e36-a1c7-84c7f09e49d2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:13.525264 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dcc26-8b77-4e36-a1c7-84c7f09e49d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:13.526993 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99dcc26-8b77-4e36-a1c7-84c7f09e49d2 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:13.541644 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 116/234] 10.222.0.41 () {56 vars in 1122 bytes} [Fri Oct 29 16:01:13 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:13.542330 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dcc26-8b77-4e36-a1c7-84c7f09e49d2 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:13.551862 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21f5ff-5952-42b2-824a-45f3f8fab6aa admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:13.559011 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99dcc26-8b77-4e36-a1c7-84c7f09e49d2 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:13.561557 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d54f25-59fd-4520-8a5c-381055a42623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:13.562452 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d54f25-59fd-4520-8a5c-381055a42623 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.562728 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d54f25-59fd-4520-8a5c-381055a42623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.563002 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d54f25-59fd-4520-8a5c-381055a42623 admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.566011 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d54f25-59fd-4520-8a5c-381055a42623 admin admin] RBAC: Authorizing `identity:get_project(project_id=98d7e030a12e408899c86d19f869ade2)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:13.568080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d54f25-59fd-4520-8a5c-381055a42623 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:13.569805 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 119/235] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:13 2021] GET /identity/v3/projects/98d7e030a12e408899c86d19f869ade2 => generated 302 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:13.570594 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d54f25-59fd-4520-8a5c-381055a42623 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:13.573436 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bbef0-911d-4a19-9a2e-db5dd78d7da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:13.574150 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bbef0-911d-4a19-9a2e-db5dd78d7da0 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.574428 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bbef0-911d-4a19-9a2e-db5dd78d7da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.574699 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358bbef0-911d-4a19-9a2e-db5dd78d7da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.575749 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bbef0-911d-4a19-9a2e-db5dd78d7da0 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:13.576055 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bbef0-911d-4a19-9a2e-db5dd78d7da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:13.583819 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358bbef0-911d-4a19-9a2e-db5dd78d7da0 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:13.587856 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d54f25-59fd-4520-8a5c-381055a42623 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:13.592555 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb7521-46c1-40a7-a362-2db214f8d287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:13.593432 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb7521-46c1-40a7-a362-2db214f8d287 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.593709 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb7521-46c1-40a7-a362-2db214f8d287 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.595859 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb7521-46c1-40a7-a362-2db214f8d287 admin admin] PATH_INFO: `/v3/users/b6985df347344ceb8b5a19e9ed66bcf1` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.597835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb7521-46c1-40a7-a362-2db214f8d287 admin admin] RBAC: Authorizing `identity:get_user(user_id=b6985df347344ceb8b5a19e9ed66bcf1)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:13.598827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 117/236] 10.222.0.41 () {56 vars in 1122 bytes} [Fri Oct 29 16:01:13 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:13.601771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bb7521-46c1-40a7-a362-2db214f8d287 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:13.601771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 120/237] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:01:13 2021] GET /identity/v3/users/b6985df347344ceb8b5a19e9ed66bcf1 => generated 283 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:13.606093 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bbef0-911d-4a19-9a2e-db5dd78d7da0 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:13.610942 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb7521-46c1-40a7-a362-2db214f8d287 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:13.620586 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358bbef0-911d-4a19-9a2e-db5dd78d7da0 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:13.621443 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bb7521-46c1-40a7-a362-2db214f8d287 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:13.630777 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74c483-9c7a-43ce-80d0-eba3198a08b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:13.632011 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74c483-9c7a-43ce-80d0-eba3198a08b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.632473 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74c483-9c7a-43ce-80d0-eba3198a08b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.633000 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74c483-9c7a-43ce-80d0-eba3198a08b4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.633845 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656607f-c935-4849-b169-5595f2534d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:13.634620 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656607f-c935-4849-b169-5595f2534d20 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.634908 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656607f-c935-4849-b169-5595f2534d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.638379 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656607f-c935-4849-b169-5595f2534d20 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.639411 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656607f-c935-4849-b169-5595f2534d20 admin admin] RBAC: Adding query filter params (role.id=8eba80d4381a47ffb74df6e1f9dda34a, scope.project.id=98d7e030a12e408899c86d19f869ade2, user.id=b6985df347344ceb8b5a19e9ed66bcf1) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:13.639727 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656607f-c935-4849-b169-5595f2534d20 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:13.641680 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656607f-c935-4849-b169-5595f2534d20 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:13.647898 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74c483-9c7a-43ce-80d0-eba3198a08b4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:13.650042 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74c483-9c7a-43ce-80d0-eba3198a08b4 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:13.655624 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 118/238] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:13 2021] GET /identity/v3/role_assignments?user.id=b6985df347344ceb8b5a19e9ed66bcf1&scope.project.id=98d7e030a12e408899c86d19f869ade2&role.id=8eba80d4381a47ffb74df6e1f9dda34a => generated 608 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:13.656497 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656607f-c935-4849-b169-5595f2534d20 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:13.667878 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 121/239] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:13.680234 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74c483-9c7a-43ce-80d0-eba3198a08b4 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:13.680752 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656607f-c935-4849-b169-5595f2534d20 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:13.695007 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e416b1d-2219-42b6-8954-ba32d65ee41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:13.695750 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e416b1d-2219-42b6-8954-ba32d65ee41b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.696039 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e416b1d-2219-42b6-8954-ba32d65ee41b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.696321 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e416b1d-2219-42b6-8954-ba32d65ee41b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.709992 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74c483-9c7a-43ce-80d0-eba3198a08b4 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:13.715119 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e416b1d-2219-42b6-8954-ba32d65ee41b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:13.717099 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e416b1d-2219-42b6-8954-ba32d65ee41b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:13.724406 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744740b8-182f-47fb-8ade-fce28ee029e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:13.725342 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744740b8-182f-47fb-8ade-fce28ee029e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.725613 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744740b8-182f-47fb-8ade-fce28ee029e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.725885 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744740b8-182f-47fb-8ade-fce28ee029e2 admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.730904 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744740b8-182f-47fb-8ade-fce28ee029e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=77d119a645a14cd79d87aae94a06ec80)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:13.733013 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744740b8-182f-47fb-8ade-fce28ee029e2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:13.733899 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 119/240] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:13.735240 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 122/241] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:13 2021] GET /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80 => generated 298 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:13.745509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e416b1d-2219-42b6-8954-ba32d65ee41b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:13.751421 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744740b8-182f-47fb-8ade-fce28ee029e2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:13.759602 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e416b1d-2219-42b6-8954-ba32d65ee41b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:13.768400 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4d530-16aa-4a0b-9200-751c8e24b6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:13.768678 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4d530-16aa-4a0b-9200-751c8e24b6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.768966 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4d530-16aa-4a0b-9200-751c8e24b6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.769568 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f4d530-16aa-4a0b-9200-751c8e24b6e4 admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.770859 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4d530-16aa-4a0b-9200-751c8e24b6e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=98d7e030a12e408899c86d19f869ade2)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:13.772869 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f4d530-16aa-4a0b-9200-751c8e24b6e4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:13.773599 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744740b8-182f-47fb-8ade-fce28ee029e2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:13.774746 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 120/242] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:13 2021] GET /identity/v3/projects/98d7e030a12e408899c86d19f869ade2 => generated 302 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:13.783393 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4d530-16aa-4a0b-9200-751c8e24b6e4 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:13.790656 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d66a65-853d-4c2b-9ae3-1323008a631f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:13.791539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d66a65-853d-4c2b-9ae3-1323008a631f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.791818 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d66a65-853d-4c2b-9ae3-1323008a631f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.792087 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d66a65-853d-4c2b-9ae3-1323008a631f admin admin] PATH_INFO: `/v3/groups/7289a3abf364422c8122972158203336` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.797019 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f4d530-16aa-4a0b-9200-751c8e24b6e4 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:13.804672 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8405ed-b8ff-4570-b01b-58635d3e9690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:13.805378 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8405ed-b8ff-4570-b01b-58635d3e9690 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.805662 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8405ed-b8ff-4570-b01b-58635d3e9690 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.805965 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8405ed-b8ff-4570-b01b-58635d3e9690 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.806918 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8405ed-b8ff-4570-b01b-58635d3e9690 admin admin] RBAC: Adding query filter params (role.id=4a1afb6391114961afeec5c1d72563f0, scope.project.id=98d7e030a12e408899c86d19f869ade2, user.id=b6985df347344ceb8b5a19e9ed66bcf1) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:13.807268 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8405ed-b8ff-4570-b01b-58635d3e9690 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:13.809131 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8405ed-b8ff-4570-b01b-58635d3e9690 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:13.810751 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d66a65-853d-4c2b-9ae3-1323008a631f admin admin] RBAC: Authorizing `identity:get_group(group_id=7289a3abf364422c8122972158203336)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:13.811808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING py.warnings [None req-d8d66a65-853d-4c2b-9ae3-1323008a631f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:01:13.811808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: warnings.warn(msg) Oct 29 16:01:13.811808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: Oct 29 16:01:13.813041 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d66a65-853d-4c2b-9ae3-1323008a631f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:13.815078 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 123/243] 10.222.0.41 () {56 vars in 1201 bytes} [Fri Oct 29 16:01:13 2021] GET /identity/v3/groups/7289a3abf364422c8122972158203336 => generated 226 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:13.820891 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 121/244] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:13 2021] GET /identity/v3/role_assignments?user.id=b6985df347344ceb8b5a19e9ed66bcf1&scope.project.id=98d7e030a12e408899c86d19f869ade2&role.id=4a1afb6391114961afeec5c1d72563f0 => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:13.833979 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d66a65-853d-4c2b-9ae3-1323008a631f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:13.852439 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d66a65-853d-4c2b-9ae3-1323008a631f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:13.862726 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556df19b-3b8e-48f9-84b1-7dc5a5ab07a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:13.863422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556df19b-3b8e-48f9-84b1-7dc5a5ab07a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:13.863712 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556df19b-3b8e-48f9-84b1-7dc5a5ab07a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:13.863988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556df19b-3b8e-48f9-84b1-7dc5a5ab07a5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:13.864871 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556df19b-3b8e-48f9-84b1-7dc5a5ab07a5 admin admin] RBAC: Adding query filter params (group.id=7289a3abf364422c8122972158203336, role.id=4a1afb6391114961afeec5c1d72563f0, scope.project.id=77d119a645a14cd79d87aae94a06ec80) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:13.865187 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556df19b-3b8e-48f9-84b1-7dc5a5ab07a5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:13.867185 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556df19b-3b8e-48f9-84b1-7dc5a5ab07a5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:13.880385 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 124/245] 10.222.0.41 () {56 vars in 1397 bytes} [Fri Oct 29 16:01:13 2021] GET /identity/v3/role_assignments?group.id=7289a3abf364422c8122972158203336&scope.project.id=77d119a645a14cd79d87aae94a06ec80&role.id=4a1afb6391114961afeec5c1d72563f0 => generated 260 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:14.036193 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13673e-da76-4343-9e8d-923ca525ebfd None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:14.036493 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13673e-da76-4343-9e8d-923ca525ebfd None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:14.036851 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13673e-da76-4343-9e8d-923ca525ebfd None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:14.039972 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 122/246] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:14 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:14.052888 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dadf31-9f02-4dfa-926a-d7a6f318623f None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:14.053185 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dadf31-9f02-4dfa-926a-d7a6f318623f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:14.053446 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dadf31-9f02-4dfa-926a-d7a6f318623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:14.079072 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-f9dadf31-9f02-4dfa-926a-d7a6f318623f None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:14.080904 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f9dadf31-9f02-4dfa-926a-d7a6f318623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:14.089150 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 125/247] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:14.125843 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13673e-da76-4343-9e8d-923ca525ebfd None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:14.143298 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c13673e-da76-4343-9e8d-923ca525ebfd None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:14.152239 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef7ce5-5f0c-45a2-91a0-2feb7c27da1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:14.153070 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef7ce5-5f0c-45a2-91a0-2feb7c27da1f admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:14.153354 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef7ce5-5f0c-45a2-91a0-2feb7c27da1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:14.153632 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef7ce5-5f0c-45a2-91a0-2feb7c27da1f admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:14.172723 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef7ce5-5f0c-45a2-91a0-2feb7c27da1f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:14.180364 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-21ef7ce5-5f0c-45a2-91a0-2feb7c27da1f admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 16:01:14.181881 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 123/248] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:01:14 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:14.188712 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dadf31-9f02-4dfa-926a-d7a6f318623f None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:14.198989 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dadf31-9f02-4dfa-926a-d7a6f318623f None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:14.210097 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b428f6-cd1b-4113-9312-479af577ef00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:14.210795 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b428f6-cd1b-4113-9312-479af577ef00 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:14.211085 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b428f6-cd1b-4113-9312-479af577ef00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:14.211363 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b428f6-cd1b-4113-9312-479af577ef00 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:14.212147 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b428f6-cd1b-4113-9312-479af577ef00 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:14.212455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b428f6-cd1b-4113-9312-479af577ef00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:14.214123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b428f6-cd1b-4113-9312-479af577ef00 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:14.226216 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 126/249] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:14 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:14.232940 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef7ce5-5f0c-45a2-91a0-2feb7c27da1f admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:14.243702 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef7ce5-5f0c-45a2-91a0-2feb7c27da1f admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:14.251208 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3acf4d-5ff7-4827-b327-ee30ba6da2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:14.251881 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3acf4d-5ff7-4827-b327-ee30ba6da2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:14.252699 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3acf4d-5ff7-4827-b327-ee30ba6da2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:14.252976 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3acf4d-5ff7-4827-b327-ee30ba6da2b8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:14.265685 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3acf4d-5ff7-4827-b327-ee30ba6da2b8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:14.267521 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3acf4d-5ff7-4827-b327-ee30ba6da2b8 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:14.278567 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 124/250] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:14.285341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b428f6-cd1b-4113-9312-479af577ef00 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:14.296061 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b428f6-cd1b-4113-9312-479af577ef00 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:14.305720 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84500e65-3655-47d8-840f-c6ae79c204e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:14.306658 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84500e65-3655-47d8-840f-c6ae79c204e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:14.306941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84500e65-3655-47d8-840f-c6ae79c204e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:14.307222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84500e65-3655-47d8-840f-c6ae79c204e4 admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:14.308659 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84500e65-3655-47d8-840f-c6ae79c204e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=77d119a645a14cd79d87aae94a06ec80)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:14.310916 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84500e65-3655-47d8-840f-c6ae79c204e4 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:14.312793 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 127/251] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:14 2021] GET /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80 => generated 298 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:14.319917 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3acf4d-5ff7-4827-b327-ee30ba6da2b8 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:14.329881 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3acf4d-5ff7-4827-b327-ee30ba6da2b8 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:14.338014 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b61d6-f761-449b-8efb-82a7ab672d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:14.338944 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b61d6-f761-449b-8efb-82a7ab672d14 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:14.339229 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b61d6-f761-449b-8efb-82a7ab672d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:14.339510 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b61d6-f761-449b-8efb-82a7ab672d14 admin admin] PATH_INFO: `/v3/groups/7289a3abf364422c8122972158203336` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:14.340911 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b61d6-f761-449b-8efb-82a7ab672d14 admin admin] RBAC: Authorizing `identity:get_group(group_id=7289a3abf364422c8122972158203336)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:14.341994 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING py.warnings [None req-cb3b61d6-f761-449b-8efb-82a7ab672d14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:01:14.341994 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: warnings.warn(msg) Oct 29 16:01:14.341994 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: Oct 29 16:01:14.343231 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b61d6-f761-449b-8efb-82a7ab672d14 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:14.345042 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 125/252] 10.222.0.41 () {56 vars in 1201 bytes} [Fri Oct 29 16:01:14 2021] GET /identity/v3/groups/7289a3abf364422c8122972158203336 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:14.353192 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84500e65-3655-47d8-840f-c6ae79c204e4 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:14.364438 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84500e65-3655-47d8-840f-c6ae79c204e4 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:14.370147 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13058bd1-519f-41c4-a104-fb7f1c04e465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:14.370834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13058bd1-519f-41c4-a104-fb7f1c04e465 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:14.371120 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13058bd1-519f-41c4-a104-fb7f1c04e465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:14.371399 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13058bd1-519f-41c4-a104-fb7f1c04e465 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:14.372295 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13058bd1-519f-41c4-a104-fb7f1c04e465 admin admin] RBAC: Adding query filter params (group.id=7289a3abf364422c8122972158203336, role.id=8eba80d4381a47ffb74df6e1f9dda34a, scope.project.id=77d119a645a14cd79d87aae94a06ec80) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:14.372610 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13058bd1-519f-41c4-a104-fb7f1c04e465 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:14.374666 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13058bd1-519f-41c4-a104-fb7f1c04e465 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:14.386885 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 128/253] 10.222.0.41 () {56 vars in 1397 bytes} [Fri Oct 29 16:01:14 2021] GET /identity/v3/role_assignments?group.id=7289a3abf364422c8122972158203336&scope.project.id=77d119a645a14cd79d87aae94a06ec80&role.id=8eba80d4381a47ffb74df6e1f9dda34a => generated 260 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:14.486232 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314a3d8-4748-4646-9769-292b98118a1f None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:14.487116 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314a3d8-4748-4646-9769-292b98118a1f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:14.487341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314a3d8-4748-4646-9769-292b98118a1f None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:14.489352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 126/254] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:14.496808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2782fb-c27f-4d9c-8f87-70ee487e0759 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:14.497119 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2782fb-c27f-4d9c-8f87-70ee487e0759 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:14.497357 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2782fb-c27f-4d9c-8f87-70ee487e0759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:14.519794 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-4d2782fb-c27f-4d9c-8f87-70ee487e0759 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:14.521045 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4d2782fb-c27f-4d9c-8f87-70ee487e0759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:14.531197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 129/255] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:14.570418 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314a3d8-4748-4646-9769-292b98118a1f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:14.586786 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314a3d8-4748-4646-9769-292b98118a1f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:14.591517 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa29ac0-2fe8-49d1-a83e-2e99dd4c4102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:14.592341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa29ac0-2fe8-49d1-a83e-2e99dd4c4102 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:14.592626 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa29ac0-2fe8-49d1-a83e-2e99dd4c4102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:14.592902 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa29ac0-2fe8-49d1-a83e-2e99dd4c4102 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:14.607912 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa29ac0-2fe8-49d1-a83e-2e99dd4c4102 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:14.615625 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-4aa29ac0-2fe8-49d1-a83e-2e99dd4c4102 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 16:01:14.617229 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 127/256] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:14 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:14.623651 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2782fb-c27f-4d9c-8f87-70ee487e0759 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:14.636868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2782fb-c27f-4d9c-8f87-70ee487e0759 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:14.648737 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6297754-a972-4cb0-8f35-57ea5d27ea93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:14.649822 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6297754-a972-4cb0-8f35-57ea5d27ea93 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:14.650353 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6297754-a972-4cb0-8f35-57ea5d27ea93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:14.650818 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6297754-a972-4cb0-8f35-57ea5d27ea93 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:14.651773 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6297754-a972-4cb0-8f35-57ea5d27ea93 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:14.652266 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6297754-a972-4cb0-8f35-57ea5d27ea93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:14.654157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6297754-a972-4cb0-8f35-57ea5d27ea93 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:14.670178 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 130/257] 10.222.0.41 () {56 vars in 1122 bytes} [Fri Oct 29 16:01:14 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:14.677768 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa29ac0-2fe8-49d1-a83e-2e99dd4c4102 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:14.690031 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa29ac0-2fe8-49d1-a83e-2e99dd4c4102 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:14.703138 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5a389-79bf-492d-a287-87a6e85210a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:14.703817 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5a389-79bf-492d-a287-87a6e85210a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:14.704102 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5a389-79bf-492d-a287-87a6e85210a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:14.704384 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5a389-79bf-492d-a287-87a6e85210a9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:14.718394 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5a389-79bf-492d-a287-87a6e85210a9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:14.720220 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5a389-79bf-492d-a287-87a6e85210a9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:14.731082 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 128/258] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:14.738117 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6297754-a972-4cb0-8f35-57ea5d27ea93 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:14.753107 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6297754-a972-4cb0-8f35-57ea5d27ea93 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:14.760999 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031708a-4a5d-4a53-aa0b-361140ebc33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:14.762420 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031708a-4a5d-4a53-aa0b-361140ebc33f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:14.762929 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031708a-4a5d-4a53-aa0b-361140ebc33f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:14.763397 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031708a-4a5d-4a53-aa0b-361140ebc33f admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:14.770880 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031708a-4a5d-4a53-aa0b-361140ebc33f admin admin] RBAC: Authorizing `identity:get_project(project_id=98d7e030a12e408899c86d19f869ade2)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:14.773338 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031708a-4a5d-4a53-aa0b-361140ebc33f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:14.775394 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 131/259] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:14 2021] GET /identity/v3/projects/98d7e030a12e408899c86d19f869ade2 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:14.782285 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5a389-79bf-492d-a287-87a6e85210a9 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:14.792447 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5a389-79bf-492d-a287-87a6e85210a9 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:14.802504 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3ac15-fda8-4117-ab35-e2574dc34e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:14.803376 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3ac15-fda8-4117-ab35-e2574dc34e0c admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:14.803659 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3ac15-fda8-4117-ab35-e2574dc34e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:14.803941 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3ac15-fda8-4117-ab35-e2574dc34e0c admin admin] PATH_INFO: `/v3/groups/7289a3abf364422c8122972158203336` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:14.810841 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3ac15-fda8-4117-ab35-e2574dc34e0c admin admin] RBAC: Authorizing `identity:get_group(group_id=7289a3abf364422c8122972158203336)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:14.812792 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3ac15-fda8-4117-ab35-e2574dc34e0c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:14.814923 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 129/260] 10.222.0.41 () {56 vars in 1201 bytes} [Fri Oct 29 16:01:14 2021] GET /identity/v3/groups/7289a3abf364422c8122972158203336 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:14.821471 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031708a-4a5d-4a53-aa0b-361140ebc33f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:14.837967 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031708a-4a5d-4a53-aa0b-361140ebc33f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:14.843261 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0238d2f-69fe-4caf-9d76-75282c018e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:14.844239 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0238d2f-69fe-4caf-9d76-75282c018e13 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:14.844713 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0238d2f-69fe-4caf-9d76-75282c018e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:14.845196 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0238d2f-69fe-4caf-9d76-75282c018e13 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:14.846796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0238d2f-69fe-4caf-9d76-75282c018e13 admin admin] RBAC: Adding query filter params (group.id=7289a3abf364422c8122972158203336, role.id=4a1afb6391114961afeec5c1d72563f0, scope.project.id=98d7e030a12e408899c86d19f869ade2) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:14.847320 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0238d2f-69fe-4caf-9d76-75282c018e13 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:14.849360 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0238d2f-69fe-4caf-9d76-75282c018e13 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:14.855920 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 132/261] 10.222.0.41 () {56 vars in 1397 bytes} [Fri Oct 29 16:01:14 2021] GET /identity/v3/role_assignments?group.id=7289a3abf364422c8122972158203336&scope.project.id=98d7e030a12e408899c86d19f869ade2&role.id=4a1afb6391114961afeec5c1d72563f0 => generated 260 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:15.304738 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cc431-100d-4a1e-83da-876d0a6fd671 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:15.305240 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cc431-100d-4a1e-83da-876d0a6fd671 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:15.305314 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cc431-100d-4a1e-83da-876d0a6fd671 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:15.307130 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 130/262] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:01:15.313436 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ea772-b68e-45ae-a5cf-900676036c13 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:15.313936 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ea772-b68e-45ae-a5cf-900676036c13 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:15.314014 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ea772-b68e-45ae-a5cf-900676036c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:15.341163 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-867ea772-b68e-45ae-a5cf-900676036c13 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:15.342387 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-867ea772-b68e-45ae-a5cf-900676036c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:15.353426 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 133/263] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:15.400184 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cc431-100d-4a1e-83da-876d0a6fd671 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:15.426890 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cc431-100d-4a1e-83da-876d0a6fd671 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:15.437123 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26bc83-d9da-4857-bb72-a908c2e9798b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:15.438390 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26bc83-d9da-4857-bb72-a908c2e9798b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:15.438818 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26bc83-d9da-4857-bb72-a908c2e9798b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:15.439259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf26bc83-d9da-4857-bb72-a908c2e9798b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:15.454926 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf26bc83-d9da-4857-bb72-a908c2e9798b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:15.463624 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-bf26bc83-d9da-4857-bb72-a908c2e9798b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 16:01:15.470038 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 131/264] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:01:15 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:15.472251 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ea772-b68e-45ae-a5cf-900676036c13 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:15.486470 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ea772-b68e-45ae-a5cf-900676036c13 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:15.496511 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d055e40-9988-482f-88ce-a63d9d8f3a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:15.497200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d055e40-9988-482f-88ce-a63d9d8f3a36 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:15.497479 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d055e40-9988-482f-88ce-a63d9d8f3a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:15.497751 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d055e40-9988-482f-88ce-a63d9d8f3a36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:15.498557 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d055e40-9988-482f-88ce-a63d9d8f3a36 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:15.498860 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d055e40-9988-482f-88ce-a63d9d8f3a36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:15.500460 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d055e40-9988-482f-88ce-a63d9d8f3a36 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:15.513974 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 134/265] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:15 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:15.520374 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26bc83-d9da-4857-bb72-a908c2e9798b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:15.535783 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf26bc83-d9da-4857-bb72-a908c2e9798b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:15.540800 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab190545-174f-4547-86cf-8a5bae732bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:15.541443 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab190545-174f-4547-86cf-8a5bae732bfd admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:15.541724 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab190545-174f-4547-86cf-8a5bae732bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:15.542022 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab190545-174f-4547-86cf-8a5bae732bfd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:15.554122 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab190545-174f-4547-86cf-8a5bae732bfd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:15.555970 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab190545-174f-4547-86cf-8a5bae732bfd admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:15.572274 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 132/266] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:15.578837 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d055e40-9988-482f-88ce-a63d9d8f3a36 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:15.588826 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d055e40-9988-482f-88ce-a63d9d8f3a36 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:15.598597 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867884f6-ed06-4701-9598-bce042b89d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:15.599472 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867884f6-ed06-4701-9598-bce042b89d16 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:15.599775 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867884f6-ed06-4701-9598-bce042b89d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:15.600085 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867884f6-ed06-4701-9598-bce042b89d16 admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:15.601320 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867884f6-ed06-4701-9598-bce042b89d16 admin admin] RBAC: Authorizing `identity:get_project(project_id=98d7e030a12e408899c86d19f869ade2)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:15.603398 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867884f6-ed06-4701-9598-bce042b89d16 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:15.605265 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 135/267] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:15 2021] GET /identity/v3/projects/98d7e030a12e408899c86d19f869ade2 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:15.612052 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab190545-174f-4547-86cf-8a5bae732bfd admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:15.627719 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab190545-174f-4547-86cf-8a5bae732bfd admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:15.632418 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e3df32-a88f-4ce3-9a15-12c860d3cc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:15.633271 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3df32-a88f-4ce3-9a15-12c860d3cc36 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:15.633549 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3df32-a88f-4ce3-9a15-12c860d3cc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:15.633823 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3df32-a88f-4ce3-9a15-12c860d3cc36 admin admin] PATH_INFO: `/v3/groups/7289a3abf364422c8122972158203336` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:15.638716 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3df32-a88f-4ce3-9a15-12c860d3cc36 admin admin] RBAC: Authorizing `identity:get_group(group_id=7289a3abf364422c8122972158203336)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:15.640770 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e3df32-a88f-4ce3-9a15-12c860d3cc36 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:15.642478 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 133/268] 10.222.0.41 () {56 vars in 1201 bytes} [Fri Oct 29 16:01:15 2021] GET /identity/v3/groups/7289a3abf364422c8122972158203336 => generated 226 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:15.649845 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867884f6-ed06-4701-9598-bce042b89d16 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:15.663266 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867884f6-ed06-4701-9598-bce042b89d16 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:15.671534 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7185e6f-c93d-442b-90da-e7fd02f2875d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:15.672200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7185e6f-c93d-442b-90da-e7fd02f2875d admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:15.672479 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7185e6f-c93d-442b-90da-e7fd02f2875d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:15.672751 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7185e6f-c93d-442b-90da-e7fd02f2875d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:15.673628 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7185e6f-c93d-442b-90da-e7fd02f2875d admin admin] RBAC: Adding query filter params (group.id=7289a3abf364422c8122972158203336, role.id=8eba80d4381a47ffb74df6e1f9dda34a, scope.project.id=98d7e030a12e408899c86d19f869ade2) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:15.674452 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7185e6f-c93d-442b-90da-e7fd02f2875d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:15.676755 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7185e6f-c93d-442b-90da-e7fd02f2875d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:15.685808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 136/269] 10.222.0.41 () {56 vars in 1397 bytes} [Fri Oct 29 16:01:15 2021] GET /identity/v3/role_assignments?group.id=7289a3abf364422c8122972158203336&scope.project.id=98d7e030a12e408899c86d19f869ade2&role.id=8eba80d4381a47ffb74df6e1f9dda34a => generated 260 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:16.097012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbab4fb-203d-482e-ae7e-07ea27356fbb None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:16.097413 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbab4fb-203d-482e-ae7e-07ea27356fbb None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:16.097578 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbab4fb-203d-482e-ae7e-07ea27356fbb None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:16.099393 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 134/270] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:01:16.108105 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0813dd-8f03-43e0-8974-fbb8c212d295 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:16.108439 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0813dd-8f03-43e0-8974-fbb8c212d295 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:16.108652 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0813dd-8f03-43e0-8974-fbb8c212d295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:16.132139 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-be0813dd-8f03-43e0-8974-fbb8c212d295 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:16.133403 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-be0813dd-8f03-43e0-8974-fbb8c212d295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:16.141187 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 137/271] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:16 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:16.169257 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbab4fb-203d-482e-ae7e-07ea27356fbb None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:16.185509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbab4fb-203d-482e-ae7e-07ea27356fbb None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:16.190939 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1492a-f4a6-4658-a7a6-e36dcda07672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:16.191749 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1492a-f4a6-4658-a7a6-e36dcda07672 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:16.192033 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1492a-f4a6-4658-a7a6-e36dcda07672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:16.192311 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1492a-f4a6-4658-a7a6-e36dcda07672 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:16.204701 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1492a-f4a6-4658-a7a6-e36dcda07672 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:16.212306 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-c3f1492a-f4a6-4658-a7a6-e36dcda07672 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:01:16.213564 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 135/272] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:16.222282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0813dd-8f03-43e0-8974-fbb8c212d295 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:16.233618 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0813dd-8f03-43e0-8974-fbb8c212d295 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:16.241006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5581ea7-cc59-4a57-8dd5-e96f93e8dd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:16.241697 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5581ea7-cc59-4a57-8dd5-e96f93e8dd5d admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:16.241997 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5581ea7-cc59-4a57-8dd5-e96f93e8dd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:16.242273 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5581ea7-cc59-4a57-8dd5-e96f93e8dd5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:16.243039 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5581ea7-cc59-4a57-8dd5-e96f93e8dd5d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:16.243341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5581ea7-cc59-4a57-8dd5-e96f93e8dd5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:16.244954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5581ea7-cc59-4a57-8dd5-e96f93e8dd5d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:16.261952 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 138/273] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:16.268206 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1492a-f4a6-4658-a7a6-e36dcda07672 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:16.278887 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1492a-f4a6-4658-a7a6-e36dcda07672 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:16.289297 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2f150-4398-4327-a0f5-5eadde7ff064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:16.289990 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2f150-4398-4327-a0f5-5eadde7ff064 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:16.290278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2f150-4398-4327-a0f5-5eadde7ff064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:16.290614 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2f150-4398-4327-a0f5-5eadde7ff064 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:16.301811 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2f150-4398-4327-a0f5-5eadde7ff064 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:16.307246 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2f150-4398-4327-a0f5-5eadde7ff064 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:16.317768 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 136/274] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:16 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:16.327349 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5581ea7-cc59-4a57-8dd5-e96f93e8dd5d admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:16.348015 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5581ea7-cc59-4a57-8dd5-e96f93e8dd5d admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:16.358303 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41e8f4-25a8-4b13-8fb9-0b3f926526f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:16.359178 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41e8f4-25a8-4b13-8fb9-0b3f926526f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:16.359456 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41e8f4-25a8-4b13-8fb9-0b3f926526f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:16.359735 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41e8f4-25a8-4b13-8fb9-0b3f926526f9 admin admin] PATH_INFO: `/v3/projects/fe31d02174b84ed29a89c0315c571a54` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:16.366775 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41e8f4-25a8-4b13-8fb9-0b3f926526f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=fe31d02174b84ed29a89c0315c571a54)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:16.368633 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41e8f4-25a8-4b13-8fb9-0b3f926526f9 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:16.370418 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 139/275] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:16 2021] GET /identity/v3/projects/fe31d02174b84ed29a89c0315c571a54 => generated 344 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:16.376870 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2f150-4398-4327-a0f5-5eadde7ff064 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:16.386348 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2f150-4398-4327-a0f5-5eadde7ff064 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:16.398250 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98601e12-a7f3-4fe3-8d8e-30e6a30fc53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:16.399210 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98601e12-a7f3-4fe3-8d8e-30e6a30fc53d admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:16.399497 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98601e12-a7f3-4fe3-8d8e-30e6a30fc53d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:16.399822 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98601e12-a7f3-4fe3-8d8e-30e6a30fc53d admin admin] PATH_INFO: `/v3/groups/4de3a5ea358741999811ca02e72a29fc` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:16.409033 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98601e12-a7f3-4fe3-8d8e-30e6a30fc53d admin admin] RBAC: Authorizing `identity:get_group(group_id=4de3a5ea358741999811ca02e72a29fc)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:16.411010 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98601e12-a7f3-4fe3-8d8e-30e6a30fc53d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:16.412968 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 137/276] 10.222.0.41 () {56 vars in 1201 bytes} [Fri Oct 29 16:01:16 2021] GET /identity/v3/groups/4de3a5ea358741999811ca02e72a29fc => generated 229 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:16.419435 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41e8f4-25a8-4b13-8fb9-0b3f926526f9 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:16.434476 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41e8f4-25a8-4b13-8fb9-0b3f926526f9 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:16.439232 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1b2242-77c9-4509-b840-6439cc32232f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:16.439938 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b2242-77c9-4509-b840-6439cc32232f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:16.440218 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b2242-77c9-4509-b840-6439cc32232f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:16.440488 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1b2242-77c9-4509-b840-6439cc32232f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:16.441338 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b2242-77c9-4509-b840-6439cc32232f admin admin] RBAC: Adding query filter params (group.id=4de3a5ea358741999811ca02e72a29fc, role.id=f28d3f93a0524078a592a15459808378, scope.project.id=fe31d02174b84ed29a89c0315c571a54) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:16.441653 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b2242-77c9-4509-b840-6439cc32232f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:16.443602 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1b2242-77c9-4509-b840-6439cc32232f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:16.449970 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 140/277] 10.222.0.41 () {56 vars in 1397 bytes} [Fri Oct 29 16:01:16 2021] GET /identity/v3/role_assignments?group.id=4de3a5ea358741999811ca02e72a29fc&scope.project.id=fe31d02174b84ed29a89c0315c571a54&role.id=f28d3f93a0524078a592a15459808378 => generated 260 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:17.434681 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeefff2-9515-47da-893c-db829e9b7021 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:17.435628 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeefff2-9515-47da-893c-db829e9b7021 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:17.435628 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeefff2-9515-47da-893c-db829e9b7021 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:17.437331 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 138/278] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:17.444876 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acd9a4-97e7-48e7-8b16-a618e580dbfa None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:17.445697 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acd9a4-97e7-48e7-8b16-a618e580dbfa None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:17.445697 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4acd9a4-97e7-48e7-8b16-a618e580dbfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:17.467887 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-d4acd9a4-97e7-48e7-8b16-a618e580dbfa None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:17.469118 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-d4acd9a4-97e7-48e7-8b16-a618e580dbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:17.481292 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 141/279] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:17.529634 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeefff2-9515-47da-893c-db829e9b7021 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:17.548405 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeefff2-9515-47da-893c-db829e9b7021 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:17.553351 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacbcc0-803d-45d9-8f33-0956eabefedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:17.554174 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacbcc0-803d-45d9-8f33-0956eabefedd admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:17.554446 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacbcc0-803d-45d9-8f33-0956eabefedd admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:17.554717 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bacbcc0-803d-45d9-8f33-0956eabefedd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:17.570138 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bacbcc0-803d-45d9-8f33-0956eabefedd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:17.577238 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-3bacbcc0-803d-45d9-8f33-0956eabefedd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 16:01:17.578842 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 139/280] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:17 2021] GET /identity/v3/roles/member => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:17.585527 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acd9a4-97e7-48e7-8b16-a618e580dbfa None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:17.594851 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4acd9a4-97e7-48e7-8b16-a618e580dbfa None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:17.602377 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc808c07-241b-407c-a2bc-7ca5485d2412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:17.603081 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc808c07-241b-407c-a2bc-7ca5485d2412 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:17.603361 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc808c07-241b-407c-a2bc-7ca5485d2412 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:17.603635 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc808c07-241b-407c-a2bc-7ca5485d2412 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:17.604438 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc808c07-241b-407c-a2bc-7ca5485d2412 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:17.604741 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc808c07-241b-407c-a2bc-7ca5485d2412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:17.606459 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc808c07-241b-407c-a2bc-7ca5485d2412 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:17.616419 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 142/281] 10.222.0.41 () {56 vars in 1122 bytes} [Fri Oct 29 16:01:17 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:17.623327 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacbcc0-803d-45d9-8f33-0956eabefedd admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:17.691823 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b22c5-8cf2-4242-a2fe-cd42873adf00 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:17.692168 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b22c5-8cf2-4242-a2fe-cd42873adf00 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:17.692377 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b22c5-8cf2-4242-a2fe-cd42873adf00 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:17.694252 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 143/282] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:17.725247 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a2abe-b97c-482d-bc1b-d52bc41b67ee None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:17.725604 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a2abe-b97c-482d-bc1b-d52bc41b67ee None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:17.725792 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a2abe-b97c-482d-bc1b-d52bc41b67ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:17.758634 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bacbcc0-803d-45d9-8f33-0956eabefedd admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:17.762280 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-5c8a2abe-b97c-482d-bc1b-d52bc41b67ee None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:17.763387 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-5c8a2abe-b97c-482d-bc1b-d52bc41b67ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:17.765838 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30de9c9-eb54-41b7-92a6-4cc5263d2472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:17.766725 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30de9c9-eb54-41b7-92a6-4cc5263d2472 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:17.767077 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30de9c9-eb54-41b7-92a6-4cc5263d2472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:17.767305 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30de9c9-eb54-41b7-92a6-4cc5263d2472 admin admin] PATH_INFO: `/v3/groups/7289a3abf364422c8122972158203336` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:17.769233 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30de9c9-eb54-41b7-92a6-4cc5263d2472 admin admin] RBAC: Authorizing `identity:get_group(group_id=7289a3abf364422c8122972158203336)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:17.771182 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30de9c9-eb54-41b7-92a6-4cc5263d2472 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:17.773062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 140/283] 10.222.0.41 () {56 vars in 1201 bytes} [Fri Oct 29 16:01:17 2021] GET /identity/v3/groups/7289a3abf364422c8122972158203336 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:17.774154 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222147d-a84f-4011-a16c-85b8e82f0efd None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:17.774436 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222147d-a84f-4011-a16c-85b8e82f0efd None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:17.774710 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222147d-a84f-4011-a16c-85b8e82f0efd None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:17.776571 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 141/284] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:17.782766 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55a2f0-38cb-48f4-a899-c3080981fd45 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:17.783042 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55a2f0-38cb-48f4-a899-c3080981fd45 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:17.783410 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55a2f0-38cb-48f4-a899-c3080981fd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:17.787997 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 144/285] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:17.788862 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a2abe-b97c-482d-bc1b-d52bc41b67ee None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:17.805384 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a2abe-b97c-482d-bc1b-d52bc41b67ee None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:17.816630 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-9a55a2f0-38cb-48f4-a899-c3080981fd45 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:17.818436 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-9a55a2f0-38cb-48f4-a899-c3080981fd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:17.821275 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8444c0-5207-488d-883b-a6f5ba770869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:17.822170 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8444c0-5207-488d-883b-a6f5ba770869 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:17.822999 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8444c0-5207-488d-883b-a6f5ba770869 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:17.823282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8444c0-5207-488d-883b-a6f5ba770869 admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:17.824945 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8444c0-5207-488d-883b-a6f5ba770869 admin admin] RBAC: Authorizing `identity:get_project(project_id=77d119a645a14cd79d87aae94a06ec80)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:17.827309 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8444c0-5207-488d-883b-a6f5ba770869 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:17.829011 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 145/286] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:17 2021] GET /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:17.829776 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8444c0-5207-488d-883b-a6f5ba770869 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:17.833272 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 142/287] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:17.842006 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55a2f0-38cb-48f4-a899-c3080981fd45 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:17.844446 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8444c0-5207-488d-883b-a6f5ba770869 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:17.848892 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55a2f0-38cb-48f4-a899-c3080981fd45 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:17.856298 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369c887-0e03-4a64-9eb5-082f1eda6ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:17.857134 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795765f9-e5b3-40e8-9be4-612df297d503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:17.857259 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369c887-0e03-4a64-9eb5-082f1eda6ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:17.857498 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369c887-0e03-4a64-9eb5-082f1eda6ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:17.857768 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369c887-0e03-4a64-9eb5-082f1eda6ce6 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:17.858093 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795765f9-e5b3-40e8-9be4-612df297d503 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:17.858373 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795765f9-e5b3-40e8-9be4-612df297d503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:17.858644 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795765f9-e5b3-40e8-9be4-612df297d503 admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80/groups/7289a3abf364422c8122972158203336/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:17.861779 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795765f9-e5b3-40e8-9be4-612df297d503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d119a645a14cd79d87aae94a06ec80, group_id=7289a3abf364422c8122972158203336, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:17.864702 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795765f9-e5b3-40e8-9be4-612df297d503 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:17.875638 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369c887-0e03-4a64-9eb5-082f1eda6ce6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:17.885369 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 143/288] 10.222.0.41 () {58 vars in 1463 bytes} [Fri Oct 29 16:01:17 2021] PUT /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80/groups/7289a3abf364422c8122972158203336/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:01:17.889150 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-7369c887-0e03-4a64-9eb5-082f1eda6ce6 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 16:01:17.890672 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 146/289] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:01:17 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:17.891140 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795765f9-e5b3-40e8-9be4-612df297d503 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:17.898330 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369c887-0e03-4a64-9eb5-082f1eda6ce6 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:17.909769 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369c887-0e03-4a64-9eb5-082f1eda6ce6 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:17.980709 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c444a2a-91b0-4703-8e6c-8220e91e33eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:17.981323 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c444a2a-91b0-4703-8e6c-8220e91e33eb admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:17.981679 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c444a2a-91b0-4703-8e6c-8220e91e33eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:17.982157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c444a2a-91b0-4703-8e6c-8220e91e33eb admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:17.983112 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c444a2a-91b0-4703-8e6c-8220e91e33eb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:17.983418 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c444a2a-91b0-4703-8e6c-8220e91e33eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:17.985055 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c444a2a-91b0-4703-8e6c-8220e91e33eb admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:18.006295 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 147/290] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:17 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:18.009479 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c444a2a-91b0-4703-8e6c-8220e91e33eb admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:18.015147 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795765f9-e5b3-40e8-9be4-612df297d503 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:18.022927 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6a1b4-21e8-4875-b687-5e2cc0ce7bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:18.023732 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6a1b4-21e8-4875-b687-5e2cc0ce7bda admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:18.024012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6a1b4-21e8-4875-b687-5e2cc0ce7bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:18.024134 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c444a2a-91b0-4703-8e6c-8220e91e33eb admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:18.024310 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab6a1b4-21e8-4875-b687-5e2cc0ce7bda admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:18.040595 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf283083-f433-4634-a221-81d6cc846512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:18.043930 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf283083-f433-4634-a221-81d6cc846512 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:18.044265 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf283083-f433-4634-a221-81d6cc846512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:18.044482 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf283083-f433-4634-a221-81d6cc846512 admin admin] PATH_INFO: `/v3/groups/7289a3abf364422c8122972158203336` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:18.046771 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab6a1b4-21e8-4875-b687-5e2cc0ce7bda admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:18.049975 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf283083-f433-4634-a221-81d6cc846512 admin admin] RBAC: Authorizing `identity:get_group(group_id=7289a3abf364422c8122972158203336)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:18.055596 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf283083-f433-4634-a221-81d6cc846512 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:18.058429 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 148/291] 10.222.0.41 () {56 vars in 1201 bytes} [Fri Oct 29 16:01:18 2021] GET /identity/v3/groups/7289a3abf364422c8122972158203336 => generated 226 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:18.060978 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-6ab6a1b4-21e8-4875-b687-5e2cc0ce7bda admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 16:01:18.062655 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 144/292] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:17 2021] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:18.069478 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf283083-f433-4634-a221-81d6cc846512 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:18.070710 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6a1b4-21e8-4875-b687-5e2cc0ce7bda admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:18.089831 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf283083-f433-4634-a221-81d6cc846512 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:18.095099 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab6a1b4-21e8-4875-b687-5e2cc0ce7bda admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:18.099526 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46893af-cb3d-4d26-8b89-f9aa917daf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:18.100259 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46893af-cb3d-4d26-8b89-f9aa917daf54 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:18.100537 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46893af-cb3d-4d26-8b89-f9aa917daf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:18.100810 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46893af-cb3d-4d26-8b89-f9aa917daf54 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:18.101042 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a2a5f-939b-45cf-9224-80074ad345cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:18.101591 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46893af-cb3d-4d26-8b89-f9aa917daf54 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:18.101901 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46893af-cb3d-4d26-8b89-f9aa917daf54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:18.102100 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2a5f-939b-45cf-9224-80074ad345cd admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:18.102341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2a5f-939b-45cf-9224-80074ad345cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:18.102603 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a2a5f-939b-45cf-9224-80074ad345cd admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:18.103561 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46893af-cb3d-4d26-8b89-f9aa917daf54 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:18.103959 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a2a5f-939b-45cf-9224-80074ad345cd admin admin] RBAC: Authorizing `identity:get_project(project_id=77d119a645a14cd79d87aae94a06ec80)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:18.109682 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a2a5f-939b-45cf-9224-80074ad345cd admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:18.112684 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 145/293] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:18 2021] GET /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80 => generated 298 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:18.120174 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a2a5f-939b-45cf-9224-80074ad345cd admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:18.122631 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 149/294] 10.222.0.41 () {56 vars in 1122 bytes} [Fri Oct 29 16:01:18 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:18.129272 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46893af-cb3d-4d26-8b89-f9aa917daf54 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:18.142437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a2a5f-939b-45cf-9224-80074ad345cd admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:18.145382 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46893af-cb3d-4d26-8b89-f9aa917daf54 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:18.152345 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db1118-6dd7-4568-844b-6f233c67d2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:18.153379 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db1118-6dd7-4568-844b-6f233c67d2a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:18.153654 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db1118-6dd7-4568-844b-6f233c67d2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:18.153945 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db1118-6dd7-4568-844b-6f233c67d2a9 admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80/groups/7289a3abf364422c8122972158203336/roles/8eba80d4381a47ffb74df6e1f9dda34a` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:18.156743 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98957c0-957c-46e2-a7d0-cb04b6261dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:18.157805 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98957c0-957c-46e2-a7d0-cb04b6261dbe admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:18.158107 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98957c0-957c-46e2-a7d0-cb04b6261dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:18.158423 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98957c0-957c-46e2-a7d0-cb04b6261dbe admin admin] PATH_INFO: `/v3/groups/7289a3abf364422c8122972158203336` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:18.161389 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98957c0-957c-46e2-a7d0-cb04b6261dbe admin admin] RBAC: Authorizing `identity:get_group(group_id=7289a3abf364422c8122972158203336)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:18.162052 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db1118-6dd7-4568-844b-6f233c67d2a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d119a645a14cd79d87aae94a06ec80, group_id=7289a3abf364422c8122972158203336, role_id=8eba80d4381a47ffb74df6e1f9dda34a)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:18.165599 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98957c0-957c-46e2-a7d0-cb04b6261dbe admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:18.167243 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db1118-6dd7-4568-844b-6f233c67d2a9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:18.171153 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 150/295] 10.222.0.41 () {56 vars in 1201 bytes} [Fri Oct 29 16:01:18 2021] GET /identity/v3/groups/7289a3abf364422c8122972158203336 => generated 226 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:18.183202 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98957c0-957c-46e2-a7d0-cb04b6261dbe admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:18.194582 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 146/296] 10.222.0.41 () {58 vars in 1463 bytes} [Fri Oct 29 16:01:18 2021] PUT /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80/groups/7289a3abf364422c8122972158203336/roles/8eba80d4381a47ffb74df6e1f9dda34a => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:01:18.204619 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98957c0-957c-46e2-a7d0-cb04b6261dbe admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:18.307673 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d9b713-d9c5-475e-be42-2a690f0c696e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:18.308472 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9b713-d9c5-475e-be42-2a690f0c696e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:18.308752 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9b713-d9c5-475e-be42-2a690f0c696e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:18.309024 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d9b713-d9c5-475e-be42-2a690f0c696e admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:18.310361 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9b713-d9c5-475e-be42-2a690f0c696e admin admin] RBAC: Authorizing `identity:get_project(project_id=98d7e030a12e408899c86d19f869ade2)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:18.312450 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d9b713-d9c5-475e-be42-2a690f0c696e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:18.314515 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 151/297] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:18 2021] GET /identity/v3/projects/98d7e030a12e408899c86d19f869ade2 => generated 302 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:18.321585 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db1118-6dd7-4568-844b-6f233c67d2a9 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:18.338329 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db1118-6dd7-4568-844b-6f233c67d2a9 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:18.347267 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd0de7-94f0-45a3-8967-b9086f96ee37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:18.348635 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd0de7-94f0-45a3-8967-b9086f96ee37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:18.349164 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd0de7-94f0-45a3-8967-b9086f96ee37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:18.349661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd0de7-94f0-45a3-8967-b9086f96ee37 admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2/groups/7289a3abf364422c8122972158203336/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:18.352350 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd0de7-94f0-45a3-8967-b9086f96ee37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d7e030a12e408899c86d19f869ade2, group_id=7289a3abf364422c8122972158203336, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:18.355573 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd0de7-94f0-45a3-8967-b9086f96ee37 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:18.371812 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 147/298] 10.222.0.41 () {58 vars in 1463 bytes} [Fri Oct 29 16:01:18 2021] PUT /identity/v3/projects/98d7e030a12e408899c86d19f869ade2/groups/7289a3abf364422c8122972158203336/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:01:19.395294 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc514c5-e4c6-49bd-aa4c-123077b8d406 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:19.396023 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc514c5-e4c6-49bd-aa4c-123077b8d406 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:19.396023 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc514c5-e4c6-49bd-aa4c-123077b8d406 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:19.397785 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 152/299] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:19 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:19.404691 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f3642-c597-4f8e-89a6-d54355a4bfea None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:19.405327 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f3642-c597-4f8e-89a6-d54355a4bfea None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:19.405327 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f3642-c597-4f8e-89a6-d54355a4bfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:19.431040 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-624f3642-c597-4f8e-89a6-d54355a4bfea None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:19.432462 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-624f3642-c597-4f8e-89a6-d54355a4bfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:19.508549 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 148/300] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:19 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:19.573295 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc514c5-e4c6-49bd-aa4c-123077b8d406 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:19.606955 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc514c5-e4c6-49bd-aa4c-123077b8d406 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:19.614872 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca7ccb-3f68-4b02-a887-e373e0451e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:19.616544 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca7ccb-3f68-4b02-a887-e373e0451e79 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:19.617236 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca7ccb-3f68-4b02-a887-e373e0451e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:19.618000 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca7ccb-3f68-4b02-a887-e373e0451e79 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:19.647529 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca7ccb-3f68-4b02-a887-e373e0451e79 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:19.659515 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-b8ca7ccb-3f68-4b02-a887-e373e0451e79 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 16:01:19.666468 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 153/301] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:01:19 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:19.671931 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f3642-c597-4f8e-89a6-d54355a4bfea None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:19.692730 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f3642-c597-4f8e-89a6-d54355a4bfea None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:19.706748 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0e9b4-ddb7-43f1-9e7a-6759da809863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:19.707443 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0e9b4-ddb7-43f1-9e7a-6759da809863 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:19.707722 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0e9b4-ddb7-43f1-9e7a-6759da809863 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:19.707988 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0e9b4-ddb7-43f1-9e7a-6759da809863 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:19.708779 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0e9b4-ddb7-43f1-9e7a-6759da809863 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:19.709081 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0e9b4-ddb7-43f1-9e7a-6759da809863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:19.710778 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0e9b4-ddb7-43f1-9e7a-6759da809863 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:19.720490 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 149/302] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:19 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:19.731673 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca7ccb-3f68-4b02-a887-e373e0451e79 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:19.759158 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca7ccb-3f68-4b02-a887-e373e0451e79 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:19.782386 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2aaf3-d61c-4f1f-bfa3-77bf4f263401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:19.784638 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2aaf3-d61c-4f1f-bfa3-77bf4f263401 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:19.785327 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2aaf3-d61c-4f1f-bfa3-77bf4f263401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:19.786010 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c2aaf3-d61c-4f1f-bfa3-77bf4f263401 admin admin] PATH_INFO: `/v3/groups/7289a3abf364422c8122972158203336` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:19.788204 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2aaf3-d61c-4f1f-bfa3-77bf4f263401 admin admin] RBAC: Authorizing `identity:get_group(group_id=7289a3abf364422c8122972158203336)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:19.791591 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c2aaf3-d61c-4f1f-bfa3-77bf4f263401 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:19.794994 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 154/303] 10.222.0.41 () {56 vars in 1201 bytes} [Fri Oct 29 16:01:19 2021] GET /identity/v3/groups/7289a3abf364422c8122972158203336 => generated 226 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:19.804136 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0e9b4-ddb7-43f1-9e7a-6759da809863 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:19.818628 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0e9b4-ddb7-43f1-9e7a-6759da809863 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:19.826727 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda8c7e-818f-4163-b93a-d959e61ac567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:19.828656 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda8c7e-818f-4163-b93a-d959e61ac567 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:19.829428 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda8c7e-818f-4163-b93a-d959e61ac567 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:19.830773 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda8c7e-818f-4163-b93a-d959e61ac567 admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:19.833372 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda8c7e-818f-4163-b93a-d959e61ac567 admin admin] RBAC: Authorizing `identity:get_project(project_id=98d7e030a12e408899c86d19f869ade2)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:19.837663 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda8c7e-818f-4163-b93a-d959e61ac567 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:19.841731 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 150/304] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:19 2021] GET /identity/v3/projects/98d7e030a12e408899c86d19f869ade2 => generated 302 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:19.853510 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2aaf3-d61c-4f1f-bfa3-77bf4f263401 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:19.871006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c2aaf3-d61c-4f1f-bfa3-77bf4f263401 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:19.879521 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c9f98-44ff-4457-8fc2-4975d0db1c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:19.881563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c9f98-44ff-4457-8fc2-4975d0db1c7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:19.882442 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c9f98-44ff-4457-8fc2-4975d0db1c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:19.883264 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c9f98-44ff-4457-8fc2-4975d0db1c7f admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2/groups/7289a3abf364422c8122972158203336/roles/8eba80d4381a47ffb74df6e1f9dda34a` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:19.887895 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c9f98-44ff-4457-8fc2-4975d0db1c7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=98d7e030a12e408899c86d19f869ade2, group_id=7289a3abf364422c8122972158203336, role_id=8eba80d4381a47ffb74df6e1f9dda34a)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:19.894395 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c9f98-44ff-4457-8fc2-4975d0db1c7f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:19.925441 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 155/305] 10.222.0.41 () {58 vars in 1463 bytes} [Fri Oct 29 16:01:19 2021] PUT /identity/v3/projects/98d7e030a12e408899c86d19f869ade2/groups/7289a3abf364422c8122972158203336/roles/8eba80d4381a47ffb74df6e1f9dda34a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:01:20.047749 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3b2ad-1c46-4877-9570-0e0a40319928 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:20.048797 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3b2ad-1c46-4877-9570-0e0a40319928 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:20.050076 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3b2ad-1c46-4877-9570-0e0a40319928 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:20.054170 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 151/306] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:20 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:20.061171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe63e5-2b5d-4b0e-aacc-ca2e6865931d None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:20.062079 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe63e5-2b5d-4b0e-aacc-ca2e6865931d None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:20.062767 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe63e5-2b5d-4b0e-aacc-ca2e6865931d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:20.098627 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-62fe63e5-2b5d-4b0e-aacc-ca2e6865931d None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:20.100992 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-62fe63e5-2b5d-4b0e-aacc-ca2e6865931d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:20.195831 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 156/307] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:20.224390 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3b2ad-1c46-4877-9570-0e0a40319928 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:20.238228 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3b2ad-1c46-4877-9570-0e0a40319928 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:20.242907 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72107ff3-64f9-4225-879b-95285ae82077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:20.243840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72107ff3-64f9-4225-879b-95285ae82077 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:20.244065 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72107ff3-64f9-4225-879b-95285ae82077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:20.244342 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72107ff3-64f9-4225-879b-95285ae82077 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:20.257809 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72107ff3-64f9-4225-879b-95285ae82077 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:20.265251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-72107ff3-64f9-4225-879b-95285ae82077 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:01:20.268872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 152/308] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:20.277268 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe63e5-2b5d-4b0e-aacc-ca2e6865931d None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:20.288428 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe63e5-2b5d-4b0e-aacc-ca2e6865931d None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:20.294334 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83a2bf-2ced-4083-8cca-24926c90b0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:20.295030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83a2bf-2ced-4083-8cca-24926c90b0c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:20.295309 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83a2bf-2ced-4083-8cca-24926c90b0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:20.295575 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83a2bf-2ced-4083-8cca-24926c90b0c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:20.296353 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83a2bf-2ced-4083-8cca-24926c90b0c8 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:20.296663 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83a2bf-2ced-4083-8cca-24926c90b0c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:20.298372 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83a2bf-2ced-4083-8cca-24926c90b0c8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:20.310770 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 157/309] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:20.317794 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72107ff3-64f9-4225-879b-95285ae82077 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:20.336960 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72107ff3-64f9-4225-879b-95285ae82077 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:20.343955 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9543485-9bd2-4ddf-86df-1a0e770005f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:20.345691 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9543485-9bd2-4ddf-86df-1a0e770005f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:20.346782 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9543485-9bd2-4ddf-86df-1a0e770005f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:20.347235 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9543485-9bd2-4ddf-86df-1a0e770005f4 admin admin] PATH_INFO: `/v3/groups/4de3a5ea358741999811ca02e72a29fc` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:20.350995 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9543485-9bd2-4ddf-86df-1a0e770005f4 admin admin] RBAC: Authorizing `identity:get_group(group_id=4de3a5ea358741999811ca02e72a29fc)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:20.353899 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9543485-9bd2-4ddf-86df-1a0e770005f4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:20.356126 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 153/310] 10.222.0.41 () {56 vars in 1201 bytes} [Fri Oct 29 16:01:20 2021] GET /identity/v3/groups/4de3a5ea358741999811ca02e72a29fc => generated 229 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:20.363604 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83a2bf-2ced-4083-8cca-24926c90b0c8 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:20.379881 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83a2bf-2ced-4083-8cca-24926c90b0c8 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:20.390074 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c8771-7094-4b10-9bcd-55cba9afc926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:20.390958 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c8771-7094-4b10-9bcd-55cba9afc926 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:20.391234 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c8771-7094-4b10-9bcd-55cba9afc926 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:20.391502 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c8771-7094-4b10-9bcd-55cba9afc926 admin admin] PATH_INFO: `/v3/projects/fe31d02174b84ed29a89c0315c571a54` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:20.398975 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c8771-7094-4b10-9bcd-55cba9afc926 admin admin] RBAC: Authorizing `identity:get_project(project_id=fe31d02174b84ed29a89c0315c571a54)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:20.400833 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c8771-7094-4b10-9bcd-55cba9afc926 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:20.402961 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 158/311] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:20 2021] GET /identity/v3/projects/fe31d02174b84ed29a89c0315c571a54 => generated 344 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:20.410540 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9543485-9bd2-4ddf-86df-1a0e770005f4 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:20.424425 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9543485-9bd2-4ddf-86df-1a0e770005f4 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:20.432429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e67fd78-2dc5-4bd8-9be5-4dfbe1344673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:20.433780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67fd78-2dc5-4bd8-9be5-4dfbe1344673 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:20.434452 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67fd78-2dc5-4bd8-9be5-4dfbe1344673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:20.435174 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e67fd78-2dc5-4bd8-9be5-4dfbe1344673 admin admin] PATH_INFO: `/v3/projects/fe31d02174b84ed29a89c0315c571a54/groups/4de3a5ea358741999811ca02e72a29fc/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:20.443991 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67fd78-2dc5-4bd8-9be5-4dfbe1344673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe31d02174b84ed29a89c0315c571a54, group_id=4de3a5ea358741999811ca02e72a29fc, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:20.447582 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e67fd78-2dc5-4bd8-9be5-4dfbe1344673 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:20.479362 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 154/312] 10.222.0.41 () {58 vars in 1463 bytes} [Fri Oct 29 16:01:20 2021] PUT /identity/v3/projects/fe31d02174b84ed29a89c0315c571a54/groups/4de3a5ea358741999811ca02e72a29fc/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:01:21.110008 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3c5ca-d9f7-492b-a629-f7dec70ece49 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.110868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3c5ca-d9f7-492b-a629-f7dec70ece49 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.111402 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d3c5ca-d9f7-492b-a629-f7dec70ece49 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.113585 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 159/313] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:21 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:21.120493 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bea2f-5ac7-451b-9747-654ef0cd14b6 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.121100 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bea2f-5ac7-451b-9747-654ef0cd14b6 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.121604 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670bea2f-5ac7-451b-9747-654ef0cd14b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.147165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-670bea2f-5ac7-451b-9747-654ef0cd14b6 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:21.148431 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-670bea2f-5ac7-451b-9747-654ef0cd14b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:21.226000 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 155/314] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:21.248389 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9fb9e-327b-48d7-9cb4-64f2a906c828 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.248712 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9fb9e-327b-48d7-9cb4-64f2a906c828 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.248938 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9fb9e-327b-48d7-9cb4-64f2a906c828 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.250834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 160/315] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:21.257343 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8474f4b-e569-4acd-b96d-4dadd71b585d None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.257618 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8474f4b-e569-4acd-b96d-4dadd71b585d None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.257899 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8474f4b-e569-4acd-b96d-4dadd71b585d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.275393 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9fb9e-327b-48d7-9cb4-64f2a906c828 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:21.277363 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-e8474f4b-e569-4acd-b96d-4dadd71b585d None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:21.280355 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e8474f4b-e569-4acd-b96d-4dadd71b585d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:21.287367 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 156/316] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:21.300093 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9fb9e-327b-48d7-9cb4-64f2a906c828 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:21.306901 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623c3b7-37d2-4832-b3ac-4d63174dbd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:21.307744 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623c3b7-37d2-4832-b3ac-4d63174dbd97 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.308020 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623c3b7-37d2-4832-b3ac-4d63174dbd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.308300 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2623c3b7-37d2-4832-b3ac-4d63174dbd97 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.327945 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2623c3b7-37d2-4832-b3ac-4d63174dbd97 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:21.336268 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-2623c3b7-37d2-4832-b3ac-4d63174dbd97 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 16:01:21.337742 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 161/317] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:01:21 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:21.341226 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8474f4b-e569-4acd-b96d-4dadd71b585d None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:21.349197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623c3b7-37d2-4832-b3ac-4d63174dbd97 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:21.351865 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8474f4b-e569-4acd-b96d-4dadd71b585d None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:21.362763 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230516ff-14a2-4e16-840c-2519a52d0ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:21.363486 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230516ff-14a2-4e16-840c-2519a52d0ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.363765 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230516ff-14a2-4e16-840c-2519a52d0ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.364036 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230516ff-14a2-4e16-840c-2519a52d0ec4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.372287 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2623c3b7-37d2-4832-b3ac-4d63174dbd97 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:21.382652 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230516ff-14a2-4e16-840c-2519a52d0ec4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:21.389762 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-230516ff-14a2-4e16-840c-2519a52d0ec4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 16:01:21.390676 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f6f9b-c019-4950-8081-1cc6941c1584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:21.391351 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f6f9b-c019-4950-8081-1cc6941c1584 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.391632 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f6f9b-c019-4950-8081-1cc6941c1584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.391900 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5f6f9b-c019-4950-8081-1cc6941c1584 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.393245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f6f9b-c019-4950-8081-1cc6941c1584 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:21.393547 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f6f9b-c019-4950-8081-1cc6941c1584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:21.395197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5f6f9b-c019-4950-8081-1cc6941c1584 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:21.398673 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 157/318] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:21 2021] GET /identity/v3/roles/member => generated 84 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:21.406696 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 162/319] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:21 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:21.409425 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230516ff-14a2-4e16-840c-2519a52d0ec4 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:21.414763 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f6f9b-c019-4950-8081-1cc6941c1584 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:21.419743 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230516ff-14a2-4e16-840c-2519a52d0ec4 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:21.424274 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e5682-19b5-44fe-b35a-c9145f28ab6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:21.424939 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e5682-19b5-44fe-b35a-c9145f28ab6b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.425219 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e5682-19b5-44fe-b35a-c9145f28ab6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.425490 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e5682-19b5-44fe-b35a-c9145f28ab6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.430417 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e5682-19b5-44fe-b35a-c9145f28ab6b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:21.430732 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e5682-19b5-44fe-b35a-c9145f28ab6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:21.432370 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e5682-19b5-44fe-b35a-c9145f28ab6b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:21.435006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5f6f9b-c019-4950-8081-1cc6941c1584 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:21.449367 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403cddd-c817-451f-8952-00a710d5d0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:21.450752 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403cddd-c817-451f-8952-00a710d5d0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.451046 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403cddd-c817-451f-8952-00a710d5d0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.451368 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a403cddd-c817-451f-8952-00a710d5d0e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.456678 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 158/320] 10.222.0.41 () {56 vars in 1122 bytes} [Fri Oct 29 16:01:21 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:21.462922 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e5682-19b5-44fe-b35a-c9145f28ab6b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:21.471030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403cddd-c817-451f-8952-00a710d5d0e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:21.474250 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a403cddd-c817-451f-8952-00a710d5d0e6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:21.476769 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e5682-19b5-44fe-b35a-c9145f28ab6b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:21.489255 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd26ee-1a91-484b-a16c-5ab3038a539c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:21.490034 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd26ee-1a91-484b-a16c-5ab3038a539c admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.490316 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd26ee-1a91-484b-a16c-5ab3038a539c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.490587 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd26ee-1a91-484b-a16c-5ab3038a539c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.494257 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 163/321] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:21 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:01:21.500833 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403cddd-c817-451f-8952-00a710d5d0e6 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:21.509056 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd26ee-1a91-484b-a16c-5ab3038a539c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:21.511953 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd26ee-1a91-484b-a16c-5ab3038a539c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:21.516911 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a403cddd-c817-451f-8952-00a710d5d0e6 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:21.523433 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cd5da-4f1f-4793-8665-5ccb40dfac5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:21.524611 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cd5da-4f1f-4793-8665-5ccb40dfac5a admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.526015 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cd5da-4f1f-4793-8665-5ccb40dfac5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.526302 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5cd5da-4f1f-4793-8665-5ccb40dfac5a admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.529407 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5cd5da-4f1f-4793-8665-5ccb40dfac5a admin admin] RBAC: Authorizing `identity:get_project(project_id=77d119a645a14cd79d87aae94a06ec80)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:21.532493 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 159/322] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:21 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:01:21.533305 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5cd5da-4f1f-4793-8665-5ccb40dfac5a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:21.535776 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 164/323] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:21 2021] GET /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:21.538745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd26ee-1a91-484b-a16c-5ab3038a539c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:21.542162 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cd5da-4f1f-4793-8665-5ccb40dfac5a admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:21.556402 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd26ee-1a91-484b-a16c-5ab3038a539c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:21.562485 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5cd5da-4f1f-4793-8665-5ccb40dfac5a admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:21.569462 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d19ed-b94d-40a8-a1a3-bf3af85eb93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:21.571626 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d19ed-b94d-40a8-a1a3-bf3af85eb93c admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.572517 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d19ed-b94d-40a8-a1a3-bf3af85eb93c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.572888 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2d19ed-b94d-40a8-a1a3-bf3af85eb93c admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.575918 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb67869-e9e4-4aa8-926b-3e43b2e0e975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:21.576998 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d19ed-b94d-40a8-a1a3-bf3af85eb93c admin admin] RBAC: Authorizing `identity:get_project(project_id=77d119a645a14cd79d87aae94a06ec80)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:21.578585 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb67869-e9e4-4aa8-926b-3e43b2e0e975 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.578865 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb67869-e9e4-4aa8-926b-3e43b2e0e975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.579134 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb67869-e9e4-4aa8-926b-3e43b2e0e975 admin admin] PATH_INFO: `/v3/groups/7289a3abf364422c8122972158203336` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.582110 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2d19ed-b94d-40a8-a1a3-bf3af85eb93c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:21.584544 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb67869-e9e4-4aa8-926b-3e43b2e0e975 admin admin] RBAC: Authorizing `identity:get_group(group_id=7289a3abf364422c8122972158203336)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:21.587925 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb67869-e9e4-4aa8-926b-3e43b2e0e975 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:21.589432 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 160/324] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:21 2021] GET /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80 => generated 298 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:21.590069 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 165/325] 10.222.0.41 () {56 vars in 1201 bytes} [Fri Oct 29 16:01:21 2021] GET /identity/v3/groups/7289a3abf364422c8122972158203336 => generated 226 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:21.599103 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d19ed-b94d-40a8-a1a3-bf3af85eb93c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:21.600977 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb67869-e9e4-4aa8-926b-3e43b2e0e975 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:21.610779 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2d19ed-b94d-40a8-a1a3-bf3af85eb93c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:21.615922 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a270eb7-a4f0-4944-8892-ff9dd6b22afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:21.616771 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a270eb7-a4f0-4944-8892-ff9dd6b22afd admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.617050 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a270eb7-a4f0-4944-8892-ff9dd6b22afd admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.617526 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a270eb7-a4f0-4944-8892-ff9dd6b22afd admin admin] PATH_INFO: `/v3/groups/7289a3abf364422c8122972158203336` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.619012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a270eb7-a4f0-4944-8892-ff9dd6b22afd admin admin] RBAC: Authorizing `identity:get_group(group_id=7289a3abf364422c8122972158203336)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:21.621255 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a270eb7-a4f0-4944-8892-ff9dd6b22afd admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:21.623737 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 161/326] 10.222.0.41 () {56 vars in 1201 bytes} [Fri Oct 29 16:01:21 2021] GET /identity/v3/groups/7289a3abf364422c8122972158203336 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:21.629040 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb67869-e9e4-4aa8-926b-3e43b2e0e975 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:21.631305 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a270eb7-a4f0-4944-8892-ff9dd6b22afd admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:21.645652 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a270eb7-a4f0-4944-8892-ff9dd6b22afd admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:21.646451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67db7e7-c000-4303-a59e-e1fb9b99929c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:21.647132 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67db7e7-c000-4303-a59e-e1fb9b99929c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.647464 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67db7e7-c000-4303-a59e-e1fb9b99929c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.647739 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67db7e7-c000-4303-a59e-e1fb9b99929c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.650866 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67db7e7-c000-4303-a59e-e1fb9b99929c admin admin] RBAC: Adding query filter params (group.id=7289a3abf364422c8122972158203336, role.id=8eba80d4381a47ffb74df6e1f9dda34a, scope.project.id=77d119a645a14cd79d87aae94a06ec80) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:21.651189 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67db7e7-c000-4303-a59e-e1fb9b99929c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:21.658666 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67db7e7-c000-4303-a59e-e1fb9b99929c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:21.660789 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57207d1-8b66-4531-9cc2-3d5e90c2f107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:21.661468 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57207d1-8b66-4531-9cc2-3d5e90c2f107 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.663000 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57207d1-8b66-4531-9cc2-3d5e90c2f107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.663327 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57207d1-8b66-4531-9cc2-3d5e90c2f107 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.664985 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57207d1-8b66-4531-9cc2-3d5e90c2f107 admin admin] RBAC: Adding query filter params (group.id=7289a3abf364422c8122972158203336, role.id=4a1afb6391114961afeec5c1d72563f0, scope.project.id=77d119a645a14cd79d87aae94a06ec80) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:21.665303 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57207d1-8b66-4531-9cc2-3d5e90c2f107 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:21.669620 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57207d1-8b66-4531-9cc2-3d5e90c2f107 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:21.674583 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 166/327] 10.222.0.41 () {56 vars in 1397 bytes} [Fri Oct 29 16:01:21 2021] GET /identity/v3/role_assignments?group.id=7289a3abf364422c8122972158203336&scope.project.id=77d119a645a14cd79d87aae94a06ec80&role.id=8eba80d4381a47ffb74df6e1f9dda34a => generated 611 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:21.680969 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 162/328] 10.222.0.41 () {56 vars in 1397 bytes} [Fri Oct 29 16:01:21 2021] GET /identity/v3/role_assignments?group.id=7289a3abf364422c8122972158203336&scope.project.id=77d119a645a14cd79d87aae94a06ec80&role.id=4a1afb6391114961afeec5c1d72563f0 => generated 611 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:21.806710 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3388a24-0604-43c5-83a9-fff3d44a24c9 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.807053 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3388a24-0604-43c5-83a9-fff3d44a24c9 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.807261 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3388a24-0604-43c5-83a9-fff3d44a24c9 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.809391 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 167/329] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:21.816545 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82fff0-c022-43a1-ab5a-eb0bc9987eb4 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.816884 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82fff0-c022-43a1-ab5a-eb0bc9987eb4 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.817109 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82fff0-c022-43a1-ab5a-eb0bc9987eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.836702 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-bc82fff0-c022-43a1-ab5a-eb0bc9987eb4 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:21.837989 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-bc82fff0-c022-43a1-ab5a-eb0bc9987eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:21.846776 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 163/330] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:21.872244 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3388a24-0604-43c5-83a9-fff3d44a24c9 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:21.888368 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3388a24-0604-43c5-83a9-fff3d44a24c9 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:21.894652 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85eff24-2950-42ec-8411-93c788a21d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:21.895545 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eff24-2950-42ec-8411-93c788a21d92 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.895827 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eff24-2950-42ec-8411-93c788a21d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.896098 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eff24-2950-42ec-8411-93c788a21d92 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.914307 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85eff24-2950-42ec-8411-93c788a21d92 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:21.921440 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-a85eff24-2950-42ec-8411-93c788a21d92 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 29 16:01:21.923248 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 168/331] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:21 2021] GET /identity/v3/roles/member => generated 84 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:21.930195 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82fff0-c022-43a1-ab5a-eb0bc9987eb4 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:21.949989 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82fff0-c022-43a1-ab5a-eb0bc9987eb4 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:21.958560 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da0221-091f-4560-800f-af0759a64b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:21.959255 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da0221-091f-4560-800f-af0759a64b17 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:21.959535 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da0221-091f-4560-800f-af0759a64b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:21.959809 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20da0221-091f-4560-800f-af0759a64b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:21.960600 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da0221-091f-4560-800f-af0759a64b17 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:21.960905 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da0221-091f-4560-800f-af0759a64b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:21.962601 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20da0221-091f-4560-800f-af0759a64b17 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:21.979122 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 164/332] 10.222.0.41 () {56 vars in 1122 bytes} [Fri Oct 29 16:01:21 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:21.985826 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85eff24-2950-42ec-8411-93c788a21d92 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:22.006767 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85eff24-2950-42ec-8411-93c788a21d92 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:22.020301 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edeb6d5-5965-4a77-9062-e4591df37597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:22.021481 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edeb6d5-5965-4a77-9062-e4591df37597 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:22.022009 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edeb6d5-5965-4a77-9062-e4591df37597 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:22.022506 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edeb6d5-5965-4a77-9062-e4591df37597 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:22.034049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edeb6d5-5965-4a77-9062-e4591df37597 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:22.035839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edeb6d5-5965-4a77-9062-e4591df37597 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:22.046435 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 169/333] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:21 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:22.053298 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da0221-091f-4560-800f-af0759a64b17 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:22.066054 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20da0221-091f-4560-800f-af0759a64b17 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:22.074083 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769e3ba-8b17-40c2-8227-e4a835a741ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:22.075021 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769e3ba-8b17-40c2-8227-e4a835a741ac admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:22.075305 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769e3ba-8b17-40c2-8227-e4a835a741ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:22.075846 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769e3ba-8b17-40c2-8227-e4a835a741ac admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:22.077284 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769e3ba-8b17-40c2-8227-e4a835a741ac admin admin] RBAC: Authorizing `identity:get_project(project_id=98d7e030a12e408899c86d19f869ade2)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:22.079572 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769e3ba-8b17-40c2-8227-e4a835a741ac admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:22.081737 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 165/334] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:22 2021] GET /identity/v3/projects/98d7e030a12e408899c86d19f869ade2 => generated 302 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:22.088025 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edeb6d5-5965-4a77-9062-e4591df37597 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:22.098806 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edeb6d5-5965-4a77-9062-e4591df37597 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:22.107591 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5b776-c137-4451-bb0c-1bdc4e23c8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:22.108901 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5b776-c137-4451-bb0c-1bdc4e23c8f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:22.109375 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5b776-c137-4451-bb0c-1bdc4e23c8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:22.109857 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5b776-c137-4451-bb0c-1bdc4e23c8f9 admin admin] PATH_INFO: `/v3/groups/7289a3abf364422c8122972158203336` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:22.112137 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5b776-c137-4451-bb0c-1bdc4e23c8f9 admin admin] RBAC: Authorizing `identity:get_group(group_id=7289a3abf364422c8122972158203336)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:22.114444 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5b776-c137-4451-bb0c-1bdc4e23c8f9 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:22.116607 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 170/335] 10.222.0.41 () {56 vars in 1201 bytes} [Fri Oct 29 16:01:22 2021] GET /identity/v3/groups/7289a3abf364422c8122972158203336 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:22.123646 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769e3ba-8b17-40c2-8227-e4a835a741ac admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:22.135872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769e3ba-8b17-40c2-8227-e4a835a741ac admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:22.144851 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955e5023-7c7f-44c0-a803-357ac0bcf710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:22.145530 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e5023-7c7f-44c0-a803-357ac0bcf710 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:22.145813 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e5023-7c7f-44c0-a803-357ac0bcf710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:22.146213 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955e5023-7c7f-44c0-a803-357ac0bcf710 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:22.147075 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e5023-7c7f-44c0-a803-357ac0bcf710 admin admin] RBAC: Adding query filter params (group.id=7289a3abf364422c8122972158203336, role.id=4a1afb6391114961afeec5c1d72563f0, scope.project.id=98d7e030a12e408899c86d19f869ade2) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:22.147440 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e5023-7c7f-44c0-a803-357ac0bcf710 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:22.149392 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955e5023-7c7f-44c0-a803-357ac0bcf710 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:22.157896 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 166/336] 10.222.0.41 () {56 vars in 1397 bytes} [Fri Oct 29 16:01:22 2021] GET /identity/v3/role_assignments?group.id=7289a3abf364422c8122972158203336&scope.project.id=98d7e030a12e408899c86d19f869ade2&role.id=4a1afb6391114961afeec5c1d72563f0 => generated 611 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:22.825959 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f382ee5-9800-4c21-9596-fca2a2d22fd6 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:22.826505 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f382ee5-9800-4c21-9596-fca2a2d22fd6 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:22.826505 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f382ee5-9800-4c21-9596-fca2a2d22fd6 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:22.828295 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 171/337] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:22.835174 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30e6a1-df37-4527-8962-107b3e41e9be None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:22.835627 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30e6a1-df37-4527-8962-107b3e41e9be None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:22.835846 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c30e6a1-df37-4527-8962-107b3e41e9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:22.854666 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-5c30e6a1-df37-4527-8962-107b3e41e9be None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:22.855829 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-5c30e6a1-df37-4527-8962-107b3e41e9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:22.863949 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 167/338] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:22.888601 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f382ee5-9800-4c21-9596-fca2a2d22fd6 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:22.902113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f382ee5-9800-4c21-9596-fca2a2d22fd6 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:22.906384 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b541d5-344e-4476-9f56-a5c03117ecdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:22.907164 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b541d5-344e-4476-9f56-a5c03117ecdf admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:22.907438 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b541d5-344e-4476-9f56-a5c03117ecdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:22.907702 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b541d5-344e-4476-9f56-a5c03117ecdf admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:22.917893 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b541d5-344e-4476-9f56-a5c03117ecdf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:22.925447 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-b5b541d5-344e-4476-9f56-a5c03117ecdf admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 16:01:22.926659 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 172/339] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:01:22 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:22.934897 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30e6a1-df37-4527-8962-107b3e41e9be None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:22.948688 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c30e6a1-df37-4527-8962-107b3e41e9be None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:22.953594 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f60950-7bf0-4a81-ad14-0903f33c424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:22.954301 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f60950-7bf0-4a81-ad14-0903f33c424e admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:22.954581 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f60950-7bf0-4a81-ad14-0903f33c424e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:22.954861 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f60950-7bf0-4a81-ad14-0903f33c424e admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:22.956202 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f60950-7bf0-4a81-ad14-0903f33c424e admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:22.956507 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f60950-7bf0-4a81-ad14-0903f33c424e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:22.958178 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f60950-7bf0-4a81-ad14-0903f33c424e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:22.966667 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 168/340] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:22 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:22.973406 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b541d5-344e-4476-9f56-a5c03117ecdf admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:22.984310 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b541d5-344e-4476-9f56-a5c03117ecdf admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:22.989454 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49165b11-3038-4f59-983b-53e70ec025ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:22.990472 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49165b11-3038-4f59-983b-53e70ec025ac admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:22.990852 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49165b11-3038-4f59-983b-53e70ec025ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:22.991264 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49165b11-3038-4f59-983b-53e70ec025ac admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:23.000996 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49165b11-3038-4f59-983b-53e70ec025ac admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:23.003409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49165b11-3038-4f59-983b-53e70ec025ac admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:23.012738 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 173/341] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:23.019919 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f60950-7bf0-4a81-ad14-0903f33c424e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:23.029902 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f60950-7bf0-4a81-ad14-0903f33c424e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:23.034440 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316e936-27d9-430f-beb8-09e3dac7afc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:23.035271 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316e936-27d9-430f-beb8-09e3dac7afc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:23.035542 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316e936-27d9-430f-beb8-09e3dac7afc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:23.035858 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316e936-27d9-430f-beb8-09e3dac7afc5 admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:23.037013 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316e936-27d9-430f-beb8-09e3dac7afc5 admin admin] RBAC: Authorizing `identity:get_project(project_id=98d7e030a12e408899c86d19f869ade2)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:23.039281 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316e936-27d9-430f-beb8-09e3dac7afc5 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:23.040951 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 169/342] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:23 2021] GET /identity/v3/projects/98d7e030a12e408899c86d19f869ade2 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:23.047214 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49165b11-3038-4f59-983b-53e70ec025ac admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:23.056789 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49165b11-3038-4f59-983b-53e70ec025ac admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:23.061641 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc967a-e6c2-4354-b709-94503ef0202d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:23.062527 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc967a-e6c2-4354-b709-94503ef0202d admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:23.062803 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc967a-e6c2-4354-b709-94503ef0202d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:23.063070 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc967a-e6c2-4354-b709-94503ef0202d admin admin] PATH_INFO: `/v3/groups/7289a3abf364422c8122972158203336` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:23.064759 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc967a-e6c2-4354-b709-94503ef0202d admin admin] RBAC: Authorizing `identity:get_group(group_id=7289a3abf364422c8122972158203336)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:23.066696 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc967a-e6c2-4354-b709-94503ef0202d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:23.068524 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 174/343] 10.222.0.41 () {56 vars in 1201 bytes} [Fri Oct 29 16:01:23 2021] GET /identity/v3/groups/7289a3abf364422c8122972158203336 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:23.074778 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316e936-27d9-430f-beb8-09e3dac7afc5 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:23.085345 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316e936-27d9-430f-beb8-09e3dac7afc5 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:23.089706 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65accd1-e73f-4843-8431-6b8d368ea033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:23.090449 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65accd1-e73f-4843-8431-6b8d368ea033 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:23.090799 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65accd1-e73f-4843-8431-6b8d368ea033 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:23.091082 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65accd1-e73f-4843-8431-6b8d368ea033 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:23.091931 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65accd1-e73f-4843-8431-6b8d368ea033 admin admin] RBAC: Adding query filter params (group.id=7289a3abf364422c8122972158203336, role.id=8eba80d4381a47ffb74df6e1f9dda34a, scope.project.id=98d7e030a12e408899c86d19f869ade2) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:23.092243 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65accd1-e73f-4843-8431-6b8d368ea033 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:23.094091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65accd1-e73f-4843-8431-6b8d368ea033 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:23.100139 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 170/344] 10.222.0.41 () {56 vars in 1397 bytes} [Fri Oct 29 16:01:23 2021] GET /identity/v3/role_assignments?group.id=7289a3abf364422c8122972158203336&scope.project.id=98d7e030a12e408899c86d19f869ade2&role.id=8eba80d4381a47ffb74df6e1f9dda34a => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:23.386049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae439888-a6d9-471b-9200-1c0ed519b512 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:23.386340 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae439888-a6d9-471b-9200-1c0ed519b512 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:23.386621 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae439888-a6d9-471b-9200-1c0ed519b512 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:23.388417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 175/345] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:23.394547 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d95f2b-1f22-4375-8678-a724e9e2b64b None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:23.394837 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d95f2b-1f22-4375-8678-a724e9e2b64b None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:23.395112 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d95f2b-1f22-4375-8678-a724e9e2b64b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:23.413249 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-91d95f2b-1f22-4375-8678-a724e9e2b64b None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:23.414502 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-91d95f2b-1f22-4375-8678-a724e9e2b64b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:23.422874 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 171/346] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:23.447879 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae439888-a6d9-471b-9200-1c0ed519b512 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:23.460535 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae439888-a6d9-471b-9200-1c0ed519b512 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:23.464865 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea556d-436e-4b94-a2fb-20e87010aaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:23.465652 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea556d-436e-4b94-a2fb-20e87010aaf9 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:23.466005 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea556d-436e-4b94-a2fb-20e87010aaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:23.466237 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea556d-436e-4b94-a2fb-20e87010aaf9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:23.476753 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea556d-436e-4b94-a2fb-20e87010aaf9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:23.483637 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-9dea556d-436e-4b94-a2fb-20e87010aaf9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:01:23.484816 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 176/347] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:23.492003 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d95f2b-1f22-4375-8678-a724e9e2b64b None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:23.502801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d95f2b-1f22-4375-8678-a724e9e2b64b None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:23.508765 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294c0c8-7049-41da-9435-e91f4449446f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:23.509451 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294c0c8-7049-41da-9435-e91f4449446f admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:23.509729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294c0c8-7049-41da-9435-e91f4449446f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:23.510028 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294c0c8-7049-41da-9435-e91f4449446f admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:23.510922 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294c0c8-7049-41da-9435-e91f4449446f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:23.511226 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294c0c8-7049-41da-9435-e91f4449446f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:23.512817 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294c0c8-7049-41da-9435-e91f4449446f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:23.523477 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 172/348] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:23.529779 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea556d-436e-4b94-a2fb-20e87010aaf9 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:23.540848 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea556d-436e-4b94-a2fb-20e87010aaf9 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:23.545151 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5fb85-16a2-4a97-ab83-6052468c4b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:23.545780 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5fb85-16a2-4a97-ab83-6052468c4b08 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:23.546095 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5fb85-16a2-4a97-ab83-6052468c4b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:23.546366 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca5fb85-16a2-4a97-ab83-6052468c4b08 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:23.554837 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5fb85-16a2-4a97-ab83-6052468c4b08 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:23.556570 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca5fb85-16a2-4a97-ab83-6052468c4b08 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:23.566801 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 177/349] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:23.573047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294c0c8-7049-41da-9435-e91f4449446f admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:23.582766 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294c0c8-7049-41da-9435-e91f4449446f admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:23.586960 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4dbee-c0fa-45f7-91df-6e0014b318fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:23.587782 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4dbee-c0fa-45f7-91df-6e0014b318fd admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:23.588061 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4dbee-c0fa-45f7-91df-6e0014b318fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:23.588333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4dbee-c0fa-45f7-91df-6e0014b318fd admin admin] PATH_INFO: `/v3/projects/fe31d02174b84ed29a89c0315c571a54` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:23.589509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4dbee-c0fa-45f7-91df-6e0014b318fd admin admin] RBAC: Authorizing `identity:get_project(project_id=fe31d02174b84ed29a89c0315c571a54)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:23.591322 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4dbee-c0fa-45f7-91df-6e0014b318fd admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:23.592945 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 173/350] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:01:23 2021] GET /identity/v3/projects/fe31d02174b84ed29a89c0315c571a54 => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:23.599159 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5fb85-16a2-4a97-ab83-6052468c4b08 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:23.608059 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca5fb85-16a2-4a97-ab83-6052468c4b08 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:23.613068 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78377201-2d28-40c6-9468-5d66c0b1a65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:23.613896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78377201-2d28-40c6-9468-5d66c0b1a65d admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:23.614197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78377201-2d28-40c6-9468-5d66c0b1a65d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:23.614463 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78377201-2d28-40c6-9468-5d66c0b1a65d admin admin] PATH_INFO: `/v3/groups/4de3a5ea358741999811ca02e72a29fc` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:23.615629 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78377201-2d28-40c6-9468-5d66c0b1a65d admin admin] RBAC: Authorizing `identity:get_group(group_id=4de3a5ea358741999811ca02e72a29fc)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:23.617485 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78377201-2d28-40c6-9468-5d66c0b1a65d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:23.619057 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 178/351] 10.222.0.41 () {56 vars in 1201 bytes} [Fri Oct 29 16:01:23 2021] GET /identity/v3/groups/4de3a5ea358741999811ca02e72a29fc => generated 229 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:23.625517 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4dbee-c0fa-45f7-91df-6e0014b318fd admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:23.635951 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4dbee-c0fa-45f7-91df-6e0014b318fd admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:23.640471 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d537a6f8-31e4-4c11-a087-8c176fdbac9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:23.641055 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537a6f8-31e4-4c11-a087-8c176fdbac9a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:23.641334 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537a6f8-31e4-4c11-a087-8c176fdbac9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:23.641610 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d537a6f8-31e4-4c11-a087-8c176fdbac9a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:23.642489 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537a6f8-31e4-4c11-a087-8c176fdbac9a admin admin] RBAC: Adding query filter params (group.id=4de3a5ea358741999811ca02e72a29fc, role.id=f28d3f93a0524078a592a15459808378, scope.project.id=fe31d02174b84ed29a89c0315c571a54) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:23.642799 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537a6f8-31e4-4c11-a087-8c176fdbac9a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:23.644636 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d537a6f8-31e4-4c11-a087-8c176fdbac9a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:23.651047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 174/352] 10.222.0.41 () {56 vars in 1397 bytes} [Fri Oct 29 16:01:23 2021] GET /identity/v3/role_assignments?group.id=4de3a5ea358741999811ca02e72a29fc&scope.project.id=fe31d02174b84ed29a89c0315c571a54&role.id=f28d3f93a0524078a592a15459808378 => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:26.504739 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b30a9-6bc4-4cb2-ad9f-832a419858e6 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:26.506135 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b30a9-6bc4-4cb2-ad9f-832a419858e6 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:26.506799 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69b30a9-6bc4-4cb2-ad9f-832a419858e6 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:26.509512 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 179/353] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:26 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:26.524565 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec14305-3923-48cd-9e49-fff23d383cc2 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:26.525049 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec14305-3923-48cd-9e49-fff23d383cc2 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:26.525125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec14305-3923-48cd-9e49-fff23d383cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:26.550952 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-eec14305-3923-48cd-9e49-fff23d383cc2 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:26.552158 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-eec14305-3923-48cd-9e49-fff23d383cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:26.560399 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 175/354] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:26.610143 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b30a9-6bc4-4cb2-ad9f-832a419858e6 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:26.627628 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69b30a9-6bc4-4cb2-ad9f-832a419858e6 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:26.637788 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98622317-61ff-4034-9382-50388cc76a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:26.639017 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98622317-61ff-4034-9382-50388cc76a68 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:26.639508 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98622317-61ff-4034-9382-50388cc76a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:26.639991 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98622317-61ff-4034-9382-50388cc76a68 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:26.658548 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98622317-61ff-4034-9382-50388cc76a68 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:26.660853 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98622317-61ff-4034-9382-50388cc76a68 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:26.685030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-98622317-61ff-4034-9382-50388cc76a68 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:26.687684 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 180/355] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:26.693015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec14305-3923-48cd-9e49-fff23d383cc2 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:26.707123 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec14305-3923-48cd-9e49-fff23d383cc2 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:26.716489 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f1136a-67f5-4d4f-9de0-d7c6f908972a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:26.717160 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1136a-67f5-4d4f-9de0-d7c6f908972a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:26.717439 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1136a-67f5-4d4f-9de0-d7c6f908972a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:26.717710 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f1136a-67f5-4d4f-9de0-d7c6f908972a admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:26.718484 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1136a-67f5-4d4f-9de0-d7c6f908972a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:26.718784 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1136a-67f5-4d4f-9de0-d7c6f908972a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:26.720979 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f1136a-67f5-4d4f-9de0-d7c6f908972a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:26.739843 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 176/356] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:26.745860 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98622317-61ff-4034-9382-50388cc76a68 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:26.759414 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98622317-61ff-4034-9382-50388cc76a68 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:26.774667 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f79148-dc33-4189-9366-4a003a47c414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:26.775708 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f79148-dc33-4189-9366-4a003a47c414 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:26.776197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f79148-dc33-4189-9366-4a003a47c414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:26.776675 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f79148-dc33-4189-9366-4a003a47c414 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:26.777961 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f79148-dc33-4189-9366-4a003a47c414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:26.781941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f79148-dc33-4189-9366-4a003a47c414 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:26.812733 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 181/357] 10.222.0.41 () {60 vars in 1153 bytes} [Fri Oct 29 16:01:26 2021] POST /identity/v3/users => generated 246 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:01:26.819199 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615d560-4a98-4aa6-b7f0-efd00438249f None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:26.819835 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615d560-4a98-4aa6-b7f0-efd00438249f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:26.820322 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2615d560-4a98-4aa6-b7f0-efd00438249f None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:26.822764 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 177/358] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:26 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:26.832510 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a80c66-69ee-4c8a-b120-dc7eff7d957f None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:26.832801 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a80c66-69ee-4c8a-b120-dc7eff7d957f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:26.833244 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a80c66-69ee-4c8a-b120-dc7eff7d957f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:26.869630 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-38a80c66-69ee-4c8a-b120-dc7eff7d957f None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:26.871140 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-38a80c66-69ee-4c8a-b120-dc7eff7d957f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:26.880946 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 182/359] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:26.918120 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615d560-4a98-4aa6-b7f0-efd00438249f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:26.936373 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2615d560-4a98-4aa6-b7f0-efd00438249f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:26.945333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb859e4a-1b36-4b23-9b87-061cd4e641c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:26.946172 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb859e4a-1b36-4b23-9b87-061cd4e641c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:26.946453 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb859e4a-1b36-4b23-9b87-061cd4e641c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:26.946729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb859e4a-1b36-4b23-9b87-061cd4e641c4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:26.963220 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb859e4a-1b36-4b23-9b87-061cd4e641c4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:26.965088 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb859e4a-1b36-4b23-9b87-061cd4e641c4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:26.990552 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-eb859e4a-1b36-4b23-9b87-061cd4e641c4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:26.992147 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 178/360] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:26 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:26.998330 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a80c66-69ee-4c8a-b120-dc7eff7d957f None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:27.016631 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a80c66-69ee-4c8a-b120-dc7eff7d957f None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:27.028121 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e751e2-8cfb-40c7-bb6c-5726d630250f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:27.029161 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e751e2-8cfb-40c7-bb6c-5726d630250f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:27.029665 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e751e2-8cfb-40c7-bb6c-5726d630250f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:27.030163 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e751e2-8cfb-40c7-bb6c-5726d630250f admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:27.031126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e751e2-8cfb-40c7-bb6c-5726d630250f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:27.031660 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e751e2-8cfb-40c7-bb6c-5726d630250f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:27.032943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING py.warnings [None req-51e751e2-8cfb-40c7-bb6c-5726d630250f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:01:27.032943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: warnings.warn(msg) Oct 29 16:01:27.032943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: Oct 29 16:01:27.034234 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e751e2-8cfb-40c7-bb6c-5726d630250f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:27.062097 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 183/361] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:27.068940 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb859e4a-1b36-4b23-9b87-061cd4e641c4 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:27.081544 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb859e4a-1b36-4b23-9b87-061cd4e641c4 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:27.088919 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352dcb89-d269-4546-ad23-1d4980614ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:27.089590 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dcb89-d269-4546-ad23-1d4980614ecb admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:27.089868 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dcb89-d269-4546-ad23-1d4980614ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:27.090230 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352dcb89-d269-4546-ad23-1d4980614ecb admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:27.090966 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352dcb89-d269-4546-ad23-1d4980614ecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:27.092880 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352dcb89-d269-4546-ad23-1d4980614ecb admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:27.126429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 179/362] 10.222.0.41 () {60 vars in 1153 bytes} [Fri Oct 29 16:01:27 2021] POST /identity/v3/users => generated 248 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:01:27.389618 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294fcec-8de4-44c7-8c82-256a6394f5f8 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:27.390022 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294fcec-8de4-44c7-8c82-256a6394f5f8 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:27.390217 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b294fcec-8de4-44c7-8c82-256a6394f5f8 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:27.392001 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 184/363] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:27.399173 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf743e-3abe-45b1-a709-9f0a66e6fffb None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:27.399541 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf743e-3abe-45b1-a709-9f0a66e6fffb None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:27.399890 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edf743e-3abe-45b1-a709-9f0a66e6fffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:27.400328 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463a370-4752-4c56-ac44-a171dfcf4425 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:27.400615 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463a370-4752-4c56-ac44-a171dfcf4425 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:27.400896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c463a370-4752-4c56-ac44-a171dfcf4425 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:27.402739 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 185/364] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:01:27.409402 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb65912-4d29-4bce-b782-69b68e4f9c12 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:27.409763 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb65912-4d29-4bce-b782-69b68e4f9c12 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:27.410235 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb65912-4d29-4bce-b782-69b68e4f9c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:27.424744 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-0edf743e-3abe-45b1-a709-9f0a66e6fffb None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:27.425970 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-0edf743e-3abe-45b1-a709-9f0a66e6fffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:27.429472 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-5cb65912-4d29-4bce-b782-69b68e4f9c12 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:27.430919 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-5cb65912-4d29-4bce-b782-69b68e4f9c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:27.434285 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 180/365] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:27.444637 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 186/366] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:27.462200 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf743e-3abe-45b1-a709-9f0a66e6fffb None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:27.472806 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb65912-4d29-4bce-b782-69b68e4f9c12 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:27.474768 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edf743e-3abe-45b1-a709-9f0a66e6fffb None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:27.483712 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e2154-d123-4b5b-b43a-5b889ab0f8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:27.484521 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e2154-d123-4b5b-b43a-5b889ab0f8cf admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:27.484807 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e2154-d123-4b5b-b43a-5b889ab0f8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:27.485083 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e2154-d123-4b5b-b43a-5b889ab0f8cf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:27.487301 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb65912-4d29-4bce-b782-69b68e4f9c12 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:27.496165 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b1efc-b23b-4aab-beff-ada2c782d6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:27.497311 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b1efc-b23b-4aab-beff-ada2c782d6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:27.497796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b1efc-b23b-4aab-beff-ada2c782d6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:27.498308 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b1efc-b23b-4aab-beff-ada2c782d6f8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:27.500140 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e2154-d123-4b5b-b43a-5b889ab0f8cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:27.501708 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e2154-d123-4b5b-b43a-5b889ab0f8cf admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:27.512081 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b1efc-b23b-4aab-beff-ada2c782d6f8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:27.514624 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663b1efc-b23b-4aab-beff-ada2c782d6f8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:27.523535 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-fd0e2154-d123-4b5b-b43a-5b889ab0f8cf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:27.525128 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 181/367] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:27.531116 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e2154-d123-4b5b-b43a-5b889ab0f8cf admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:27.540858 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-663b1efc-b23b-4aab-beff-ada2c782d6f8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:27.542458 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 187/368] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:27.542665 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e2154-d123-4b5b-b43a-5b889ab0f8cf admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:27.549137 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b1efc-b23b-4aab-beff-ada2c782d6f8 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:27.549535 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474fe27-2206-44f6-bcd2-3dcd1a088ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:27.550325 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474fe27-2206-44f6-bcd2-3dcd1a088ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:27.550658 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474fe27-2206-44f6-bcd2-3dcd1a088ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:27.550929 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474fe27-2206-44f6-bcd2-3dcd1a088ca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:27.551820 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474fe27-2206-44f6-bcd2-3dcd1a088ca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:27.552121 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474fe27-2206-44f6-bcd2-3dcd1a088ca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:27.553871 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474fe27-2206-44f6-bcd2-3dcd1a088ca6 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:27.569951 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663b1efc-b23b-4aab-beff-ada2c782d6f8 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:27.577042 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 182/369] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:27.578545 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6796e-bd15-40f9-b3ae-194f6e6913e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:27.579270 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6796e-bd15-40f9-b3ae-194f6e6913e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:27.579637 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6796e-bd15-40f9-b3ae-194f6e6913e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:27.579993 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6796e-bd15-40f9-b3ae-194f6e6913e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:27.580740 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6796e-bd15-40f9-b3ae-194f6e6913e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:27.581089 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6796e-bd15-40f9-b3ae-194f6e6913e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:27.582778 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6796e-bd15-40f9-b3ae-194f6e6913e5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:27.585630 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474fe27-2206-44f6-bcd2-3dcd1a088ca6 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:27.601795 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474fe27-2206-44f6-bcd2-3dcd1a088ca6 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:27.604597 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 188/370] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:27.611865 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6796e-bd15-40f9-b3ae-194f6e6913e5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:27.620116 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac06d1e-47f5-4eb5-b93b-502a73080e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:27.620794 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac06d1e-47f5-4eb5-b93b-502a73080e80 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:27.621072 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac06d1e-47f5-4eb5-b93b-502a73080e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:27.621343 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac06d1e-47f5-4eb5-b93b-502a73080e80 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:27.622111 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac06d1e-47f5-4eb5-b93b-502a73080e80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:27.624019 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac06d1e-47f5-4eb5-b93b-502a73080e80 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:27.634921 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6796e-bd15-40f9-b3ae-194f6e6913e5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:27.641691 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c7aabd-6e2b-4893-8704-b4040b89118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:27.642450 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7aabd-6e2b-4893-8704-b4040b89118d admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:27.642795 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7aabd-6e2b-4893-8704-b4040b89118d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:27.643071 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c7aabd-6e2b-4893-8704-b4040b89118d admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:27.643855 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7aabd-6e2b-4893-8704-b4040b89118d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:27.645808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c7aabd-6e2b-4893-8704-b4040b89118d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:27.654467 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 183/371] 10.222.0.41 () {60 vars in 1153 bytes} [Fri Oct 29 16:01:27 2021] POST /identity/v3/users => generated 248 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:01:27.677431 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 189/372] 10.222.0.41 () {60 vars in 1153 bytes} [Fri Oct 29 16:01:27 2021] POST /identity/v3/users => generated 249 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:01:27.880586 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dfdd7-6b8e-4c0c-82fa-abb1b90e34ed None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:27.880982 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dfdd7-6b8e-4c0c-82fa-abb1b90e34ed None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:27.881144 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691dfdd7-6b8e-4c0c-82fa-abb1b90e34ed None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:27.883381 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 184/373] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:27.889565 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5379ed-166b-4131-be78-73e11fa7c817 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:27.889863 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5379ed-166b-4131-be78-73e11fa7c817 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:27.890153 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5379ed-166b-4131-be78-73e11fa7c817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:27.918516 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-2a5379ed-166b-4131-be78-73e11fa7c817 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:27.919379 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-2a5379ed-166b-4131-be78-73e11fa7c817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:27.929422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 190/374] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:27.952821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dfdd7-6b8e-4c0c-82fa-abb1b90e34ed None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:27.969638 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691dfdd7-6b8e-4c0c-82fa-abb1b90e34ed None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:27.976951 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8eb4c-f0f6-4dcd-94ad-c3e69b7f657c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:27.976951 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8eb4c-f0f6-4dcd-94ad-c3e69b7f657c admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:27.976951 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8eb4c-f0f6-4dcd-94ad-c3e69b7f657c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:27.977248 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8eb4c-f0f6-4dcd-94ad-c3e69b7f657c admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:27.977904 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8eb4c-f0f6-4dcd-94ad-c3e69b7f657c admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:27.979500 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8eb4c-f0f6-4dcd-94ad-c3e69b7f657c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:27.991353 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.sql.core [None req-e0d8eb4c-f0f6-4dcd-94ad-c3e69b7f657c admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 29 16:01:27.991353 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 29 16:01:27.991353 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [parameters: {'id': '7cb15c2213d04a0286c0804e564679b9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 29 16:01:27.991353 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79610) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 29 16:01:28.006995 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-e0d8eb4c-f0f6-4dcd-94ad-c3e69b7f657c admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 29 16:01:28.008587 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 185/375] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:01:27 2021] POST /identity/v3/roles => generated 144 bytes in 56 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:28.015025 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5379ed-166b-4131-be78-73e11fa7c817 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:28.028288 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5379ed-166b-4131-be78-73e11fa7c817 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:28.034635 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aef5c3-97aa-4707-9b8a-46c6a39d6b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:28.035694 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aef5c3-97aa-4707-9b8a-46c6a39d6b6b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:28.036201 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aef5c3-97aa-4707-9b8a-46c6a39d6b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:28.036644 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aef5c3-97aa-4707-9b8a-46c6a39d6b6b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:28.049296 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aef5c3-97aa-4707-9b8a-46c6a39d6b6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:28.057166 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-c9aef5c3-97aa-4707-9b8a-46c6a39d6b6b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 29 16:01:28.059008 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 191/376] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:01:28 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:28.064873 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8eb4c-f0f6-4dcd-94ad-c3e69b7f657c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:28.075681 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8eb4c-f0f6-4dcd-94ad-c3e69b7f657c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:28.080786 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154dacdc-9980-42ac-a894-aa25c6997c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:28.081454 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dacdc-9980-42ac-a894-aa25c6997c92 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:28.081732 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dacdc-9980-42ac-a894-aa25c6997c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:28.082031 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154dacdc-9980-42ac-a894-aa25c6997c92 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:28.082801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154dacdc-9980-42ac-a894-aa25c6997c92 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:28.083105 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154dacdc-9980-42ac-a894-aa25c6997c92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:28.084971 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154dacdc-9980-42ac-a894-aa25c6997c92 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:28.095126 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 186/377] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:28 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:29.979873 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f616e-f12c-4f36-9a00-6a0900c6f20f None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:29.980860 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f616e-f12c-4f36-9a00-6a0900c6f20f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:29.981463 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1f616e-f12c-4f36-9a00-6a0900c6f20f None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:29.983713 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 192/378] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:29 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:29.990513 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e86588-dff0-439e-a2f1-52c7a013d28b None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:29.990947 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e86588-dff0-439e-a2f1-52c7a013d28b None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:29.991128 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e86588-dff0-439e-a2f1-52c7a013d28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.018979 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-70e86588-dff0-439e-a2f1-52c7a013d28b None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:30.020211 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-70e86588-dff0-439e-a2f1-52c7a013d28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:30.028702 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 187/379] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:30.048204 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbabb15-a87b-47ec-94d4-e3de9c0af367 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.049026 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbabb15-a87b-47ec-94d4-e3de9c0af367 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.049295 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbabb15-a87b-47ec-94d4-e3de9c0af367 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.051248 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 193/380] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:30.057419 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4ca8b-0fea-43e8-9685-0ffcfc7e9022 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.057713 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4ca8b-0fea-43e8-9685-0ffcfc7e9022 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.058016 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac4ca8b-0fea-43e8-9685-0ffcfc7e9022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.058350 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbabb15-a87b-47ec-94d4-e3de9c0af367 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.078298 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbabb15-a87b-47ec-94d4-e3de9c0af367 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.079835 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-0ac4ca8b-0fea-43e8-9685-0ffcfc7e9022 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:30.081023 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-0ac4ca8b-0fea-43e8-9685-0ffcfc7e9022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:30.087256 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc455409-cdb1-45b2-90e8-779555ad0c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.088058 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455409-cdb1-45b2-90e8-779555ad0c14 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.088339 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455409-cdb1-45b2-90e8-779555ad0c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.088611 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc455409-cdb1-45b2-90e8-779555ad0c14 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.096623 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 188/381] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:30.113281 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc455409-cdb1-45b2-90e8-779555ad0c14 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:30.120347 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-dc455409-cdb1-45b2-90e8-779555ad0c14 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:01:30.121630 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 194/382] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:30.121760 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4ca8b-0fea-43e8-9685-0ffcfc7e9022 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.134989 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc455409-cdb1-45b2-90e8-779555ad0c14 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.136204 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac4ca8b-0fea-43e8-9685-0ffcfc7e9022 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.146797 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc455409-cdb1-45b2-90e8-779555ad0c14 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.147452 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495f3a4-8424-41bd-9983-a2d12d44e107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.148511 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495f3a4-8424-41bd-9983-a2d12d44e107 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.148992 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495f3a4-8424-41bd-9983-a2d12d44e107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.149466 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495f3a4-8424-41bd-9983-a2d12d44e107 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.152640 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0d1bb-b51a-48fb-8d02-70ab1789c80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.153300 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0d1bb-b51a-48fb-8d02-70ab1789c80b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.153584 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0d1bb-b51a-48fb-8d02-70ab1789c80b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.153861 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b0d1bb-b51a-48fb-8d02-70ab1789c80b admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.154668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0d1bb-b51a-48fb-8d02-70ab1789c80b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:30.154975 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0d1bb-b51a-48fb-8d02-70ab1789c80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.156579 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b0d1bb-b51a-48fb-8d02-70ab1789c80b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.170864 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1495f3a4-8424-41bd-9983-a2d12d44e107 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:30.178568 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-1495f3a4-8424-41bd-9983-a2d12d44e107 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:01:30.179791 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 189/383] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:30.181966 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 195/384] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:30.192610 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0d1bb-b51a-48fb-8d02-70ab1789c80b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.194681 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495f3a4-8424-41bd-9983-a2d12d44e107 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.207841 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b0d1bb-b51a-48fb-8d02-70ab1789c80b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.215222 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495f3a4-8424-41bd-9983-a2d12d44e107 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.216951 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bc6ed-4021-4c90-97c4-a8112b5a15b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.217632 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bc6ed-4021-4c90-97c4-a8112b5a15b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.217912 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bc6ed-4021-4c90-97c4-a8112b5a15b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.218207 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bc6ed-4021-4c90-97c4-a8112b5a15b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.218976 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bc6ed-4021-4c90-97c4-a8112b5a15b1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:30.219281 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bc6ed-4021-4c90-97c4-a8112b5a15b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.220937 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bc6ed-4021-4c90-97c4-a8112b5a15b1 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.229992 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206387fc-473f-4590-baf6-c5bfa5f7a7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.230785 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206387fc-473f-4590-baf6-c5bfa5f7a7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.231067 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206387fc-473f-4590-baf6-c5bfa5f7a7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.231341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206387fc-473f-4590-baf6-c5bfa5f7a7a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.237166 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 196/385] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:30.243933 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bc6ed-4021-4c90-97c4-a8112b5a15b1 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.256092 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206387fc-473f-4590-baf6-c5bfa5f7a7a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.258013 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206387fc-473f-4590-baf6-c5bfa5f7a7a0 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.262941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bc6ed-4021-4c90-97c4-a8112b5a15b1 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.275455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27116e47-f247-42cf-a261-4adee448ddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.276269 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27116e47-f247-42cf-a261-4adee448ddbe admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.276554 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27116e47-f247-42cf-a261-4adee448ddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.276836 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27116e47-f247-42cf-a261-4adee448ddbe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.285133 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-206387fc-473f-4590-baf6-c5bfa5f7a7a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:30.286641 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 190/386] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:30.292637 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206387fc-473f-4590-baf6-c5bfa5f7a7a0 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.301327 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27116e47-f247-42cf-a261-4adee448ddbe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.303232 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27116e47-f247-42cf-a261-4adee448ddbe admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.307248 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206387fc-473f-4590-baf6-c5bfa5f7a7a0 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.316978 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb141665-3900-42e5-a185-de6391fc7582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.319222 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb141665-3900-42e5-a185-de6391fc7582 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.319510 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb141665-3900-42e5-a185-de6391fc7582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.319785 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb141665-3900-42e5-a185-de6391fc7582 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.321666 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb141665-3900-42e5-a185-de6391fc7582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:30.321666 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb141665-3900-42e5-a185-de6391fc7582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.323668 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb141665-3900-42e5-a185-de6391fc7582 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.342160 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-27116e47-f247-42cf-a261-4adee448ddbe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:30.343392 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 197/387] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:30.354570 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 191/388] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:30.355698 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27116e47-f247-42cf-a261-4adee448ddbe admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.367142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27116e47-f247-42cf-a261-4adee448ddbe admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.372971 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb141665-3900-42e5-a185-de6391fc7582 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.384135 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb141665-3900-42e5-a185-de6391fc7582 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.386049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdad152-e0eb-44a8-a205-d1bd9fb1d7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.386829 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdad152-e0eb-44a8-a205-d1bd9fb1d7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.387113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdad152-e0eb-44a8-a205-d1bd9fb1d7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.387390 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdad152-e0eb-44a8-a205-d1bd9fb1d7b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.388537 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdad152-e0eb-44a8-a205-d1bd9fb1d7b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:30.389620 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdad152-e0eb-44a8-a205-d1bd9fb1d7b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.392357 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdad152-e0eb-44a8-a205-d1bd9fb1d7b2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.394367 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589d854-b2a8-4e9b-b9e9-fcf359820b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.396561 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589d854-b2a8-4e9b-b9e9-fcf359820b2b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.396850 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589d854-b2a8-4e9b-b9e9-fcf359820b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.397639 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0589d854-b2a8-4e9b-b9e9-fcf359820b2b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.416650 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589d854-b2a8-4e9b-b9e9-fcf359820b2b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.422266 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 198/389] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:30.423182 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0589d854-b2a8-4e9b-b9e9-fcf359820b2b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.426131 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdad152-e0eb-44a8-a205-d1bd9fb1d7b2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.442031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdad152-e0eb-44a8-a205-d1bd9fb1d7b2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.450123 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-0589d854-b2a8-4e9b-b9e9-fcf359820b2b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 16:01:30.451990 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 192/390] 10.222.0.41 () {56 vars in 1114 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/users/nova => generated 82 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:30.458205 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589d854-b2a8-4e9b-b9e9-fcf359820b2b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.463992 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b48b4b-6255-4d06-a549-e1046e3c7c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.464797 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b48b4b-6255-4d06-a549-e1046e3c7c4f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.465071 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b48b4b-6255-4d06-a549-e1046e3c7c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.465345 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b48b4b-6255-4d06-a549-e1046e3c7c4f admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.468914 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0589d854-b2a8-4e9b-b9e9-fcf359820b2b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.474501 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851218e-421f-49a3-b0c1-bf0c1917e341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.475183 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851218e-421f-49a3-b0c1-bf0c1917e341 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.475521 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851218e-421f-49a3-b0c1-bf0c1917e341 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.475796 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851218e-421f-49a3-b0c1-bf0c1917e341 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.476707 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851218e-421f-49a3-b0c1-bf0c1917e341 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:30.477017 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851218e-421f-49a3-b0c1-bf0c1917e341 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.478132 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING py.warnings [None req-4851218e-421f-49a3-b0c1-bf0c1917e341 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:01:30.478132 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: warnings.warn(msg) Oct 29 16:01:30.478132 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: Oct 29 16:01:30.479482 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851218e-421f-49a3-b0c1-bf0c1917e341 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.487788 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b48b4b-6255-4d06-a549-e1046e3c7c4f admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.491925 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b48b4b-6255-4d06-a549-e1046e3c7c4f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.517767 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-32b48b4b-6255-4d06-a549-e1046e3c7c4f admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 29 16:01:30.524047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 193/391] 10.222.0.41 () {56 vars in 1154 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:30.526003 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 199/392] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/users/glance => generated 84 bytes in 100 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:30.532603 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851218e-421f-49a3-b0c1-bf0c1917e341 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.540471 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b48b4b-6255-4d06-a549-e1046e3c7c4f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.544168 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851218e-421f-49a3-b0c1-bf0c1917e341 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.549709 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975f38f-8301-4fb7-948e-afa3ff08c8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.550585 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975f38f-8301-4fb7-948e-afa3ff08c8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.550919 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975f38f-8301-4fb7-948e-afa3ff08c8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.551199 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5975f38f-8301-4fb7-948e-afa3ff08c8d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.552085 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975f38f-8301-4fb7-948e-afa3ff08c8d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:30.552451 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975f38f-8301-4fb7-948e-afa3ff08c8d3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.552848 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b48b4b-6255-4d06-a549-e1046e3c7c4f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.554681 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5975f38f-8301-4fb7-948e-afa3ff08c8d3 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.558213 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a724f-3fc8-4fde-b584-60181f480077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.559181 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a724f-3fc8-4fde-b584-60181f480077 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.559682 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a724f-3fc8-4fde-b584-60181f480077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.560154 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a724f-3fc8-4fde-b584-60181f480077 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.570276 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a724f-3fc8-4fde-b584-60181f480077 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.573119 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a724f-3fc8-4fde-b584-60181f480077 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.575259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 194/393] 10.222.0.41 () {56 vars in 1158 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:30.584696 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975f38f-8301-4fb7-948e-afa3ff08c8d3 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.594571 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 200/394] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:01:30.599932 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a724f-3fc8-4fde-b584-60181f480077 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.607602 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5975f38f-8301-4fb7-948e-afa3ff08c8d3 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.612465 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a724f-3fc8-4fde-b584-60181f480077 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.623003 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26875e-8388-49c1-a0c5-24a28e68864c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.624635 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26875e-8388-49c1-a0c5-24a28e68864c admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.627059 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26875e-8388-49c1-a0c5-24a28e68864c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.628061 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f26875e-8388-49c1-a0c5-24a28e68864c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.628806 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de8d39-3ef1-42f1-86f1-9336a7657b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.630795 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de8d39-3ef1-42f1-86f1-9336a7657b58 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.631395 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de8d39-3ef1-42f1-86f1-9336a7657b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.632602 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de8d39-3ef1-42f1-86f1-9336a7657b58 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.647206 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26875e-8388-49c1-a0c5-24a28e68864c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.652700 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f26875e-8388-49c1-a0c5-24a28e68864c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.657273 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de8d39-3ef1-42f1-86f1-9336a7657b58 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.663700 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de8d39-3ef1-42f1-86f1-9336a7657b58 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.672545 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 195/395] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:01:30.692343 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-80de8d39-3ef1-42f1-86f1-9336a7657b58 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:30.695791 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 201/396] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 97 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:30.697039 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26875e-8388-49c1-a0c5-24a28e68864c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.709314 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de8d39-3ef1-42f1-86f1-9336a7657b58 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.711753 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f26875e-8388-49c1-a0c5-24a28e68864c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.717829 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2abacb-9ccc-4b2b-8e39-cf792df044ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.718911 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2abacb-9ccc-4b2b-8e39-cf792df044ef admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.719413 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2abacb-9ccc-4b2b-8e39-cf792df044ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.719517 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de8d39-3ef1-42f1-86f1-9336a7657b58 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.719981 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2abacb-9ccc-4b2b-8e39-cf792df044ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.724747 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8c2ec-2890-46ab-9e82-6fe7aec2c60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.725440 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8c2ec-2890-46ab-9e82-6fe7aec2c60c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.725722 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8c2ec-2890-46ab-9e82-6fe7aec2c60c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.726054 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8c2ec-2890-46ab-9e82-6fe7aec2c60c admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.726837 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8c2ec-2890-46ab-9e82-6fe7aec2c60c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:30.727192 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8c2ec-2890-46ab-9e82-6fe7aec2c60c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.728832 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8c2ec-2890-46ab-9e82-6fe7aec2c60c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.734109 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2abacb-9ccc-4b2b-8e39-cf792df044ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.737369 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2abacb-9ccc-4b2b-8e39-cf792df044ef admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.742311 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 202/397] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:30.748484 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bb05c-05a3-4a52-ae32-749ae18e0e48 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.748484 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bb05c-05a3-4a52-ae32-749ae18e0e48 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.748484 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bb05c-05a3-4a52-ae32-749ae18e0e48 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.748484 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 203/398] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:30.748484 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255bff9-a529-4fb8-9035-0e4ed3e9d530 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.748484 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255bff9-a529-4fb8-9035-0e4ed3e9d530 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.748905 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c255bff9-a529-4fb8-9035-0e4ed3e9d530 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.749170 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 204/399] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:30.749810 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255bff9-a529-4fb8-9035-0e4ed3e9d530 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.766078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-fe2abacb-9ccc-4b2b-8e39-cf792df044ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:30.766262 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c255bff9-a529-4fb8-9035-0e4ed3e9d530 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.766372 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 196/400] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:30.766372 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a9795-3357-4bf4-bdb4-21ee84af55cc None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.766688 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a9795-3357-4bf4-bdb4-21ee84af55cc None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.766942 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343a9795-3357-4bf4-bdb4-21ee84af55cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.772908 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cd7d3-d498-460a-ba7c-9164cfb7071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.772908 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cd7d3-d498-460a-ba7c-9164cfb7071e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.772908 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cd7d3-d498-460a-ba7c-9164cfb7071e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.772908 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cd7d3-d498-460a-ba7c-9164cfb7071e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.781518 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cd7d3-d498-460a-ba7c-9164cfb7071e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.786266 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cd7d3-d498-460a-ba7c-9164cfb7071e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.786913 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-343a9795-3357-4bf4-bdb4-21ee84af55cc None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:30.788083 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-343a9795-3357-4bf4-bdb4-21ee84af55cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:30.796154 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 197/401] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:30.803395 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74853a04-1520-46aa-af81-d8336034a0fb None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.803892 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74853a04-1520-46aa-af81-d8336034a0fb None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.804359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74853a04-1520-46aa-af81-d8336034a0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.808795 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-788cd7d3-d498-460a-ba7c-9164cfb7071e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:30.815073 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 205/402] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:30.815073 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cd7d3-d498-460a-ba7c-9164cfb7071e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.826769 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cd7d3-d498-460a-ba7c-9164cfb7071e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.828156 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-74853a04-1520-46aa-af81-d8336034a0fb None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:30.829283 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-74853a04-1520-46aa-af81-d8336034a0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:30.831985 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ceac9-d2b8-4599-80d3-2b77d1ae3b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.832907 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ceac9-d2b8-4599-80d3-2b77d1ae3b0f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.833132 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ceac9-d2b8-4599-80d3-2b77d1ae3b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.833420 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514ceac9-d2b8-4599-80d3-2b77d1ae3b0f admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.834275 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ceac9-d2b8-4599-80d3-2b77d1ae3b0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:30.834650 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ceac9-d2b8-4599-80d3-2b77d1ae3b0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.836256 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514ceac9-d2b8-4599-80d3-2b77d1ae3b0f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.842516 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 198/403] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:30.842516 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74853a04-1520-46aa-af81-d8336034a0fb None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.851194 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74853a04-1520-46aa-af81-d8336034a0fb None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.852987 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 206/404] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:30.854160 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ceac9-d2b8-4599-80d3-2b77d1ae3b0f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.861215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702305e-4d1d-47f4-a458-9ae1690b0706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.862146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702305e-4d1d-47f4-a458-9ae1690b0706 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.862561 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702305e-4d1d-47f4-a458-9ae1690b0706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.862816 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702305e-4d1d-47f4-a458-9ae1690b0706 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.863622 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702305e-4d1d-47f4-a458-9ae1690b0706 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:30.863976 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702305e-4d1d-47f4-a458-9ae1690b0706 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.865188 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING py.warnings [None req-a702305e-4d1d-47f4-a458-9ae1690b0706 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:01:30.865188 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: warnings.warn(msg) Oct 29 16:01:30.865188 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: Oct 29 16:01:30.865616 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514ceac9-d2b8-4599-80d3-2b77d1ae3b0f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.866513 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702305e-4d1d-47f4-a458-9ae1690b0706 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.870383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfaaa30-58d8-4e2b-a011-d60acebf1936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.871450 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfaaa30-58d8-4e2b-a011-d60acebf1936 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.871881 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfaaa30-58d8-4e2b-a011-d60acebf1936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.872352 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfaaa30-58d8-4e2b-a011-d60acebf1936 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.883780 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfaaa30-58d8-4e2b-a011-d60acebf1936 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:30.885431 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 199/405] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:30.886276 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702305e-4d1d-47f4-a458-9ae1690b0706 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.891732 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-acfaaa30-58d8-4e2b-a011-d60acebf1936 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:01:30.893612 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 207/406] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:30.899653 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfaaa30-58d8-4e2b-a011-d60acebf1936 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.899824 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702305e-4d1d-47f4-a458-9ae1690b0706 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.904234 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a03ca-51b4-44bb-8d65-920b0009cec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.904998 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a03ca-51b4-44bb-8d65-920b0009cec3 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.905277 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a03ca-51b4-44bb-8d65-920b0009cec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.905549 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a03ca-51b4-44bb-8d65-920b0009cec3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.910558 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfaaa30-58d8-4e2b-a011-d60acebf1936 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.913233 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a03ca-51b4-44bb-8d65-920b0009cec3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.915225 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a03ca-51b4-44bb-8d65-920b0009cec3 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.915325 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ab65f-76f2-483f-b0dd-b862024bfb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.916078 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ab65f-76f2-483f-b0dd-b862024bfb27 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.916361 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ab65f-76f2-483f-b0dd-b862024bfb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.916636 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ab65f-76f2-483f-b0dd-b862024bfb27 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.927187 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ab65f-76f2-483f-b0dd-b862024bfb27 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:30.928600 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-574a03ca-51b4-44bb-8d65-920b0009cec3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:30.930133 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 200/407] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:30.934395 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-d66ab65f-76f2-483f-b0dd-b862024bfb27 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:01:30.935138 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a03ca-51b4-44bb-8d65-920b0009cec3 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.938062 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 208/408] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:30.938062 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ab65f-76f2-483f-b0dd-b862024bfb27 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.947946 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ab65f-76f2-483f-b0dd-b862024bfb27 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.952988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba1c33-ff05-4795-9353-0ae42c502722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.953742 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba1c33-ff05-4795-9353-0ae42c502722 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.954066 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba1c33-ff05-4795-9353-0ae42c502722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.954347 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aba1c33-ff05-4795-9353-0ae42c502722 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.955788 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba1c33-ff05-4795-9353-0ae42c502722 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:30.956288 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba1c33-ff05-4795-9353-0ae42c502722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.957878 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aba1c33-ff05-4795-9353-0ae42c502722 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.961764 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a03ca-51b4-44bb-8d65-920b0009cec3 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.967660 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf86ba-f531-4b20-b07d-8fe1371f910d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.968341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf86ba-f531-4b20-b07d-8fe1371f910d admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.968624 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf86ba-f531-4b20-b07d-8fe1371f910d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.968904 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf86ba-f531-4b20-b07d-8fe1371f910d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.969782 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf86ba-f531-4b20-b07d-8fe1371f910d admin admin] RBAC: Adding query filter params (role.id=01b3b9b5c0d846968d6a5219373998f8, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=4f13d0e9f79a433c81759ecd819a6dfa) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:30.970119 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf86ba-f531-4b20-b07d-8fe1371f910d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.972602 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf86ba-f531-4b20-b07d-8fe1371f910d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:30.973014 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 209/409] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:30.974160 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba1c33-ff05-4795-9353-0ae42c502722 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.980329 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 201/410] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/role_assignments?user.id=4f13d0e9f79a433c81759ecd819a6dfa&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=01b3b9b5c0d846968d6a5219373998f8 => generated 259 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:30.981545 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf86ba-f531-4b20-b07d-8fe1371f910d admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:30.986660 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aba1c33-ff05-4795-9353-0ae42c502722 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.991993 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e80b0-9e7d-433f-92b4-2012ba3dca68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:30.992941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e80b0-9e7d-433f-92b4-2012ba3dca68 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:30.993403 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e80b0-9e7d-433f-92b4-2012ba3dca68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:30.993814 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0e80b0-9e7d-433f-92b4-2012ba3dca68 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:30.994576 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf86ba-f531-4b20-b07d-8fe1371f910d admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:30.995318 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e80b0-9e7d-433f-92b4-2012ba3dca68 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:30.995898 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e80b0-9e7d-433f-92b4-2012ba3dca68 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:30.997292 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING py.warnings [None req-9e0e80b0-9e7d-433f-92b4-2012ba3dca68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:01:30.997292 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: warnings.warn(msg) Oct 29 16:01:30.997292 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: Oct 29 16:01:30.999137 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0e80b0-9e7d-433f-92b4-2012ba3dca68 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.000552 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceea76c-ec07-466f-abe6-bd3f80defa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.001762 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceea76c-ec07-466f-abe6-bd3f80defa0e admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.002302 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceea76c-ec07-466f-abe6-bd3f80defa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.002727 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceea76c-ec07-466f-abe6-bd3f80defa0e admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.003737 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceea76c-ec07-466f-abe6-bd3f80defa0e admin admin] RBAC: Adding query filter params (name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:31.004141 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceea76c-ec07-466f-abe6-bd3f80defa0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.006906 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceea76c-ec07-466f-abe6-bd3f80defa0e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.021959 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 202/411] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:31.021959 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceea76c-ec07-466f-abe6-bd3f80defa0e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.032608 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 210/412] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:30 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:31.032608 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e80b0-9e7d-433f-92b4-2012ba3dca68 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.044714 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceea76c-ec07-466f-abe6-bd3f80defa0e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.045172 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0e80b0-9e7d-433f-92b4-2012ba3dca68 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.050089 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ccc8a-d0e7-4e77-b40b-5b5b3d0b02d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.050962 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ccc8a-d0e7-4e77-b40b-5b5b3d0b02d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.051239 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ccc8a-d0e7-4e77-b40b-5b5b3d0b02d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.051577 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8ccc8a-d0e7-4e77-b40b-5b5b3d0b02d2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.052145 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c3fcb-3670-4ea4-8ede-076964eb1faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.053585 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c3fcb-3670-4ea4-8ede-076964eb1faa admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.054520 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c3fcb-3670-4ea4-8ede-076964eb1faa admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.055687 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c3fcb-3670-4ea4-8ede-076964eb1faa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.071443 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ccc8a-d0e7-4e77-b40b-5b5b3d0b02d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.074558 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8ccc8a-d0e7-4e77-b40b-5b5b3d0b02d2 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.079030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c3fcb-3670-4ea4-8ede-076964eb1faa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.081886 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c3fcb-3670-4ea4-8ede-076964eb1faa admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.094910 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-2a8ccc8a-d0e7-4e77-b40b-5b5b3d0b02d2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:31.097217 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 203/413] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:31.098239 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ccc8a-d0e7-4e77-b40b-5b5b3d0b02d2 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.105352 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-9a5c3fcb-3670-4ea4-8ede-076964eb1faa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:31.107590 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 211/414] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:31.108712 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c3fcb-3670-4ea4-8ede-076964eb1faa admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.111246 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8ccc8a-d0e7-4e77-b40b-5b5b3d0b02d2 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.116640 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2110144-dac6-4824-93d8-f174388449d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.117590 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2110144-dac6-4824-93d8-f174388449d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.118313 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2110144-dac6-4824-93d8-f174388449d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.118794 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2110144-dac6-4824-93d8-f174388449d4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.120625 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2110144-dac6-4824-93d8-f174388449d4 admin admin] RBAC: Adding query filter params (role.id=01b3b9b5c0d846968d6a5219373998f8, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=e27a0c9ae2bf40caa92e9dbceff8d68b) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:31.121244 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2110144-dac6-4824-93d8-f174388449d4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.123200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c3fcb-3670-4ea4-8ede-076964eb1faa admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.123648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2110144-dac6-4824-93d8-f174388449d4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.128261 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8a91d-be33-4f72-9758-51c8dff7ea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.128950 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8a91d-be33-4f72-9758-51c8dff7ea51 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.129224 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8a91d-be33-4f72-9758-51c8dff7ea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.129474 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8a91d-be33-4f72-9758-51c8dff7ea51 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.130268 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8a91d-be33-4f72-9758-51c8dff7ea51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:31.130643 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8a91d-be33-4f72-9758-51c8dff7ea51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.137955 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e8a91d-be33-4f72-9758-51c8dff7ea51 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.138155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 204/415] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/role_assignments?user.id=e27a0c9ae2bf40caa92e9dbceff8d68b&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=01b3b9b5c0d846968d6a5219373998f8 => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:31.138155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6d6f5-f1c0-49b1-a481-9648f0003c37 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.138155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6d6f5-f1c0-49b1-a481-9648f0003c37 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.138155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6d6f5-f1c0-49b1-a481-9648f0003c37 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.138155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 205/416] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:31.140362 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6d6f5-f1c0-49b1-a481-9648f0003c37 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.156955 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 212/417] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:31.158573 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845d94e-3f52-4a97-8168-0318c7a3244f None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.158857 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845d94e-3f52-4a97-8168-0318c7a3244f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.159132 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845d94e-3f52-4a97-8168-0318c7a3244f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.164187 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6d6f5-f1c0-49b1-a481-9648f0003c37 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.169202 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f0b89-ab9e-4791-be31-a919fc89f3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.169875 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f0b89-ab9e-4791-be31-a919fc89f3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.170227 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f0b89-ab9e-4791-be31-a919fc89f3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.170507 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0f0b89-ab9e-4791-be31-a919fc89f3b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.171281 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f0b89-ab9e-4791-be31-a919fc89f3b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:31.171591 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f0b89-ab9e-4791-be31-a919fc89f3b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.173287 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0f0b89-ab9e-4791-be31-a919fc89f3b7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.178991 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-6845d94e-3f52-4a97-8168-0318c7a3244f None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:31.180356 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-6845d94e-3f52-4a97-8168-0318c7a3244f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:31.188928 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 213/418] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:31.190377 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845d94e-3f52-4a97-8168-0318c7a3244f None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.208152 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 206/419] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:31.209167 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f0b89-ab9e-4791-be31-a919fc89f3b7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.220020 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845d94e-3f52-4a97-8168-0318c7a3244f None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.224182 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0f0b89-ab9e-4791-be31-a919fc89f3b7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.224722 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68045c80-fc89-4f05-b3bd-e4d785175582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.227669 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68045c80-fc89-4f05-b3bd-e4d785175582 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.227669 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68045c80-fc89-4f05-b3bd-e4d785175582 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.227669 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68045c80-fc89-4f05-b3bd-e4d785175582 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.234611 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68045c80-fc89-4f05-b3bd-e4d785175582 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.236509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429230c-7f8b-4489-b790-3b9e6c5c7448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.236783 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68045c80-fc89-4f05-b3bd-e4d785175582 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.237635 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429230c-7f8b-4489-b790-3b9e6c5c7448 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.237950 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429230c-7f8b-4489-b790-3b9e6c5c7448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.238227 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429230c-7f8b-4489-b790-3b9e6c5c7448 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.247326 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429230c-7f8b-4489-b790-3b9e6c5c7448 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.249417 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429230c-7f8b-4489-b790-3b9e6c5c7448 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.266055 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-e429230c-7f8b-4489-b790-3b9e6c5c7448 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 16:01:31.268202 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 207/420] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/users/cinder => generated 84 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:31.268774 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-68045c80-fc89-4f05-b3bd-e4d785175582 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 29 16:01:31.269041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429230c-7f8b-4489-b790-3b9e6c5c7448 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.270110 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 214/421] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/users/neutron => generated 85 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:31.276629 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68045c80-fc89-4f05-b3bd-e4d785175582 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.280679 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429230c-7f8b-4489-b790-3b9e6c5c7448 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.290551 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f109e9e-ed6b-4acf-b538-f0f7aee820ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.291494 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f109e9e-ed6b-4acf-b538-f0f7aee820ce admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.291808 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f109e9e-ed6b-4acf-b538-f0f7aee820ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.292080 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f109e9e-ed6b-4acf-b538-f0f7aee820ce admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.294948 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68045c80-fc89-4f05-b3bd-e4d785175582 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.303137 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ee2e7-d038-4eef-b947-dfc320ac0f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.304163 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ee2e7-d038-4eef-b947-dfc320ac0f43 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.304580 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f109e9e-ed6b-4acf-b538-f0f7aee820ce admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.304846 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ee2e7-d038-4eef-b947-dfc320ac0f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.305306 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808ee2e7-d038-4eef-b947-dfc320ac0f43 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.306478 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ee2e7-d038-4eef-b947-dfc320ac0f43 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:31.306999 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ee2e7-d038-4eef-b947-dfc320ac0f43 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.307363 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f109e9e-ed6b-4acf-b538-f0f7aee820ce admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.308614 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING py.warnings [None req-808ee2e7-d038-4eef-b947-dfc320ac0f43 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:01:31.308614 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: warnings.warn(msg) Oct 29 16:01:31.308614 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: Oct 29 16:01:31.310165 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808ee2e7-d038-4eef-b947-dfc320ac0f43 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.327223 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-0f109e9e-ed6b-4acf-b538-f0f7aee820ce admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:31.328677 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 208/422] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:31.329560 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f109e9e-ed6b-4acf-b538-f0f7aee820ce admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.340346 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f109e9e-ed6b-4acf-b538-f0f7aee820ce admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.345463 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689368c-762b-4e70-9659-cc00fbffd3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.346304 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689368c-762b-4e70-9659-cc00fbffd3ce admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.346597 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689368c-762b-4e70-9659-cc00fbffd3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.346913 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689368c-762b-4e70-9659-cc00fbffd3ce admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.348106 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689368c-762b-4e70-9659-cc00fbffd3ce admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:31.348292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689368c-762b-4e70-9659-cc00fbffd3ce admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.350585 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689368c-762b-4e70-9659-cc00fbffd3ce admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.385648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 209/423] 10.222.0.41 () {56 vars in 1158 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:31.385648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689368c-762b-4e70-9659-cc00fbffd3ce admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.390811 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 215/424] 10.222.0.41 () {56 vars in 1160 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:31.391691 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ee2e7-d038-4eef-b947-dfc320ac0f43 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.395418 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689368c-762b-4e70-9659-cc00fbffd3ce admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.406662 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82947cc8-f211-4ff8-9c4b-9edae00df437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.407371 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82947cc8-f211-4ff8-9c4b-9edae00df437 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.407648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82947cc8-f211-4ff8-9c4b-9edae00df437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.407974 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82947cc8-f211-4ff8-9c4b-9edae00df437 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.408727 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82947cc8-f211-4ff8-9c4b-9edae00df437 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:31.409106 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82947cc8-f211-4ff8-9c4b-9edae00df437 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.411731 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82947cc8-f211-4ff8-9c4b-9edae00df437 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.411865 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808ee2e7-d038-4eef-b947-dfc320ac0f43 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.423898 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 210/425] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:31.424195 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8ceac-19f6-4c5e-b55f-1c8e545ba77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.424737 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82947cc8-f211-4ff8-9c4b-9edae00df437 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.424844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8ceac-19f6-4c5e-b55f-1c8e545ba77b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.425125 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8ceac-19f6-4c5e-b55f-1c8e545ba77b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.425381 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8ceac-19f6-4c5e-b55f-1c8e545ba77b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.435993 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8ceac-19f6-4c5e-b55f-1c8e545ba77b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.437346 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82947cc8-f211-4ff8-9c4b-9edae00df437 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.437761 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8ceac-19f6-4c5e-b55f-1c8e545ba77b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.447082 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0235e-f24b-4ab9-b4f4-ee801ddc5a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.448233 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0235e-f24b-4ab9-b4f4-ee801ddc5a65 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.448482 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 216/426] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:31.448726 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0235e-f24b-4ab9-b4f4-ee801ddc5a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.449242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8ceac-19f6-4c5e-b55f-1c8e545ba77b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.454240 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc0235e-f24b-4ab9-b4f4-ee801ddc5a65 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.467792 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8ceac-19f6-4c5e-b55f-1c8e545ba77b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.471054 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0235e-f24b-4ab9-b4f4-ee801ddc5a65 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.472821 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737682cb-bfc0-479f-ae97-f9a5853523da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.473493 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737682cb-bfc0-479f-ae97-f9a5853523da admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.473792 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc0235e-f24b-4ab9-b4f4-ee801ddc5a65 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.473901 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737682cb-bfc0-479f-ae97-f9a5853523da admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.474185 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737682cb-bfc0-479f-ae97-f9a5853523da admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.474907 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737682cb-bfc0-479f-ae97-f9a5853523da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.476823 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737682cb-bfc0-479f-ae97-f9a5853523da admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.486021 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 211/427] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:31.486965 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0235e-f24b-4ab9-b4f4-ee801ddc5a65 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.505577 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc0235e-f24b-4ab9-b4f4-ee801ddc5a65 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.508816 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 217/428] 10.222.0.41 () {60 vars in 1153 bytes} [Fri Oct 29 16:01:31 2021] POST /identity/v3/users => generated 247 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:01:31.509778 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737682cb-bfc0-479f-ae97-f9a5853523da admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.510490 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bc05f-fff5-428a-9dfd-b8b8515a596a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.511272 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bc05f-fff5-428a-9dfd-b8b8515a596a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.511548 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bc05f-fff5-428a-9dfd-b8b8515a596a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.511879 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44bc05f-fff5-428a-9dfd-b8b8515a596a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.523543 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737682cb-bfc0-479f-ae97-f9a5853523da admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.537381 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bc05f-fff5-428a-9dfd-b8b8515a596a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.538196 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c43c7f-fed6-4621-b815-697d9b3fb7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.539113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c43c7f-fed6-4621-b815-697d9b3fb7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.539443 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c43c7f-fed6-4621-b815-697d9b3fb7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.539812 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c43c7f-fed6-4621-b815-697d9b3fb7c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.542913 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44bc05f-fff5-428a-9dfd-b8b8515a596a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.573556 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c43c7f-fed6-4621-b815-697d9b3fb7c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.576040 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c43c7f-fed6-4621-b815-697d9b3fb7c0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.584363 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-f44bc05f-fff5-428a-9dfd-b8b8515a596a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:31.585951 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 212/429] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:31.600954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bc05f-fff5-428a-9dfd-b8b8515a596a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.616295 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44bc05f-fff5-428a-9dfd-b8b8515a596a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.620118 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-38c43c7f-fed6-4621-b815-697d9b3fb7c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:31.621603 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 218/430] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:31.628910 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c43c7f-fed6-4621-b815-697d9b3fb7c0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.638898 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77366766-c3a7-4b39-9364-fc95f290b15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.639574 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77366766-c3a7-4b39-9364-fc95f290b15a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.639855 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77366766-c3a7-4b39-9364-fc95f290b15a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.640173 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77366766-c3a7-4b39-9364-fc95f290b15a admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.640970 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77366766-c3a7-4b39-9364-fc95f290b15a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:31.641277 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77366766-c3a7-4b39-9364-fc95f290b15a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.645961 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77366766-c3a7-4b39-9364-fc95f290b15a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.651556 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c43c7f-fed6-4621-b815-697d9b3fb7c0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.657092 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 213/431] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:31.662366 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ac709-3e4f-4934-9737-d12301e5adb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.663043 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ac709-3e4f-4934-9737-d12301e5adb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.663331 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ac709-3e4f-4934-9737-d12301e5adb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.663751 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ac709-3e4f-4934-9737-d12301e5adb7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.664670 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ac709-3e4f-4934-9737-d12301e5adb7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:31.665146 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ac709-3e4f-4934-9737-d12301e5adb7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.667207 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77366766-c3a7-4b39-9364-fc95f290b15a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.675367 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ac709-3e4f-4934-9737-d12301e5adb7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.680835 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77366766-c3a7-4b39-9364-fc95f290b15a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.687970 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca68a19-058b-40be-aa5c-da1b5bf308ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.688791 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca68a19-058b-40be-aa5c-da1b5bf308ae admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.689762 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca68a19-058b-40be-aa5c-da1b5bf308ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.690112 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca68a19-058b-40be-aa5c-da1b5bf308ae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.700164 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 219/432] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:31.703946 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca68a19-058b-40be-aa5c-da1b5bf308ae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.706577 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca68a19-058b-40be-aa5c-da1b5bf308ae admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.707123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ac709-3e4f-4934-9737-d12301e5adb7 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.725794 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-4ca68a19-058b-40be-aa5c-da1b5bf308ae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:31.728154 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 214/433] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:31.728842 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ac709-3e4f-4934-9737-d12301e5adb7 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.735100 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca68a19-058b-40be-aa5c-da1b5bf308ae admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.743723 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1b94e-26b9-4b31-abc5-0709c88cfc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.744538 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1b94e-26b9-4b31-abc5-0709c88cfc49 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.744816 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1b94e-26b9-4b31-abc5-0709c88cfc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.745100 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1b94e-26b9-4b31-abc5-0709c88cfc49 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.761297 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca68a19-058b-40be-aa5c-da1b5bf308ae admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.766746 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1b94e-26b9-4b31-abc5-0709c88cfc49 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.769703 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1b94e-26b9-4b31-abc5-0709c88cfc49 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.778544 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16e4e4-4e8b-4592-9d03-57e74858d45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.779323 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16e4e4-4e8b-4592-9d03-57e74858d45e admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.780464 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16e4e4-4e8b-4592-9d03-57e74858d45e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.780464 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae16e4e4-4e8b-4592-9d03-57e74858d45e admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.780892 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16e4e4-4e8b-4592-9d03-57e74858d45e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:31.781110 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16e4e4-4e8b-4592-9d03-57e74858d45e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.785733 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae16e4e4-4e8b-4592-9d03-57e74858d45e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.797575 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-59c1b94e-26b9-4b31-abc5-0709c88cfc49 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:31.801079 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 220/434] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:31.806997 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1b94e-26b9-4b31-abc5-0709c88cfc49 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.818448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 215/435] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:31.819515 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1b94e-26b9-4b31-abc5-0709c88cfc49 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.824756 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fe767-f27a-4e33-9383-c3623a1b6c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.825301 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fe767-f27a-4e33-9383-c3623a1b6c18 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.825888 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fe767-f27a-4e33-9383-c3623a1b6c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.826195 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fe767-f27a-4e33-9383-c3623a1b6c18 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.827091 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fe767-f27a-4e33-9383-c3623a1b6c18 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:31.827451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fe767-f27a-4e33-9383-c3623a1b6c18 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.828172 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16e4e4-4e8b-4592-9d03-57e74858d45e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.829372 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06fe767-f27a-4e33-9383-c3623a1b6c18 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.842319 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 221/436] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:31.845675 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae16e4e4-4e8b-4592-9d03-57e74858d45e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.849527 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fe767-f27a-4e33-9383-c3623a1b6c18 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:31.853455 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd667c-956e-49a4-ad5c-895c8c13219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.854872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd667c-956e-49a4-ad5c-895c8c13219f admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.855600 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd667c-956e-49a4-ad5c-895c8c13219f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.856314 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd667c-956e-49a4-ad5c-895c8c13219f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.858071 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd667c-956e-49a4-ad5c-895c8c13219f admin admin] RBAC: Adding query filter params (role.id=01b3b9b5c0d846968d6a5219373998f8, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=9652ec3b44ee410dba2491c8f9795e20) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:31.858728 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd667c-956e-49a4-ad5c-895c8c13219f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.860805 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06fe767-f27a-4e33-9383-c3623a1b6c18 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:31.863915 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd667c-956e-49a4-ad5c-895c8c13219f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.866536 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ded078-19ae-4af8-8a9f-ced087ccf27c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:31.867350 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ded078-19ae-4af8-8a9f-ced087ccf27c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:31.867810 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ded078-19ae-4af8-8a9f-ced087ccf27c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:31.868250 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ded078-19ae-4af8-8a9f-ced087ccf27c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:31.869284 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ded078-19ae-4af8-8a9f-ced087ccf27c admin admin] RBAC: Adding query filter params (role.id=01b3b9b5c0d846968d6a5219373998f8, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=3bb8aa43328d4be08455441d0ffa4e8a) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:31.869754 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ded078-19ae-4af8-8a9f-ced087ccf27c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:31.871959 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ded078-19ae-4af8-8a9f-ced087ccf27c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:31.878913 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 222/438] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/role_assignments?user.id=3bb8aa43328d4be08455441d0ffa4e8a&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=01b3b9b5c0d846968d6a5219373998f8 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:31.886089 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 216/438] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:31 2021] GET /identity/v3/role_assignments?user.id=9652ec3b44ee410dba2491c8f9795e20&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=01b3b9b5c0d846968d6a5219373998f8 => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:33.761484 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7a676-a9e4-4a20-9592-11698d4c7c94 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:33.762096 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7a676-a9e4-4a20-9592-11698d4c7c94 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:33.762408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7a676-a9e4-4a20-9592-11698d4c7c94 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:33.765347 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 223/439] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:33.775815 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7980a-40f9-4d3c-8d61-4dfd4bf21c58 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:33.775815 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7980a-40f9-4d3c-8d61-4dfd4bf21c58 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:33.775815 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c7980a-40f9-4d3c-8d61-4dfd4bf21c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:33.815997 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-d1c7980a-40f9-4d3c-8d61-4dfd4bf21c58 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:33.817208 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d1c7980a-40f9-4d3c-8d61-4dfd4bf21c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:33.829790 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 217/440] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:33.842070 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3112a1-8e92-4829-8ef1-6273ea8031cc None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:33.842359 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3112a1-8e92-4829-8ef1-6273ea8031cc None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:33.842638 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3112a1-8e92-4829-8ef1-6273ea8031cc None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:33.844426 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 224/441] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:33.852499 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7980a-40f9-4d3c-8d61-4dfd4bf21c58 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:33.862533 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c7980a-40f9-4d3c-8d61-4dfd4bf21c58 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:33.867787 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70366e-4b20-48b1-80a3-40cb02ee4192 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:33.868331 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70366e-4b20-48b1-80a3-40cb02ee4192 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:33.868849 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af70366e-4b20-48b1-80a3-40cb02ee4192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:33.870007 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396b7f1-425e-4186-b481-40a6f340f589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:33.870806 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396b7f1-425e-4186-b481-40a6f340f589 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:33.871090 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396b7f1-425e-4186-b481-40a6f340f589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:33.871366 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2396b7f1-425e-4186-b481-40a6f340f589 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:33.904643 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-af70366e-4b20-48b1-80a3-40cb02ee4192 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:33.906237 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-af70366e-4b20-48b1-80a3-40cb02ee4192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:33.910988 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2396b7f1-425e-4186-b481-40a6f340f589 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:33.918383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-2396b7f1-425e-4186-b481-40a6f340f589 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:01:33.919916 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 218/442] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:33 2021] GET /identity/v3/roles/service => generated 85 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:33.926923 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396b7f1-425e-4186-b481-40a6f340f589 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:33.927656 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 225/443] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:33 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:33.937309 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2396b7f1-425e-4186-b481-40a6f340f589 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:33.951522 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aceb410-946f-4d4c-819a-8bce7e5dd839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:33.952002 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70366e-4b20-48b1-80a3-40cb02ee4192 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:33.952208 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceb410-946f-4d4c-819a-8bce7e5dd839 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:33.952485 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceb410-946f-4d4c-819a-8bce7e5dd839 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:33.952768 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aceb410-946f-4d4c-819a-8bce7e5dd839 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:33.953553 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aceb410-946f-4d4c-819a-8bce7e5dd839 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:33.953860 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aceb410-946f-4d4c-819a-8bce7e5dd839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:33.955547 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aceb410-946f-4d4c-819a-8bce7e5dd839 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:33.963630 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af70366e-4b20-48b1-80a3-40cb02ee4192 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:33.969538 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 219/444] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:01:33 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:33.979015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aceb410-946f-4d4c-819a-8bce7e5dd839 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:33.987003 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69417c-c63a-45a5-8736-7e4e02d3b33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:33.988115 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69417c-c63a-45a5-8736-7e4e02d3b33b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:33.988402 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69417c-c63a-45a5-8736-7e4e02d3b33b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:33.988679 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f69417c-c63a-45a5-8736-7e4e02d3b33b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:33.995078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aceb410-946f-4d4c-819a-8bce7e5dd839 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.002533 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f7688-3b0c-404c-8295-72456aa4587a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.003770 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f7688-3b0c-404c-8295-72456aa4587a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.004214 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f7688-3b0c-404c-8295-72456aa4587a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.004649 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64f7688-3b0c-404c-8295-72456aa4587a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.014981 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f69417c-c63a-45a5-8736-7e4e02d3b33b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:34.021164 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f7688-3b0c-404c-8295-72456aa4587a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:34.023269 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-4f69417c-c63a-45a5-8736-7e4e02d3b33b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:01:34.024299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64f7688-3b0c-404c-8295-72456aa4587a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:34.031405 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 226/445] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:33 2021] GET /identity/v3/roles/service => generated 85 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:34.039429 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69417c-c63a-45a5-8736-7e4e02d3b33b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.051874 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-d64f7688-3b0c-404c-8295-72456aa4587a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:34.053423 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 220/446] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:33 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:34.059714 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f7688-3b0c-404c-8295-72456aa4587a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.060193 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f69417c-c63a-45a5-8736-7e4e02d3b33b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.070465 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64f7688-3b0c-404c-8295-72456aa4587a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.075123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af898b8b-d0a3-48fe-889c-1087ba7837be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.076075 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af898b8b-d0a3-48fe-889c-1087ba7837be admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.076359 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af898b8b-d0a3-48fe-889c-1087ba7837be admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.076637 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af898b8b-d0a3-48fe-889c-1087ba7837be admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.077413 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af898b8b-d0a3-48fe-889c-1087ba7837be admin admin] RBAC: Adding query filter params (name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:34.077720 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af898b8b-d0a3-48fe-889c-1087ba7837be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:34.079393 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af898b8b-d0a3-48fe-889c-1087ba7837be admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:34.082965 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9ea63-1c81-4196-8a3d-4460a23caafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.083631 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9ea63-1c81-4196-8a3d-4460a23caafe admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.083913 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9ea63-1c81-4196-8a3d-4460a23caafe admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.084188 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9ea63-1c81-4196-8a3d-4460a23caafe admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.084938 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9ea63-1c81-4196-8a3d-4460a23caafe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:34.085243 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9ea63-1c81-4196-8a3d-4460a23caafe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:34.086877 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9ea63-1c81-4196-8a3d-4460a23caafe admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:34.103741 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 227/447] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:34.111833 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 221/448] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:34.117943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af898b8b-d0a3-48fe-889c-1087ba7837be admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.127025 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9ea63-1c81-4196-8a3d-4460a23caafe admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.136900 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af898b8b-d0a3-48fe-889c-1087ba7837be admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.141844 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9ea63-1c81-4196-8a3d-4460a23caafe admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.147378 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ed436-2b04-4379-b0d0-ee9fe1fa95fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.148242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ed436-2b04-4379-b0d0-ee9fe1fa95fe admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.148532 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ed436-2b04-4379-b0d0-ee9fe1fa95fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.148807 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ed436-2b04-4379-b0d0-ee9fe1fa95fe admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.156392 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab76a5d-29ac-408d-a5b7-619683303239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.157240 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab76a5d-29ac-408d-a5b7-619683303239 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.157528 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab76a5d-29ac-408d-a5b7-619683303239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.160749 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab76a5d-29ac-408d-a5b7-619683303239 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.171272 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ed436-2b04-4379-b0d0-ee9fe1fa95fe admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:34.173409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ed436-2b04-4379-b0d0-ee9fe1fa95fe admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:34.180773 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab76a5d-29ac-408d-a5b7-619683303239 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:34.184877 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab76a5d-29ac-408d-a5b7-619683303239 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:34.210772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-9ab76a5d-29ac-408d-a5b7-619683303239 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:34.213532 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-d18ed436-2b04-4379-b0d0-ee9fe1fa95fe admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 29 16:01:34.214061 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 222/449] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:34.221824 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 228/450] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/users/glance => generated 84 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:34.224001 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab76a5d-29ac-408d-a5b7-619683303239 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.227184 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ed436-2b04-4379-b0d0-ee9fe1fa95fe admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.240766 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ed436-2b04-4379-b0d0-ee9fe1fa95fe admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.244426 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab76a5d-29ac-408d-a5b7-619683303239 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.250486 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cc5e4-a6e2-4a1f-b926-147551eaab15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.251659 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cc5e4-a6e2-4a1f-b926-147551eaab15 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.252634 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cc5e4-a6e2-4a1f-b926-147551eaab15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.253452 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905cc5e4-a6e2-4a1f-b926-147551eaab15 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.255029 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cc5e4-a6e2-4a1f-b926-147551eaab15 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:34.255830 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9566675-af5d-4718-b701-cb4ca7b87a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.256359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cc5e4-a6e2-4a1f-b926-147551eaab15 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:34.257214 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9566675-af5d-4718-b701-cb4ca7b87a6c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.259489 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905cc5e4-a6e2-4a1f-b926-147551eaab15 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:34.260023 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9566675-af5d-4718-b701-cb4ca7b87a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.260511 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9566675-af5d-4718-b701-cb4ca7b87a6c admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.261469 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9566675-af5d-4718-b701-cb4ca7b87a6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:34.262151 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9566675-af5d-4718-b701-cb4ca7b87a6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:34.265839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9566675-af5d-4718-b701-cb4ca7b87a6c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:34.294073 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 229/451] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:34.301701 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9566675-af5d-4718-b701-cb4ca7b87a6c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.310863 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 223/452] 10.222.0.41 () {56 vars in 1158 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:34.311841 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9566675-af5d-4718-b701-cb4ca7b87a6c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.318840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cc5e4-a6e2-4a1f-b926-147551eaab15 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.322002 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab07c7-9d50-4523-846a-70cdbc12ce89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.323013 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab07c7-9d50-4523-846a-70cdbc12ce89 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.323447 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab07c7-9d50-4523-846a-70cdbc12ce89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.323868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab07c7-9d50-4523-846a-70cdbc12ce89 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.341441 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab07c7-9d50-4523-846a-70cdbc12ce89 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:34.344738 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fab07c7-9d50-4523-846a-70cdbc12ce89 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:34.348078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905cc5e4-a6e2-4a1f-b926-147551eaab15 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.358200 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9db53-de8c-4176-b116-53183a7b5db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.360368 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9db53-de8c-4176-b116-53183a7b5db6 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.361669 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9db53-de8c-4176-b116-53183a7b5db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.362928 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9db53-de8c-4176-b116-53183a7b5db6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.379386 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-8fab07c7-9d50-4523-846a-70cdbc12ce89 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 16:01:34.380899 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 230/453] 10.222.0.41 () {56 vars in 1114 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/users/nova => generated 82 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:34.387234 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9db53-de8c-4176-b116-53183a7b5db6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:34.389268 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9db53-de8c-4176-b116-53183a7b5db6 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:34.404381 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab07c7-9d50-4523-846a-70cdbc12ce89 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.417239 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fab07c7-9d50-4523-846a-70cdbc12ce89 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.421080 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-eed9db53-de8c-4176-b116-53183a7b5db6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:34.423762 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 224/454] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:34.424202 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b239d64-4579-4d27-8c3d-04a62d7fc3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.431059 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b239d64-4579-4d27-8c3d-04a62d7fc3f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.432296 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b239d64-4579-4d27-8c3d-04a62d7fc3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.432729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9db53-de8c-4176-b116-53183a7b5db6 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.432873 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b239d64-4579-4d27-8c3d-04a62d7fc3f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.433965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b239d64-4579-4d27-8c3d-04a62d7fc3f0 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:34.434449 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b239d64-4579-4d27-8c3d-04a62d7fc3f0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:34.436895 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b239d64-4579-4d27-8c3d-04a62d7fc3f0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:34.454422 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9db53-de8c-4176-b116-53183a7b5db6 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.469573 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 231/455] 10.222.0.41 () {56 vars in 1154 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:34.475405 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7634f0-7198-4d1c-88bf-19ea0a3e2ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.476012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7634f0-7198-4d1c-88bf-19ea0a3e2ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.476290 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7634f0-7198-4d1c-88bf-19ea0a3e2ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.476561 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7634f0-7198-4d1c-88bf-19ea0a3e2ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.477001 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b239d64-4579-4d27-8c3d-04a62d7fc3f0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.477305 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7634f0-7198-4d1c-88bf-19ea0a3e2ec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:34.477607 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7634f0-7198-4d1c-88bf-19ea0a3e2ec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:34.479240 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7634f0-7198-4d1c-88bf-19ea0a3e2ec7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:34.492148 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b239d64-4579-4d27-8c3d-04a62d7fc3f0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.497788 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 225/456] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:34.501861 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ae7ca-21aa-4d53-94e0-5c9c0135d246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.502852 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ae7ca-21aa-4d53-94e0-5c9c0135d246 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.503382 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ae7ca-21aa-4d53-94e0-5c9c0135d246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.504471 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7634f0-7198-4d1c-88bf-19ea0a3e2ec7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.504700 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ae7ca-21aa-4d53-94e0-5c9c0135d246 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.526265 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7634f0-7198-4d1c-88bf-19ea0a3e2ec7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.527359 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ae7ca-21aa-4d53-94e0-5c9c0135d246 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:34.529906 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ae7ca-21aa-4d53-94e0-5c9c0135d246 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:34.539902 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfedc80c-c364-4509-8d2c-6bc6ba1c131b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.540742 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedc80c-c364-4509-8d2c-6bc6ba1c131b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.541064 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedc80c-c364-4509-8d2c-6bc6ba1c131b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.541334 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfedc80c-c364-4509-8d2c-6bc6ba1c131b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.557097 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-8a9ae7ca-21aa-4d53-94e0-5c9c0135d246 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:34.558745 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 232/457] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:34.559175 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfedc80c-c364-4509-8d2c-6bc6ba1c131b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:34.561185 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfedc80c-c364-4509-8d2c-6bc6ba1c131b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:34.564512 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ae7ca-21aa-4d53-94e0-5c9c0135d246 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.575227 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ae7ca-21aa-4d53-94e0-5c9c0135d246 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.581348 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac69ae1-729f-403b-b053-8bb32f63a587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.582360 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac69ae1-729f-403b-b053-8bb32f63a587 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.582909 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac69ae1-729f-403b-b053-8bb32f63a587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.583395 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac69ae1-729f-403b-b053-8bb32f63a587 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.584376 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac69ae1-729f-403b-b053-8bb32f63a587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:34.584874 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac69ae1-729f-403b-b053-8bb32f63a587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:34.587007 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac69ae1-729f-403b-b053-8bb32f63a587 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:34.589217 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-dfedc80c-c364-4509-8d2c-6bc6ba1c131b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:34.590750 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 226/458] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:34.592009 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b2b55-a67b-44f0-be16-8a1fee521dbc None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.592294 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b2b55-a67b-44f0-be16-8a1fee521dbc None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.592571 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56b2b55-a67b-44f0-be16-8a1fee521dbc None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.594526 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 227/459] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:34.602856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b2b55-a67b-44f0-be16-8a1fee521dbc None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.604141 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 233/460] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:34.605881 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2772b-725c-46e7-8c4c-09b1a5ef5c5a None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.606427 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2772b-725c-46e7-8c4c-09b1a5ef5c5a None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.606936 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2772b-725c-46e7-8c4c-09b1a5ef5c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.622600 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56b2b55-a67b-44f0-be16-8a1fee521dbc None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.629324 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820c755-95e3-433e-952d-f8f3bc2b8de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.630288 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820c755-95e3-433e-952d-f8f3bc2b8de5 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.630591 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820c755-95e3-433e-952d-f8f3bc2b8de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.630881 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820c755-95e3-433e-952d-f8f3bc2b8de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.631133 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-d9e2772b-725c-46e7-8c4c-09b1a5ef5c5a None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:34.631746 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820c755-95e3-433e-952d-f8f3bc2b8de5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:34.632051 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820c755-95e3-433e-952d-f8f3bc2b8de5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:34.632487 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-d9e2772b-725c-46e7-8c4c-09b1a5ef5c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:34.634086 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820c755-95e3-433e-952d-f8f3bc2b8de5 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:34.646001 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 234/461] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:34.646001 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2772b-725c-46e7-8c4c-09b1a5ef5c5a None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.650299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 228/462] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:34.650299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765f775-e07d-4a30-95de-5f9eb471d6c0 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.650299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765f775-e07d-4a30-95de-5f9eb471d6c0 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.650299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765f775-e07d-4a30-95de-5f9eb471d6c0 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.653954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 229/463] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:34.657093 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765f775-e07d-4a30-95de-5f9eb471d6c0 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.661468 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2772b-725c-46e7-8c4c-09b1a5ef5c5a None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.671500 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b53a3b-59f5-49ac-9255-065c1af10181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.672824 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b53a3b-59f5-49ac-9255-065c1af10181 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.673507 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b53a3b-59f5-49ac-9255-065c1af10181 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.674016 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b53a3b-59f5-49ac-9255-065c1af10181 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.682062 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b53a3b-59f5-49ac-9255-065c1af10181 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:34.683250 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765f775-e07d-4a30-95de-5f9eb471d6c0 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.684480 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b53a3b-59f5-49ac-9255-065c1af10181 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:34.696821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de29f0-2cbf-4a31-9d26-f0c4324fd5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.696821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de29f0-2cbf-4a31-9d26-f0c4324fd5cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.696821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de29f0-2cbf-4a31-9d26-f0c4324fd5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.696821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de29f0-2cbf-4a31-9d26-f0c4324fd5cd admin admin] PATH_INFO: `/v3/projects/4939afba2b604181b67577f309c9550a/users/e27a0c9ae2bf40caa92e9dbceff8d68b/roles/01b3b9b5c0d846968d6a5219373998f8` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.711689 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-18b53a3b-59f5-49ac-9255-065c1af10181 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:34.713151 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 235/464] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:34.716555 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de29f0-2cbf-4a31-9d26-f0c4324fd5cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4939afba2b604181b67577f309c9550a, user_id=e27a0c9ae2bf40caa92e9dbceff8d68b, role_id=01b3b9b5c0d846968d6a5219373998f8)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:34.719358 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de29f0-2cbf-4a31-9d26-f0c4324fd5cd admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:34.719623 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bed6e-8c37-4e3e-adb1-2e0634cd85c2 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.719853 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bed6e-8c37-4e3e-adb1-2e0634cd85c2 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.720130 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bed6e-8c37-4e3e-adb1-2e0634cd85c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.735631 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 230/465] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:01:34 2021] PUT /identity/v3/projects/4939afba2b604181b67577f309c9550a/users/e27a0c9ae2bf40caa92e9dbceff8d68b/roles/01b3b9b5c0d846968d6a5219373998f8 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:01:34.736824 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de29f0-2cbf-4a31-9d26-f0c4324fd5cd admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.755866 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-256bed6e-8c37-4e3e-adb1-2e0634cd85c2 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:34.758462 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-256bed6e-8c37-4e3e-adb1-2e0634cd85c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:34.826702 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de29f0-2cbf-4a31-9d26-f0c4324fd5cd admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.837359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd79556-8a6f-4124-8edf-b050b0a8b680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.838652 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd79556-8a6f-4124-8edf-b050b0a8b680 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.839170 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd79556-8a6f-4124-8edf-b050b0a8b680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.839873 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd79556-8a6f-4124-8edf-b050b0a8b680 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.861259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd79556-8a6f-4124-8edf-b050b0a8b680 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:34.861744 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 236/466] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:34 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:34.870557 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bed6e-8c37-4e3e-adb1-2e0634cd85c2 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.874822 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bed6e-8c37-4e3e-adb1-2e0634cd85c2 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.888026 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-ffd79556-8a6f-4124-8edf-b050b0a8b680 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:01:34.890382 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 231/467] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:34.899344 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd79556-8a6f-4124-8edf-b050b0a8b680 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.899771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b82629-1cbb-46a2-879b-820429e4c5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.900731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b82629-1cbb-46a2-879b-820429e4c5b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.901118 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b82629-1cbb-46a2-879b-820429e4c5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.901590 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b82629-1cbb-46a2-879b-820429e4c5b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.902742 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b82629-1cbb-46a2-879b-820429e4c5b1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:34.903220 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b82629-1cbb-46a2-879b-820429e4c5b1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:34.905426 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b82629-1cbb-46a2-879b-820429e4c5b1 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:34.915793 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd79556-8a6f-4124-8edf-b050b0a8b680 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.920872 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 237/468] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:34.922128 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b82629-1cbb-46a2-879b-820429e4c5b1 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.922407 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ef353-87da-4655-9f3d-ed41a0f693ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.923620 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ef353-87da-4655-9f3d-ed41a0f693ab admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.924047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ef353-87da-4655-9f3d-ed41a0f693ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.924473 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ef353-87da-4655-9f3d-ed41a0f693ab admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.933359 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b82629-1cbb-46a2-879b-820429e4c5b1 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.938513 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791694c-3a85-48e0-91f7-9fa90820ea47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.939937 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791694c-3a85-48e0-91f7-9fa90820ea47 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.940321 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791694c-3a85-48e0-91f7-9fa90820ea47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.940575 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ef353-87da-4655-9f3d-ed41a0f693ab admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:34.940871 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791694c-3a85-48e0-91f7-9fa90820ea47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:34.941775 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791694c-3a85-48e0-91f7-9fa90820ea47 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:34.942226 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791694c-3a85-48e0-91f7-9fa90820ea47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:34.944110 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791694c-3a85-48e0-91f7-9fa90820ea47 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:34.955318 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-aa5ef353-87da-4655-9f3d-ed41a0f693ab admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:01:34.958275 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 232/469] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:34.959867 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ef353-87da-4655-9f3d-ed41a0f693ab admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.969385 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 238/470] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:34.973993 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791694c-3a85-48e0-91f7-9fa90820ea47 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:34.988146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ef353-87da-4655-9f3d-ed41a0f693ab admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.996578 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791694c-3a85-48e0-91f7-9fa90820ea47 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:34.997485 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898aa7a-6e2c-4798-8699-0106d2a7da42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:34.998719 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898aa7a-6e2c-4798-8699-0106d2a7da42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:34.999173 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898aa7a-6e2c-4798-8699-0106d2a7da42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:34.999460 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c898aa7a-6e2c-4798-8699-0106d2a7da42 admin admin] PATH_INFO: `/v3/projects/4939afba2b604181b67577f309c9550a/users/4f13d0e9f79a433c81759ecd819a6dfa/roles/01b3b9b5c0d846968d6a5219373998f8` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.004116 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36680f7-474a-48f0-859d-36e446629e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.005019 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36680f7-474a-48f0-859d-36e446629e04 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.005502 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36680f7-474a-48f0-859d-36e446629e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.005792 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36680f7-474a-48f0-859d-36e446629e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.007154 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36680f7-474a-48f0-859d-36e446629e04 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:35.007696 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36680f7-474a-48f0-859d-36e446629e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.012362 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36680f7-474a-48f0-859d-36e446629e04 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.024281 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 239/471] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:01:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:35.025078 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36680f7-474a-48f0-859d-36e446629e04 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.028267 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898aa7a-6e2c-4798-8699-0106d2a7da42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4939afba2b604181b67577f309c9550a, user_id=4f13d0e9f79a433c81759ecd819a6dfa, role_id=01b3b9b5c0d846968d6a5219373998f8)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.031481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c898aa7a-6e2c-4798-8699-0106d2a7da42 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.037260 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36680f7-474a-48f0-859d-36e446629e04 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.043113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc3d2f-ffaa-466f-b276-3eb8e7b2f576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.043468 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc3d2f-ffaa-466f-b276-3eb8e7b2f576 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.043733 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc3d2f-ffaa-466f-b276-3eb8e7b2f576 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.043999 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc3d2f-ffaa-466f-b276-3eb8e7b2f576 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.055204 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc3d2f-ffaa-466f-b276-3eb8e7b2f576 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.057069 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bc3d2f-ffaa-466f-b276-3eb8e7b2f576 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.059844 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 233/472] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:01:34 2021] PUT /identity/v3/projects/4939afba2b604181b67577f309c9550a/users/4f13d0e9f79a433c81759ecd819a6dfa/roles/01b3b9b5c0d846968d6a5219373998f8 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:01:35.061075 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898aa7a-6e2c-4798-8699-0106d2a7da42 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.087503 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-00bc3d2f-ffaa-466f-b276-3eb8e7b2f576 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:35.094052 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 240/473] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:35.094052 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a256b2-e712-480e-889f-0b9a517c53f4 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.094052 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a256b2-e712-480e-889f-0b9a517c53f4 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.094052 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a256b2-e712-480e-889f-0b9a517c53f4 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.094655 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 241/474] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:35.103686 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a256b2-e712-480e-889f-0b9a517c53f4 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.172203 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c898aa7a-6e2c-4798-8699-0106d2a7da42 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.178026 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e078351-02f4-414f-b61a-e348488a7269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.179245 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e078351-02f4-414f-b61a-e348488a7269 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.179245 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e078351-02f4-414f-b61a-e348488a7269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.179705 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e078351-02f4-414f-b61a-e348488a7269 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.185032 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a256b2-e712-480e-889f-0b9a517c53f4 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.191828 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafea75-1205-4a6f-bcf9-2041bc9ca4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.193127 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafea75-1205-4a6f-bcf9-2041bc9ca4fb admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.193537 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e078351-02f4-414f-b61a-e348488a7269 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.193821 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafea75-1205-4a6f-bcf9-2041bc9ca4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.194324 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafea75-1205-4a6f-bcf9-2041bc9ca4fb admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.195265 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafea75-1205-4a6f-bcf9-2041bc9ca4fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:35.195758 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafea75-1205-4a6f-bcf9-2041bc9ca4fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.195925 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e078351-02f4-414f-b61a-e348488a7269 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.197780 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaafea75-1205-4a6f-bcf9-2041bc9ca4fb admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.219480 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-7e078351-02f4-414f-b61a-e348488a7269 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:35.219480 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 234/476] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:35.219845 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 242/476] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:35.221633 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafea75-1205-4a6f-bcf9-2041bc9ca4fb admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.226412 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7076d1-cbea-4ec0-b1e4-d5a1aae4528f None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.226701 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7076d1-cbea-4ec0-b1e4-d5a1aae4528f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.227160 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7076d1-cbea-4ec0-b1e4-d5a1aae4528f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.237368 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafea75-1205-4a6f-bcf9-2041bc9ca4fb admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.245004 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669aa85b-4d45-4725-9137-ffdcf98d07b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.245835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669aa85b-4d45-4725-9137-ffdcf98d07b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.246365 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669aa85b-4d45-4725-9137-ffdcf98d07b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.249951 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669aa85b-4d45-4725-9137-ffdcf98d07b9 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.252128 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-ce7076d1-cbea-4ec0-b1e4-d5a1aae4528f None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:35.253387 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-ce7076d1-cbea-4ec0-b1e4-d5a1aae4528f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:35.268041 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669aa85b-4d45-4725-9137-ffdcf98d07b9 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.270046 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 235/477] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:35.271034 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7076d1-cbea-4ec0-b1e4-d5a1aae4528f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.273133 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669aa85b-4d45-4725-9137-ffdcf98d07b9 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.289773 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7076d1-cbea-4ec0-b1e4-d5a1aae4528f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.302307 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-669aa85b-4d45-4725-9137-ffdcf98d07b9 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 29 16:01:35.303193 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75024526-e213-4586-804f-076577e6adde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.303882 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75024526-e213-4586-804f-076577e6adde admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.304169 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75024526-e213-4586-804f-076577e6adde admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.304532 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75024526-e213-4586-804f-076577e6adde admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.305315 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75024526-e213-4586-804f-076577e6adde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:35.305594 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75024526-e213-4586-804f-076577e6adde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.307040 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 243/478] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/users/swift => generated 83 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:35.307561 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75024526-e213-4586-804f-076577e6adde admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.314899 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669aa85b-4d45-4725-9137-ffdcf98d07b9 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.334051 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669aa85b-4d45-4725-9137-ffdcf98d07b9 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.335073 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 236/479] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:35.336520 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75024526-e213-4586-804f-076577e6adde admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.347124 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c47a1-67aa-4d7e-88e0-462c34ca9af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.348640 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c47a1-67aa-4d7e-88e0-462c34ca9af5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.349088 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c47a1-67aa-4d7e-88e0-462c34ca9af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.349526 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c47a1-67aa-4d7e-88e0-462c34ca9af5 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.350954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75024526-e213-4586-804f-076577e6adde admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.359024 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30da7da-fca8-4647-ac95-aaed1b9a5fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.360289 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30da7da-fca8-4647-ac95-aaed1b9a5fab admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.360644 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30da7da-fca8-4647-ac95-aaed1b9a5fab admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.361398 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30da7da-fca8-4647-ac95-aaed1b9a5fab admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.362524 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30da7da-fca8-4647-ac95-aaed1b9a5fab admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:35.362893 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30da7da-fca8-4647-ac95-aaed1b9a5fab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.364771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c47a1-67aa-4d7e-88e0-462c34ca9af5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:35.365096 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30da7da-fca8-4647-ac95-aaed1b9a5fab admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.372537 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-8f6c47a1-67aa-4d7e-88e0-462c34ca9af5 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:01:35.374024 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 244/480] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/roles/service => generated 85 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:35.374966 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c47a1-67aa-4d7e-88e0-462c34ca9af5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.389500 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c47a1-67aa-4d7e-88e0-462c34ca9af5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.389756 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 237/481] 10.222.0.41 () {56 vars in 1156 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:35.391285 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30da7da-fca8-4647-ac95-aaed1b9a5fab admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.402081 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30da7da-fca8-4647-ac95-aaed1b9a5fab admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.404244 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b2ba3-2cc6-4059-8400-ef8276db6ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.406023 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b2ba3-2cc6-4059-8400-ef8276db6ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.406669 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b2ba3-2cc6-4059-8400-ef8276db6ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.407112 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc422eb8-3e3d-4141-aa05-1a38cd0663e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.407517 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2b2ba3-2cc6-4059-8400-ef8276db6ca6 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.408567 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc422eb8-3e3d-4141-aa05-1a38cd0663e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.408927 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc422eb8-3e3d-4141-aa05-1a38cd0663e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.409277 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc422eb8-3e3d-4141-aa05-1a38cd0663e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.410163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc422eb8-3e3d-4141-aa05-1a38cd0663e9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:35.410543 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc422eb8-3e3d-4141-aa05-1a38cd0663e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.412217 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc422eb8-3e3d-4141-aa05-1a38cd0663e9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.421731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b2ba3-2cc6-4059-8400-ef8276db6ca6 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.422642 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 238/482] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:35.428083 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc422eb8-3e3d-4141-aa05-1a38cd0663e9 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.428254 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2b2ba3-2cc6-4059-8400-ef8276db6ca6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.438491 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc422eb8-3e3d-4141-aa05-1a38cd0663e9 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.443553 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6e4e5-4d2f-49da-9c09-b28cbddbd892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.444320 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6e4e5-4d2f-49da-9c09-b28cbddbd892 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.444677 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6e4e5-4d2f-49da-9c09-b28cbddbd892 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.445028 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c6e4e5-4d2f-49da-9c09-b28cbddbd892 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.445373 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-6d2b2ba3-2cc6-4059-8400-ef8276db6ca6 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 29 16:01:35.447145 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 245/483] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/users/neutron => generated 85 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:35.448178 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b2ba3-2cc6-4059-8400-ef8276db6ca6 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.457276 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6e4e5-4d2f-49da-9c09-b28cbddbd892 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.459162 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c6e4e5-4d2f-49da-9c09-b28cbddbd892 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.466334 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2b2ba3-2cc6-4059-8400-ef8276db6ca6 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.469626 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 239/484] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:35.473630 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6e4e5-4d2f-49da-9c09-b28cbddbd892 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.474164 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3eab0-56f8-4ae4-b433-773deba22213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.475194 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3eab0-56f8-4ae4-b433-773deba22213 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.475614 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3eab0-56f8-4ae4-b433-773deba22213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.476030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3eab0-56f8-4ae4-b433-773deba22213 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.484218 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c6e4e5-4d2f-49da-9c09-b28cbddbd892 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.490068 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc6f75-4d0e-4509-8e94-4f665faf1766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.490696 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc6f75-4d0e-4509-8e94-4f665faf1766 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.491090 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc6f75-4d0e-4509-8e94-4f665faf1766 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.491514 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cc6f75-4d0e-4509-8e94-4f665faf1766 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.492445 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc6f75-4d0e-4509-8e94-4f665faf1766 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:35.492831 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc6f75-4d0e-4509-8e94-4f665faf1766 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.493018 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3eab0-56f8-4ae4-b433-773deba22213 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.494989 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cc6f75-4d0e-4509-8e94-4f665faf1766 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.495182 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3eab0-56f8-4ae4-b433-773deba22213 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.518875 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-afa3eab0-56f8-4ae4-b433-773deba22213 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:35.520380 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 246/485] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:35.526197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3eab0-56f8-4ae4-b433-773deba22213 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.537285 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3eab0-56f8-4ae4-b433-773deba22213 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.537731 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 240/486] 10.222.0.41 () {56 vars in 1160 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:35.539583 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc6f75-4d0e-4509-8e94-4f665faf1766 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.547897 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07ee36-4b34-4fe0-b3e4-16593bedd7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.548883 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07ee36-4b34-4fe0-b3e4-16593bedd7e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.549220 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07ee36-4b34-4fe0-b3e4-16593bedd7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.549529 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac07ee36-4b34-4fe0-b3e4-16593bedd7e3 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.554616 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cc6f75-4d0e-4509-8e94-4f665faf1766 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.562245 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a46b7-0efc-4fbc-876e-926e896e2010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.563382 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a46b7-0efc-4fbc-876e-926e896e2010 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.563975 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a46b7-0efc-4fbc-876e-926e896e2010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.564435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a46b7-0efc-4fbc-876e-926e896e2010 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.565384 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a46b7-0efc-4fbc-876e-926e896e2010 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:35.565994 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a46b7-0efc-4fbc-876e-926e896e2010 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.568342 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a46b7-0efc-4fbc-876e-926e896e2010 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.569680 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07ee36-4b34-4fe0-b3e4-16593bedd7e3 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.573003 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac07ee36-4b34-4fe0-b3e4-16593bedd7e3 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.585872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 241/487] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:35.587179 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a46b7-0efc-4fbc-876e-926e896e2010 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.604406 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a46b7-0efc-4fbc-876e-926e896e2010 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.607615 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-ac07ee36-4b34-4fe0-b3e4-16593bedd7e3 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:35.609080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 247/488] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:35.609550 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd821ca-3522-42b8-8d9b-2fe9a1df046a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.610434 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd821ca-3522-42b8-8d9b-2fe9a1df046a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.610778 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd821ca-3522-42b8-8d9b-2fe9a1df046a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.611063 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07ee36-4b34-4fe0-b3e4-16593bedd7e3 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.611165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd821ca-3522-42b8-8d9b-2fe9a1df046a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.630956 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd821ca-3522-42b8-8d9b-2fe9a1df046a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.632274 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac07ee36-4b34-4fe0-b3e4-16593bedd7e3 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.633996 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd821ca-3522-42b8-8d9b-2fe9a1df046a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.637271 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c9cab-d954-44aa-80f6-31be2ec1c97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.638701 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c9cab-d954-44aa-80f6-31be2ec1c97f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.638972 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c9cab-d954-44aa-80f6-31be2ec1c97f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.639248 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c9cab-d954-44aa-80f6-31be2ec1c97f admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.649861 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c9cab-d954-44aa-80f6-31be2ec1c97f admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.651922 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c9cab-d954-44aa-80f6-31be2ec1c97f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.660739 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-abd821ca-3522-42b8-8d9b-2fe9a1df046a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:35.667900 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 242/489] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:35.669202 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd821ca-3522-42b8-8d9b-2fe9a1df046a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.672081 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-600c9cab-d954-44aa-80f6-31be2ec1c97f admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 16:01:35.673619 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 248/490] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/users/cinder => generated 84 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:35.679021 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c9cab-d954-44aa-80f6-31be2ec1c97f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.685839 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd821ca-3522-42b8-8d9b-2fe9a1df046a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.691009 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c9cab-d954-44aa-80f6-31be2ec1c97f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.691979 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a78f78-1413-4bcb-bf9c-52639727b9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.692669 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a78f78-1413-4bcb-bf9c-52639727b9fa admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.693301 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a78f78-1413-4bcb-bf9c-52639727b9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.693591 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a78f78-1413-4bcb-bf9c-52639727b9fa admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.694528 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a78f78-1413-4bcb-bf9c-52639727b9fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:35.694849 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a78f78-1413-4bcb-bf9c-52639727b9fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.696848 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a78f78-1413-4bcb-bf9c-52639727b9fa admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.697529 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89791f-8755-4dcf-ac21-383d99d829db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.698500 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89791f-8755-4dcf-ac21-383d99d829db admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.699121 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89791f-8755-4dcf-ac21-383d99d829db admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.699683 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89791f-8755-4dcf-ac21-383d99d829db admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.701103 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89791f-8755-4dcf-ac21-383d99d829db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:35.701586 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89791f-8755-4dcf-ac21-383d99d829db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.703553 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89791f-8755-4dcf-ac21-383d99d829db admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.711359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 243/491] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:35.712209 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a78f78-1413-4bcb-bf9c-52639727b9fa admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.725279 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a78f78-1413-4bcb-bf9c-52639727b9fa admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.725612 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 249/492] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:35.726952 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89791f-8755-4dcf-ac21-383d99d829db admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.727328 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8de57d-49d0-4efe-836d-639aaa8fcfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.728224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8de57d-49d0-4efe-836d-639aaa8fcfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.728534 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8de57d-49d0-4efe-836d-639aaa8fcfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.728812 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8de57d-49d0-4efe-836d-639aaa8fcfa4 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.729663 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8de57d-49d0-4efe-836d-639aaa8fcfa4 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:35.730019 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8de57d-49d0-4efe-836d-639aaa8fcfa4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.731871 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8de57d-49d0-4efe-836d-639aaa8fcfa4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.740818 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89791f-8755-4dcf-ac21-383d99d829db admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.747620 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bab431-2d37-4477-995c-d2b4f9c7e847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.748769 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bab431-2d37-4477-995c-d2b4f9c7e847 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.749227 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bab431-2d37-4477-995c-d2b4f9c7e847 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.749671 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bab431-2d37-4477-995c-d2b4f9c7e847 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.752930 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 244/493] 10.222.0.41 () {56 vars in 1158 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:35.753813 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8de57d-49d0-4efe-836d-639aaa8fcfa4 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.759139 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bab431-2d37-4477-995c-d2b4f9c7e847 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.761729 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bab431-2d37-4477-995c-d2b4f9c7e847 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.769838 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8de57d-49d0-4efe-836d-639aaa8fcfa4 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.783736 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d6dcb-fff9-4565-93f8-3c544ef55103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.784653 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d6dcb-fff9-4565-93f8-3c544ef55103 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.785000 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d6dcb-fff9-4565-93f8-3c544ef55103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.785367 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d6dcb-fff9-4565-93f8-3c544ef55103 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.787822 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-52bab431-2d37-4477-995c-d2b4f9c7e847 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:35.789319 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 250/494] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:35.790500 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bab431-2d37-4477-995c-d2b4f9c7e847 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.794873 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d6dcb-fff9-4565-93f8-3c544ef55103 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.797291 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d6dcb-fff9-4565-93f8-3c544ef55103 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.806189 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bab431-2d37-4477-995c-d2b4f9c7e847 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.812968 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-497d6dcb-fff9-4565-93f8-3c544ef55103 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:35.813451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39b1df-ef1e-426b-af86-806f68c07980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.815444 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 245/495] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:35.817121 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d6dcb-fff9-4565-93f8-3c544ef55103 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.817707 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39b1df-ef1e-426b-af86-806f68c07980 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.822802 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39b1df-ef1e-426b-af86-806f68c07980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.823393 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df39b1df-ef1e-426b-af86-806f68c07980 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.828461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d6dcb-fff9-4565-93f8-3c544ef55103 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.835794 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2ac0e-0a35-4fa8-9974-0e1a1c760215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.837186 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2ac0e-0a35-4fa8-9974-0e1a1c760215 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.837530 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2ac0e-0a35-4fa8-9974-0e1a1c760215 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.838061 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2ac0e-0a35-4fa8-9974-0e1a1c760215 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.839203 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2ac0e-0a35-4fa8-9974-0e1a1c760215 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:35.839545 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39b1df-ef1e-426b-af86-806f68c07980 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.839652 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2ac0e-0a35-4fa8-9974-0e1a1c760215 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.841508 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2ac0e-0a35-4fa8-9974-0e1a1c760215 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.842052 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df39b1df-ef1e-426b-af86-806f68c07980 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.856730 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 246/496] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:35.857716 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2ac0e-0a35-4fa8-9974-0e1a1c760215 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.861583 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-df39b1df-ef1e-426b-af86-806f68c07980 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:35.863784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 251/497] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:35.865309 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39b1df-ef1e-426b-af86-806f68c07980 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.877018 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2ac0e-0a35-4fa8-9974-0e1a1c760215 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.883612 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df39b1df-ef1e-426b-af86-806f68c07980 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.885730 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6f8e4-798a-4683-a267-612a4cc75e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.887293 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6f8e4-798a-4683-a267-612a4cc75e37 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.888005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6f8e4-798a-4683-a267-612a4cc75e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.888521 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37782efa-7047-408a-9261-06c3b079865e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.888758 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e6f8e4-798a-4683-a267-612a4cc75e37 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.889168 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37782efa-7047-408a-9261-06c3b079865e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.889479 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37782efa-7047-408a-9261-06c3b079865e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.889775 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37782efa-7047-408a-9261-06c3b079865e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.890598 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37782efa-7047-408a-9261-06c3b079865e admin admin] RBAC: Adding query filter params (role.id=01b3b9b5c0d846968d6a5219373998f8, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=f518ae309c4b4f7eacca882b58e58bd0) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:35.890917 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37782efa-7047-408a-9261-06c3b079865e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.892651 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6f8e4-798a-4683-a267-612a4cc75e37 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:35.893344 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37782efa-7047-408a-9261-06c3b079865e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.893893 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6f8e4-798a-4683-a267-612a4cc75e37 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.896766 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e6f8e4-798a-4683-a267-612a4cc75e37 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.900293 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 252/498] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/role_assignments?user.id=f518ae309c4b4f7eacca882b58e58bd0&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=01b3b9b5c0d846968d6a5219373998f8 => generated 259 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:35.901220 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37782efa-7047-408a-9261-06c3b079865e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.913483 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37782efa-7047-408a-9261-06c3b079865e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.921996 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55623e-867d-43cb-89c9-46a55834b08c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.921996 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55623e-867d-43cb-89c9-46a55834b08c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.921996 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55623e-867d-43cb-89c9-46a55834b08c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.921996 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55623e-867d-43cb-89c9-46a55834b08c admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.922436 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55623e-867d-43cb-89c9-46a55834b08c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:35.922436 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55623e-867d-43cb-89c9-46a55834b08c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:35.922436 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55623e-867d-43cb-89c9-46a55834b08c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:35.923089 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 247/499] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:35.930837 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6f8e4-798a-4683-a267-612a4cc75e37 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.935641 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 253/500] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:35.945982 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55623e-867d-43cb-89c9-46a55834b08c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:35.953862 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e6f8e4-798a-4683-a267-612a4cc75e37 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.961577 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55623e-867d-43cb-89c9-46a55834b08c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:35.968925 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849364e2-ea4d-4143-80f6-bda994f0f987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.969898 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849364e2-ea4d-4143-80f6-bda994f0f987 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.970241 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849364e2-ea4d-4143-80f6-bda994f0f987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.970593 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849364e2-ea4d-4143-80f6-bda994f0f987 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.970697 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09690626-bf2b-46a4-af73-3324e19602d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:35.971826 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09690626-bf2b-46a4-af73-3324e19602d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:35.972312 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09690626-bf2b-46a4-af73-3324e19602d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:35.973049 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09690626-bf2b-46a4-af73-3324e19602d3 admin admin] PATH_INFO: `/v3/projects/4939afba2b604181b67577f309c9550a/users/3bb8aa43328d4be08455441d0ffa4e8a/roles/01b3b9b5c0d846968d6a5219373998f8` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:35.998821 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849364e2-ea4d-4143-80f6-bda994f0f987 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:36.007246 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849364e2-ea4d-4143-80f6-bda994f0f987 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:36.034142 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09690626-bf2b-46a4-af73-3324e19602d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4939afba2b604181b67577f309c9550a, user_id=3bb8aa43328d4be08455441d0ffa4e8a, role_id=01b3b9b5c0d846968d6a5219373998f8)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:36.049426 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09690626-bf2b-46a4-af73-3324e19602d3 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:36.065634 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-849364e2-ea4d-4143-80f6-bda994f0f987 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:36.069051 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 254/501] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:35 2021] GET /identity/v3/projects/service => generated 88 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:36.082454 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849364e2-ea4d-4143-80f6-bda994f0f987 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:36.099193 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 248/502] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:01:35 2021] PUT /identity/v3/projects/4939afba2b604181b67577f309c9550a/users/3bb8aa43328d4be08455441d0ffa4e8a/roles/01b3b9b5c0d846968d6a5219373998f8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:01:36.116235 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849364e2-ea4d-4143-80f6-bda994f0f987 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:36.258443 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f6016-4da7-44e0-a0a9-d2c255639f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:36.259492 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f6016-4da7-44e0-a0a9-d2c255639f15 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:36.259947 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f6016-4da7-44e0-a0a9-d2c255639f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:36.260403 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f6016-4da7-44e0-a0a9-d2c255639f15 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:36.261777 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f6016-4da7-44e0-a0a9-d2c255639f15 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:36.262323 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f6016-4da7-44e0-a0a9-d2c255639f15 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:36.265619 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f6016-4da7-44e0-a0a9-d2c255639f15 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:36.288401 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 255/503] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:36 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:36.295344 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09690626-bf2b-46a4-af73-3324e19602d3 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:36.316816 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09690626-bf2b-46a4-af73-3324e19602d3 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:36.331780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb8ef7c-5192-48ea-8191-4148395c86db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:36.332930 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8ef7c-5192-48ea-8191-4148395c86db admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:36.333381 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8ef7c-5192-48ea-8191-4148395c86db admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:36.333812 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb8ef7c-5192-48ea-8191-4148395c86db admin admin] PATH_INFO: `/v3/projects/4939afba2b604181b67577f309c9550a/users/9652ec3b44ee410dba2491c8f9795e20/roles/01b3b9b5c0d846968d6a5219373998f8` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:36.356025 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8ef7c-5192-48ea-8191-4148395c86db admin admin] RBAC: Authorizing `identity:create_grant(project_id=4939afba2b604181b67577f309c9550a, user_id=9652ec3b44ee410dba2491c8f9795e20, role_id=01b3b9b5c0d846968d6a5219373998f8)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:36.358970 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb8ef7c-5192-48ea-8191-4148395c86db admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:36.379374 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 249/504] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:01:36 2021] PUT /identity/v3/projects/4939afba2b604181b67577f309c9550a/users/9652ec3b44ee410dba2491c8f9795e20/roles/01b3b9b5c0d846968d6a5219373998f8 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:01:37.513669 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378f23c-727f-48a4-920a-3e81aadc95ef None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:37.514713 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378f23c-727f-48a4-920a-3e81aadc95ef None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:37.515198 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8378f23c-727f-48a4-920a-3e81aadc95ef None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:37.518045 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 256/505] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:37.523904 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bf62d-43fd-4f29-9a43-e143d006ccd0 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:37.524763 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bf62d-43fd-4f29-9a43-e143d006ccd0 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:37.525253 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750bf62d-43fd-4f29-9a43-e143d006ccd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:37.550967 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-750bf62d-43fd-4f29-9a43-e143d006ccd0 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:37.552513 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-750bf62d-43fd-4f29-9a43-e143d006ccd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:37.622696 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 250/506] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:37.663531 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378f23c-727f-48a4-920a-3e81aadc95ef None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:37.679498 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8378f23c-727f-48a4-920a-3e81aadc95ef None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:37.690816 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3411a-bf5e-44e9-86e0-9ec71ae2f703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:37.692035 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3411a-bf5e-44e9-86e0-9ec71ae2f703 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:37.692522 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3411a-bf5e-44e9-86e0-9ec71ae2f703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:37.693166 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3411a-bf5e-44e9-86e0-9ec71ae2f703 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:37.712220 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3411a-bf5e-44e9-86e0-9ec71ae2f703 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:37.719811 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-4ac3411a-bf5e-44e9-86e0-9ec71ae2f703 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:01:37.726097 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 257/507] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:37 2021] GET /identity/v3/roles/service => generated 85 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:37.728552 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bf62d-43fd-4f29-9a43-e143d006ccd0 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:37.738044 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750bf62d-43fd-4f29-9a43-e143d006ccd0 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:37.746078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512c0a51-8caf-4f19-9100-4ca102f04eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:37.747018 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c0a51-8caf-4f19-9100-4ca102f04eae admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:37.747501 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c0a51-8caf-4f19-9100-4ca102f04eae admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:37.747971 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512c0a51-8caf-4f19-9100-4ca102f04eae admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:37.748970 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c0a51-8caf-4f19-9100-4ca102f04eae admin admin] RBAC: Adding query filter params (name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:37.749474 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c0a51-8caf-4f19-9100-4ca102f04eae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:37.751336 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512c0a51-8caf-4f19-9100-4ca102f04eae admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:37.772446 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 251/508] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:01:37 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:37.783774 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3411a-bf5e-44e9-86e0-9ec71ae2f703 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:37.794912 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3411a-bf5e-44e9-86e0-9ec71ae2f703 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:37.806617 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ca8fb-b1db-421b-81da-81702869b352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:37.807791 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ca8fb-b1db-421b-81da-81702869b352 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:37.808271 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ca8fb-b1db-421b-81da-81702869b352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:37.808755 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ca8fb-b1db-421b-81da-81702869b352 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:37.825384 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ca8fb-b1db-421b-81da-81702869b352 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:37.827920 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ca8fb-b1db-421b-81da-81702869b352 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:37.847132 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796f487-cbf9-4cf4-a8c3-eca84e298f09 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:37.847745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796f487-cbf9-4cf4-a8c3-eca84e298f09 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:37.848322 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796f487-cbf9-4cf4-a8c3-eca84e298f09 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:37.850325 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 252/509] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:37 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:01:37.856542 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851f88b-9341-4545-8ee8-167cacc8edc7 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:37.856832 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851f88b-9341-4545-8ee8-167cacc8edc7 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:37.857114 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851f88b-9341-4545-8ee8-167cacc8edc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:37.858299 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-9f2ca8fb-b1db-421b-81da-81702869b352 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:37.860070 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 258/510] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:37.870054 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ca8fb-b1db-421b-81da-81702869b352 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:37.883179 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ca8fb-b1db-421b-81da-81702869b352 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:37.888355 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-5851f88b-9341-4545-8ee8-167cacc8edc7 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:37.889622 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-5851f88b-9341-4545-8ee8-167cacc8edc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:37.895771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee618f-5ead-47ec-b382-d3c7e741bbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:37.896469 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee618f-5ead-47ec-b382-d3c7e741bbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:37.896752 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee618f-5ead-47ec-b382-d3c7e741bbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:37.897026 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee618f-5ead-47ec-b382-d3c7e741bbd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:37.897789 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee618f-5ead-47ec-b382-d3c7e741bbd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:37.898130 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee618f-5ead-47ec-b382-d3c7e741bbd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:37.899778 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ee618f-5ead-47ec-b382-d3c7e741bbd4 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:37.919431 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 259/511] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:37.921638 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 253/512] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:37 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:37.929314 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee618f-5ead-47ec-b382-d3c7e741bbd4 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:37.944172 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee618f-5ead-47ec-b382-d3c7e741bbd4 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:37.953789 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961011b1-14b6-4c0b-92a0-87b1d201c386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:37.955293 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961011b1-14b6-4c0b-92a0-87b1d201c386 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:37.955579 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961011b1-14b6-4c0b-92a0-87b1d201c386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:37.955856 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961011b1-14b6-4c0b-92a0-87b1d201c386 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:37.970994 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961011b1-14b6-4c0b-92a0-87b1d201c386 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:37.975156 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961011b1-14b6-4c0b-92a0-87b1d201c386 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:37.997449 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851f88b-9341-4545-8ee8-167cacc8edc7 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.002513 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-961011b1-14b6-4c0b-92a0-87b1d201c386 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 29 16:01:38.004102 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 260/513] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:37 2021] GET /identity/v3/users/glance => generated 84 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:38.010566 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961011b1-14b6-4c0b-92a0-87b1d201c386 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.013470 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5851f88b-9341-4545-8ee8-167cacc8edc7 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.022937 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacab16-8877-438c-88e7-78c13e372d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.024454 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacab16-8877-438c-88e7-78c13e372d6b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.025009 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacab16-8877-438c-88e7-78c13e372d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.025523 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eacab16-8877-438c-88e7-78c13e372d6b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.025843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961011b1-14b6-4c0b-92a0-87b1d201c386 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.035900 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8139e-b911-479c-a947-f62226ddd860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.037007 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8139e-b911-479c-a947-f62226ddd860 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.038362 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8139e-b911-479c-a947-f62226ddd860 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.038871 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e8139e-b911-479c-a947-f62226ddd860 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.040679 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8139e-b911-479c-a947-f62226ddd860 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:38.041691 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8139e-b911-479c-a947-f62226ddd860 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.046348 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e8139e-b911-479c-a947-f62226ddd860 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.052871 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eacab16-8877-438c-88e7-78c13e372d6b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:38.069712 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-6eacab16-8877-438c-88e7-78c13e372d6b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:01:38.072512 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 254/514] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:37 2021] GET /identity/v3/roles/service => generated 85 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:38.079280 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacab16-8877-438c-88e7-78c13e372d6b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.089408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 261/515] 10.222.0.41 () {56 vars in 1158 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:38.094223 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8139e-b911-479c-a947-f62226ddd860 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.095165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eacab16-8877-438c-88e7-78c13e372d6b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.110321 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ffefb-bad7-427a-9d79-dc4d08396172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.111444 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ffefb-bad7-427a-9d79-dc4d08396172 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.111923 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ffefb-bad7-427a-9d79-dc4d08396172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.112420 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ffefb-bad7-427a-9d79-dc4d08396172 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.113419 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ffefb-bad7-427a-9d79-dc4d08396172 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:38.114375 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e8139e-b911-479c-a947-f62226ddd860 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.114921 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ffefb-bad7-427a-9d79-dc4d08396172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.119385 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ffefb-bad7-427a-9d79-dc4d08396172 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.127435 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104b31d-87c6-40ff-a521-27f9b43b6d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.129090 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104b31d-87c6-40ff-a521-27f9b43b6d13 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.130604 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104b31d-87c6-40ff-a521-27f9b43b6d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.131099 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104b31d-87c6-40ff-a521-27f9b43b6d13 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.140647 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 255/516] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:38.147684 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ffefb-bad7-427a-9d79-dc4d08396172 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.149178 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104b31d-87c6-40ff-a521-27f9b43b6d13 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.156784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104b31d-87c6-40ff-a521-27f9b43b6d13 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.164236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ffefb-bad7-427a-9d79-dc4d08396172 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.176664 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2895f-29b5-49ef-bd40-08a05a2c223d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.177997 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2895f-29b5-49ef-bd40-08a05a2c223d admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.179076 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 262/517] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:38.179402 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2895f-29b5-49ef-bd40-08a05a2c223d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.179875 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc2895f-29b5-49ef-bd40-08a05a2c223d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.185173 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104b31d-87c6-40ff-a521-27f9b43b6d13 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.202828 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104b31d-87c6-40ff-a521-27f9b43b6d13 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.205896 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2895f-29b5-49ef-bd40-08a05a2c223d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.209369 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc2895f-29b5-49ef-bd40-08a05a2c223d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.213443 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82670e61-4c49-40a7-bb90-a7cb6a8fc245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.215103 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82670e61-4c49-40a7-bb90-a7cb6a8fc245 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.216469 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82670e61-4c49-40a7-bb90-a7cb6a8fc245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.217396 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82670e61-4c49-40a7-bb90-a7cb6a8fc245 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.240184 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82670e61-4c49-40a7-bb90-a7cb6a8fc245 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.242446 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82670e61-4c49-40a7-bb90-a7cb6a8fc245 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.251067 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-4fc2895f-29b5-49ef-bd40-08a05a2c223d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:38.253157 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 256/518] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:38.259837 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2895f-29b5-49ef-bd40-08a05a2c223d admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.264341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-82670e61-4c49-40a7-bb90-a7cb6a8fc245 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:38.266214 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 263/519] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:38.283356 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82670e61-4c49-40a7-bb90-a7cb6a8fc245 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.293869 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc2895f-29b5-49ef-bd40-08a05a2c223d admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.295131 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82670e61-4c49-40a7-bb90-a7cb6a8fc245 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.300641 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ca673-7d24-445a-97d4-4019d5d31927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.301618 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ca673-7d24-445a-97d4-4019d5d31927 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.302256 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ca673-7d24-445a-97d4-4019d5d31927 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.302809 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578ca673-7d24-445a-97d4-4019d5d31927 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.303891 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ca673-7d24-445a-97d4-4019d5d31927 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:38.304409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ca673-7d24-445a-97d4-4019d5d31927 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.306455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578ca673-7d24-445a-97d4-4019d5d31927 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.313158 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07674d-489e-4f5b-8ae1-43ad344bd566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.314812 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07674d-489e-4f5b-8ae1-43ad344bd566 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.315515 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07674d-489e-4f5b-8ae1-43ad344bd566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.315822 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c07674d-489e-4f5b-8ae1-43ad344bd566 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.316959 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07674d-489e-4f5b-8ae1-43ad344bd566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:38.317467 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07674d-489e-4f5b-8ae1-43ad344bd566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.320358 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c07674d-489e-4f5b-8ae1-43ad344bd566 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.322088 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 264/520] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:38.332708 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ca673-7d24-445a-97d4-4019d5d31927 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.344195 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578ca673-7d24-445a-97d4-4019d5d31927 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.349707 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44698045-d36a-43a4-9d26-15d74fd8392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.350994 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44698045-d36a-43a4-9d26-15d74fd8392a admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.351520 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44698045-d36a-43a4-9d26-15d74fd8392a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.351991 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44698045-d36a-43a4-9d26-15d74fd8392a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.362280 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44698045-d36a-43a4-9d26-15d74fd8392a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.364446 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 257/521] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:38.365049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44698045-d36a-43a4-9d26-15d74fd8392a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.370664 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07674d-489e-4f5b-8ae1-43ad344bd566 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.381543 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-44698045-d36a-43a4-9d26-15d74fd8392a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:38.383551 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 265/522] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:38.391231 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44698045-d36a-43a4-9d26-15d74fd8392a admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.401172 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c07674d-489e-4f5b-8ae1-43ad344bd566 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.403548 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44698045-d36a-43a4-9d26-15d74fd8392a admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.410286 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda722db-4154-4361-998f-1db5fa0d4c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.411732 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda722db-4154-4361-998f-1db5fa0d4c1e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.412489 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda722db-4154-4361-998f-1db5fa0d4c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.413150 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda722db-4154-4361-998f-1db5fa0d4c1e admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.414817 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda722db-4154-4361-998f-1db5fa0d4c1e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:38.415584 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda722db-4154-4361-998f-1db5fa0d4c1e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.419192 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f85b9-4cf5-485d-8040-23043d80c76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.419825 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda722db-4154-4361-998f-1db5fa0d4c1e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.420572 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f85b9-4cf5-485d-8040-23043d80c76a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.421105 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f85b9-4cf5-485d-8040-23043d80c76a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.421736 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61f85b9-4cf5-485d-8040-23043d80c76a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.441610 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f85b9-4cf5-485d-8040-23043d80c76a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.445883 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61f85b9-4cf5-485d-8040-23043d80c76a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.446671 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 266/523] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:38.456241 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda722db-4154-4361-998f-1db5fa0d4c1e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.487844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda722db-4154-4361-998f-1db5fa0d4c1e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.491730 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-b61f85b9-4cf5-485d-8040-23043d80c76a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 16:01:38.493654 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 258/524] 10.222.0.41 () {56 vars in 1114 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:38.500258 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f85b9-4cf5-485d-8040-23043d80c76a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.503768 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2109a3-c44b-4203-ab1c-233245af39fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.504453 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2109a3-c44b-4203-ab1c-233245af39fd admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.504738 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2109a3-c44b-4203-ab1c-233245af39fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.505009 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2109a3-c44b-4203-ab1c-233245af39fd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.505872 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2109a3-c44b-4203-ab1c-233245af39fd admin admin] RBAC: Adding query filter params (role.id=01b3b9b5c0d846968d6a5219373998f8, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=e27a0c9ae2bf40caa92e9dbceff8d68b) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:38.506211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2109a3-c44b-4203-ab1c-233245af39fd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.508313 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2109a3-c44b-4203-ab1c-233245af39fd admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.515301 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 267/525] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/role_assignments?user.id=e27a0c9ae2bf40caa92e9dbceff8d68b&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=01b3b9b5c0d846968d6a5219373998f8 => generated 608 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:38.524788 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61f85b9-4cf5-485d-8040-23043d80c76a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.540444 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2e2a8-89a5-41ef-b205-4f23493b0fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.541606 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2e2a8-89a5-41ef-b205-4f23493b0fd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.542113 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2e2a8-89a5-41ef-b205-4f23493b0fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.542585 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2e2a8-89a5-41ef-b205-4f23493b0fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.544173 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2e2a8-89a5-41ef-b205-4f23493b0fd8 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:38.544753 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2e2a8-89a5-41ef-b205-4f23493b0fd8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.548898 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2e2a8-89a5-41ef-b205-4f23493b0fd8 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.588694 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 259/526] 10.222.0.41 () {56 vars in 1154 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:38.594799 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2109a3-c44b-4203-ab1c-233245af39fd admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.619207 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2109a3-c44b-4203-ab1c-233245af39fd admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.636792 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbcf74-69f3-4a28-beb5-b030751d45bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.638004 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbcf74-69f3-4a28-beb5-b030751d45bb admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.638423 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbcf74-69f3-4a28-beb5-b030751d45bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.638830 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbcf74-69f3-4a28-beb5-b030751d45bb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.658729 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbcf74-69f3-4a28-beb5-b030751d45bb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.660573 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbcf74-69f3-4a28-beb5-b030751d45bb admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.678212 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 268/527] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:38.684636 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2e2a8-89a5-41ef-b205-4f23493b0fd8 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.708578 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2e2a8-89a5-41ef-b205-4f23493b0fd8 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.718115 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1d4db-841a-43ad-b83b-28c0618df96f None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.718453 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1d4db-841a-43ad-b83b-28c0618df96f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.718551 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eac7b1-f31c-40ae-aea4-73a3d208a6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.718746 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1d4db-841a-43ad-b83b-28c0618df96f None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.719255 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eac7b1-f31c-40ae-aea4-73a3d208a6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.719531 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eac7b1-f31c-40ae-aea4-73a3d208a6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.719796 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eac7b1-f31c-40ae-aea4-73a3d208a6b6 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.721242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 269/528] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:01:38.727256 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3a313-1ed0-4695-a742-c0f3365db8da None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.727544 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3a313-1ed0-4695-a742-c0f3365db8da None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.727825 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3a313-1ed0-4695-a742-c0f3365db8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.739440 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eac7b1-f31c-40ae-aea4-73a3d208a6b6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.741321 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eac7b1-f31c-40ae-aea4-73a3d208a6b6 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.768539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-86e3a313-1ed0-4695-a742-c0f3365db8da None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:38.770089 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-86e3a313-1ed0-4695-a742-c0f3365db8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:38.778595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-02eac7b1-f31c-40ae-aea4-73a3d208a6b6 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:38.780155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 260/529] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:38.786587 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eac7b1-f31c-40ae-aea4-73a3d208a6b6 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.796374 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 270/530] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:38.802029 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eac7b1-f31c-40ae-aea4-73a3d208a6b6 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.806614 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca459eac-617c-4633-a29a-27f611e626ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.807440 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca459eac-617c-4633-a29a-27f611e626ad admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.807769 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca459eac-617c-4633-a29a-27f611e626ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.808042 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca459eac-617c-4633-a29a-27f611e626ad admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.808889 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca459eac-617c-4633-a29a-27f611e626ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:38.809266 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca459eac-617c-4633-a29a-27f611e626ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.811928 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca459eac-617c-4633-a29a-27f611e626ad admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.824947 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 261/531] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:38.831880 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3a313-1ed0-4695-a742-c0f3365db8da None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.836093 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca459eac-617c-4633-a29a-27f611e626ad admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.844817 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3a313-1ed0-4695-a742-c0f3365db8da None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.846629 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca459eac-617c-4633-a29a-27f611e626ad admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.850076 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a83ade-d3aa-48dc-8915-7e36cb4e15d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.850898 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a83ade-d3aa-48dc-8915-7e36cb4e15d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.851179 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a83ade-d3aa-48dc-8915-7e36cb4e15d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.851456 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a83ade-d3aa-48dc-8915-7e36cb4e15d2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.852994 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2dd42c-f935-4486-8a08-e45dbf4f6fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.853961 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dd42c-f935-4486-8a08-e45dbf4f6fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.854254 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dd42c-f935-4486-8a08-e45dbf4f6fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.854529 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2dd42c-f935-4486-8a08-e45dbf4f6fb4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.860083 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a83ade-d3aa-48dc-8915-7e36cb4e15d2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.864436 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a83ade-d3aa-48dc-8915-7e36cb4e15d2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.868095 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2dd42c-f935-4486-8a08-e45dbf4f6fb4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:38.875728 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-5c2dd42c-f935-4486-8a08-e45dbf4f6fb4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:01:38.882016 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-a1a83ade-d3aa-48dc-8915-7e36cb4e15d2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:38.882016 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 271/532] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:38.882276 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 262/533] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:38.889243 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a83ade-d3aa-48dc-8915-7e36cb4e15d2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.891006 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2dd42c-f935-4486-8a08-e45dbf4f6fb4 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.903001 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2dd42c-f935-4486-8a08-e45dbf4f6fb4 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.904458 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a83ade-d3aa-48dc-8915-7e36cb4e15d2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.908963 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e778c6-0e9b-44a5-8c6d-723a7cfd0f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.909748 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e778c6-0e9b-44a5-8c6d-723a7cfd0f2d admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.910152 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e778c6-0e9b-44a5-8c6d-723a7cfd0f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.910509 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565698d-8a08-4b4c-ad16-300d53e613e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.910626 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e778c6-0e9b-44a5-8c6d-723a7cfd0f2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.911468 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e778c6-0e9b-44a5-8c6d-723a7cfd0f2d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:38.911588 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565698d-8a08-4b4c-ad16-300d53e613e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.911852 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e778c6-0e9b-44a5-8c6d-723a7cfd0f2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.912273 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565698d-8a08-4b4c-ad16-300d53e613e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.912725 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565698d-8a08-4b4c-ad16-300d53e613e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.914075 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565698d-8a08-4b4c-ad16-300d53e613e2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:38.914186 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e778c6-0e9b-44a5-8c6d-723a7cfd0f2d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.914686 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565698d-8a08-4b4c-ad16-300d53e613e2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.916725 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565698d-8a08-4b4c-ad16-300d53e613e2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.932795 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 263/534] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:38.934481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e778c6-0e9b-44a5-8c6d-723a7cfd0f2d admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.937964 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 272/535] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:38.947207 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565698d-8a08-4b4c-ad16-300d53e613e2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:38.947402 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e778c6-0e9b-44a5-8c6d-723a7cfd0f2d admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.952195 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb632ac-b178-4e35-ae9d-63d90c4ab49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.953029 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb632ac-b178-4e35-ae9d-63d90c4ab49a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.953348 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb632ac-b178-4e35-ae9d-63d90c4ab49a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.953639 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb632ac-b178-4e35-ae9d-63d90c4ab49a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.959816 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565698d-8a08-4b4c-ad16-300d53e613e2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:38.966157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb614d7-3a04-4c4d-a193-6cf4592596a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:38.967165 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb614d7-3a04-4c4d-a193-6cf4592596a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:38.967435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb632ac-b178-4e35-ae9d-63d90c4ab49a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.967835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb614d7-3a04-4c4d-a193-6cf4592596a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:38.968283 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb614d7-3a04-4c4d-a193-6cf4592596a2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:38.969297 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb614d7-3a04-4c4d-a193-6cf4592596a2 admin admin] RBAC: Adding query filter params (role.id=01b3b9b5c0d846968d6a5219373998f8, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=4f13d0e9f79a433c81759ecd819a6dfa) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:38.969720 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb632ac-b178-4e35-ae9d-63d90c4ab49a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.970515 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb614d7-3a04-4c4d-a193-6cf4592596a2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:38.972740 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb614d7-3a04-4c4d-a193-6cf4592596a2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:38.980248 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 273/536] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/role_assignments?user.id=4f13d0e9f79a433c81759ecd819a6dfa&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=01b3b9b5c0d846968d6a5219373998f8 => generated 608 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:38.996574 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-3fb632ac-b178-4e35-ae9d-63d90c4ab49a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:38.998646 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 264/537] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:39.004869 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb614d7-3a04-4c4d-a193-6cf4592596a2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:39.020529 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb614d7-3a04-4c4d-a193-6cf4592596a2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:39.027210 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71b65c-06b2-4015-ae3c-5ec02f6b15f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:39.028199 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71b65c-06b2-4015-ae3c-5ec02f6b15f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:39.028657 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71b65c-06b2-4015-ae3c-5ec02f6b15f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:39.029128 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71b65c-06b2-4015-ae3c-5ec02f6b15f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:39.030143 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71b65c-06b2-4015-ae3c-5ec02f6b15f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:39.030641 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71b65c-06b2-4015-ae3c-5ec02f6b15f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:39.032505 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71b65c-06b2-4015-ae3c-5ec02f6b15f4 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:39.048058 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 274/538] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:39.054734 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb632ac-b178-4e35-ae9d-63d90c4ab49a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:39.066017 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb632ac-b178-4e35-ae9d-63d90c4ab49a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:39.077071 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18aba1-cbc6-4974-ae74-364ec6902139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:39.078278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18aba1-cbc6-4974-ae74-364ec6902139 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:39.078738 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18aba1-cbc6-4974-ae74-364ec6902139 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:39.079189 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18aba1-cbc6-4974-ae74-364ec6902139 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:39.089768 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18aba1-cbc6-4974-ae74-364ec6902139 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:39.092209 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18aba1-cbc6-4974-ae74-364ec6902139 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:39.110153 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-8e18aba1-cbc6-4974-ae74-364ec6902139 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 29 16:01:39.112104 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 265/539] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:39 2021] GET /identity/v3/users/swift => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:39.118282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71b65c-06b2-4015-ae3c-5ec02f6b15f4 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:39.128909 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71b65c-06b2-4015-ae3c-5ec02f6b15f4 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:39.136769 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088ed75-ed39-4e77-80e4-6c103b4b9caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:39.137467 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088ed75-ed39-4e77-80e4-6c103b4b9caa admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:39.137753 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088ed75-ed39-4e77-80e4-6c103b4b9caa admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:39.138122 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088ed75-ed39-4e77-80e4-6c103b4b9caa admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:39.139006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088ed75-ed39-4e77-80e4-6c103b4b9caa admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:39.139320 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088ed75-ed39-4e77-80e4-6c103b4b9caa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:39.141207 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9088ed75-ed39-4e77-80e4-6c103b4b9caa admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:39.169511 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 275/540] 10.222.0.41 () {56 vars in 1156 bytes} [Fri Oct 29 16:01:39 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:39.175925 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18aba1-cbc6-4974-ae74-364ec6902139 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:39.186842 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18aba1-cbc6-4974-ae74-364ec6902139 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:39.197680 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23535514-42ef-407c-8a3c-ebdb96affaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:39.198792 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23535514-42ef-407c-8a3c-ebdb96affaae admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:39.199223 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23535514-42ef-407c-8a3c-ebdb96affaae admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:39.199635 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23535514-42ef-407c-8a3c-ebdb96affaae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:39.213959 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23535514-42ef-407c-8a3c-ebdb96affaae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:39.216378 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23535514-42ef-407c-8a3c-ebdb96affaae admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:39.238284 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-23535514-42ef-407c-8a3c-ebdb96affaae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:39.240213 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 266/541] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:39.248944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088ed75-ed39-4e77-80e4-6c103b4b9caa admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:39.263543 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088ed75-ed39-4e77-80e4-6c103b4b9caa admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:39.272926 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ad22-587d-4b19-9cb2-5ee92c186bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:39.274268 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ad22-587d-4b19-9cb2-5ee92c186bd8 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:39.274941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ad22-587d-4b19-9cb2-5ee92c186bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:39.275488 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002ad22-587d-4b19-9cb2-5ee92c186bd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:39.277209 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002ad22-587d-4b19-9cb2-5ee92c186bd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:39.277873 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002ad22-587d-4b19-9cb2-5ee92c186bd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:39.281186 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002ad22-587d-4b19-9cb2-5ee92c186bd8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:39.308242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 276/542] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:39.314592 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23535514-42ef-407c-8a3c-ebdb96affaae admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:39.325846 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23535514-42ef-407c-8a3c-ebdb96affaae admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:39.333705 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e169d7f-25d7-431a-b7a8-ccf3b63b54f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:39.334947 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e169d7f-25d7-431a-b7a8-ccf3b63b54f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:39.335497 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e169d7f-25d7-431a-b7a8-ccf3b63b54f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:39.336008 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e169d7f-25d7-431a-b7a8-ccf3b63b54f8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:39.346738 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e169d7f-25d7-431a-b7a8-ccf3b63b54f8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:39.349428 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e169d7f-25d7-431a-b7a8-ccf3b63b54f8 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:39.365055 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-6e169d7f-25d7-431a-b7a8-ccf3b63b54f8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:39.367311 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 267/543] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:39.375890 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ad22-587d-4b19-9cb2-5ee92c186bd8 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:39.396850 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002ad22-587d-4b19-9cb2-5ee92c186bd8 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:39.403073 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5f442-837c-47dd-a459-3ba2c7607c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:39.403852 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5f442-837c-47dd-a459-3ba2c7607c6a admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:39.404130 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5f442-837c-47dd-a459-3ba2c7607c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:39.404400 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5f442-837c-47dd-a459-3ba2c7607c6a admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:39.405345 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5f442-837c-47dd-a459-3ba2c7607c6a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:39.405651 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5f442-837c-47dd-a459-3ba2c7607c6a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:39.408365 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5f442-837c-47dd-a459-3ba2c7607c6a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:39.409572 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf65613-a669-46f5-8aa8-fcc2c5a9204f None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:39.410319 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf65613-a669-46f5-8aa8-fcc2c5a9204f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:39.411034 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf65613-a669-46f5-8aa8-fcc2c5a9204f None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:39.415645 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 268/544] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:39 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:39.427623 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38168dd3-bf17-4976-a01d-a6aab9af6ba9 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:39.428830 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38168dd3-bf17-4976-a01d-a6aab9af6ba9 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:39.429511 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38168dd3-bf17-4976-a01d-a6aab9af6ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:39.432132 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 277/545] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:39.438847 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5f442-837c-47dd-a459-3ba2c7607c6a admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:39.455377 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5f442-837c-47dd-a459-3ba2c7607c6a admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:39.460080 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-38168dd3-bf17-4976-a01d-a6aab9af6ba9 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:39.462139 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-38168dd3-bf17-4976-a01d-a6aab9af6ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:39.462581 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c5ae-dc03-441f-8ff8-1c3df3bb7f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:39.463950 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c5ae-dc03-441f-8ff8-1c3df3bb7f1c admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:39.463950 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c5ae-dc03-441f-8ff8-1c3df3bb7f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:39.464116 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c5ae-dc03-441f-8ff8-1c3df3bb7f1c admin admin] PATH_INFO: `/v3/projects/4939afba2b604181b67577f309c9550a/users/f518ae309c4b4f7eacca882b58e58bd0/roles/01b3b9b5c0d846968d6a5219373998f8` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:39.476649 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 269/546] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:39.494809 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7c5ae-dc03-441f-8ff8-1c3df3bb7f1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4939afba2b604181b67577f309c9550a, user_id=f518ae309c4b4f7eacca882b58e58bd0, role_id=01b3b9b5c0d846968d6a5219373998f8)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:39.500198 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7c5ae-dc03-441f-8ff8-1c3df3bb7f1c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:39.519937 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38168dd3-bf17-4976-a01d-a6aab9af6ba9 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:39.527642 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 278/547] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:01:39 2021] PUT /identity/v3/projects/4939afba2b604181b67577f309c9550a/users/f518ae309c4b4f7eacca882b58e58bd0/roles/01b3b9b5c0d846968d6a5219373998f8 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:01:39.537721 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38168dd3-bf17-4976-a01d-a6aab9af6ba9 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:39.643695 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a121e8a-f9b1-4471-8e6c-3a418fb31b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:39.645643 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a121e8a-f9b1-4471-8e6c-3a418fb31b9d admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:39.646500 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a121e8a-f9b1-4471-8e6c-3a418fb31b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:39.647115 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a121e8a-f9b1-4471-8e6c-3a418fb31b9d admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:39.661230 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a121e8a-f9b1-4471-8e6c-3a418fb31b9d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:39.668905 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-2a121e8a-f9b1-4471-8e6c-3a418fb31b9d admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:01:39.670761 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 270/548] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:39 2021] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:39.682080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c5ae-dc03-441f-8ff8-1c3df3bb7f1c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:39.708613 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c5ae-dc03-441f-8ff8-1c3df3bb7f1c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:39.724269 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca3743-6303-4193-b650-a4b1668cdabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:39.724970 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca3743-6303-4193-b650-a4b1668cdabe admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:39.725255 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca3743-6303-4193-b650-a4b1668cdabe admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:39.725534 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ca3743-6303-4193-b650-a4b1668cdabe admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:39.726348 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca3743-6303-4193-b650-a4b1668cdabe admin admin] RBAC: Adding query filter params (name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:39.726655 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca3743-6303-4193-b650-a4b1668cdabe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:39.728257 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ca3743-6303-4193-b650-a4b1668cdabe admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:39.745426 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 279/549] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:01:39 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:39.748870 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa17c7-54b8-4235-82b3-441a24bd8d67 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:39.749183 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa17c7-54b8-4235-82b3-441a24bd8d67 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:39.749429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa17c7-54b8-4235-82b3-441a24bd8d67 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:39.751775 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 271/550] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:39.751913 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca3743-6303-4193-b650-a4b1668cdabe admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:39.758909 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da83b9d-0858-4533-82e3-c2df6c7201cb None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:39.759221 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da83b9d-0858-4533-82e3-c2df6c7201cb None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:39.759466 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da83b9d-0858-4533-82e3-c2df6c7201cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:39.780518 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-5da83b9d-0858-4533-82e3-c2df6c7201cb None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:39.781500 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ca3743-6303-4193-b650-a4b1668cdabe admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:39.781750 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-5da83b9d-0858-4533-82e3-c2df6c7201cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:39.792903 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078e6c0-2296-4d6e-802f-078ecc3fd395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:39.795333 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078e6c0-2296-4d6e-802f-078ecc3fd395 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:39.795621 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078e6c0-2296-4d6e-802f-078ecc3fd395 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:39.795895 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078e6c0-2296-4d6e-802f-078ecc3fd395 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:39.802212 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 272/551] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:39.813565 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078e6c0-2296-4d6e-802f-078ecc3fd395 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:39.815570 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078e6c0-2296-4d6e-802f-078ecc3fd395 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:39.871731 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da83b9d-0858-4533-82e3-c2df6c7201cb None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:39.881470 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da83b9d-0858-4533-82e3-c2df6c7201cb None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:39.890874 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e152b6-011d-4a3e-89b1-a8362a19ba84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:39.891742 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e152b6-011d-4a3e-89b1-a8362a19ba84 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:39.892567 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e152b6-011d-4a3e-89b1-a8362a19ba84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:39.892840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e152b6-011d-4a3e-89b1-a8362a19ba84 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:39.905350 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e152b6-011d-4a3e-89b1-a8362a19ba84 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:39.915256 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-26e152b6-011d-4a3e-89b1-a8362a19ba84 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:01:39.921735 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 273/552] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:39 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:39.923661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e152b6-011d-4a3e-89b1-a8362a19ba84 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:39.934319 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e152b6-011d-4a3e-89b1-a8362a19ba84 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:39.939893 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b3677-da49-4358-ba86-a677aa83e027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:39.940579 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b3677-da49-4358-ba86-a677aa83e027 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:39.940857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b3677-da49-4358-ba86-a677aa83e027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:39.941225 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b3677-da49-4358-ba86-a677aa83e027 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:39.942046 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b3677-da49-4358-ba86-a677aa83e027 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:39.942358 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b3677-da49-4358-ba86-a677aa83e027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:39.944189 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b3677-da49-4358-ba86-a677aa83e027 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:39.958727 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-4078e6c0-2296-4d6e-802f-078ecc3fd395 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:39.960184 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 280/554] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:39.960356 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 274/554] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:01:39 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:39.966226 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078e6c0-2296-4d6e-802f-078ecc3fd395 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:39.966433 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b3677-da49-4358-ba86-a677aa83e027 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:39.980315 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b3677-da49-4358-ba86-a677aa83e027 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:39.983112 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078e6c0-2296-4d6e-802f-078ecc3fd395 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:39.989780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61404a-4e49-4777-bb2c-a30b6c127fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:39.990468 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61404a-4e49-4777-bb2c-a30b6c127fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:39.990755 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61404a-4e49-4777-bb2c-a30b6c127fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:39.991032 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61404a-4e49-4777-bb2c-a30b6c127fa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:39.991772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61404a-4e49-4777-bb2c-a30b6c127fa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:39.992075 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61404a-4e49-4777-bb2c-a30b6c127fa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:39.993675 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61404a-4e49-4777-bb2c-a30b6c127fa0 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:39.995079 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa33212-c918-4b12-b877-9334558fa0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:39.995861 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa33212-c918-4b12-b877-9334558fa0b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:39.996132 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa33212-c918-4b12-b877-9334558fa0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:39.996396 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa33212-c918-4b12-b877-9334558fa0b8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:40.014977 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa33212-c918-4b12-b877-9334558fa0b8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:40.017363 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa33212-c918-4b12-b877-9334558fa0b8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:40.021288 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 275/555] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:40.034148 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61404a-4e49-4777-bb2c-a30b6c127fa0 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:40.045447 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61404a-4e49-4777-bb2c-a30b6c127fa0 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:40.048514 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-4fa33212-c918-4b12-b877-9334558fa0b8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:40.050019 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 281/556] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:40.050195 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8d40f-3669-4ad8-a922-9cede4558caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:40.050963 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8d40f-3669-4ad8-a922-9cede4558caf admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:40.051288 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8d40f-3669-4ad8-a922-9cede4558caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:40.051563 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8d40f-3669-4ad8-a922-9cede4558caf admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:40.055952 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa33212-c918-4b12-b877-9334558fa0b8 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:40.066169 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8d40f-3669-4ad8-a922-9cede4558caf admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:40.068255 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8d40f-3669-4ad8-a922-9cede4558caf admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:40.075807 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa33212-c918-4b12-b877-9334558fa0b8 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:40.085866 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17c24e-f3df-4525-b050-89f6ad32dbc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:40.087687 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17c24e-f3df-4525-b050-89f6ad32dbc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:40.087967 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17c24e-f3df-4525-b050-89f6ad32dbc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:40.089747 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17c24e-f3df-4525-b050-89f6ad32dbc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:40.090562 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17c24e-f3df-4525-b050-89f6ad32dbc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:40.090875 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17c24e-f3df-4525-b050-89f6ad32dbc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:40.094583 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17c24e-f3df-4525-b050-89f6ad32dbc8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:40.098362 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-f0a8d40f-3669-4ad8-a922-9cede4558caf admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 29 16:01:40.099738 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 276/557] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:40 2021] GET /identity/v3/users/neutron => generated 85 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:40.106772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8d40f-3669-4ad8-a922-9cede4558caf admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:40.119287 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 282/558] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:40.121781 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8d40f-3669-4ad8-a922-9cede4558caf admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:40.125358 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17c24e-f3df-4525-b050-89f6ad32dbc8 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:40.134430 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e1ae6-86c7-4cef-8f78-f8f44f9eacab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:40.136189 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e1ae6-86c7-4cef-8f78-f8f44f9eacab admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:40.136472 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e1ae6-86c7-4cef-8f78-f8f44f9eacab admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:40.136743 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e1ae6-86c7-4cef-8f78-f8f44f9eacab admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:40.139911 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17c24e-f3df-4525-b050-89f6ad32dbc8 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:40.140112 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e1ae6-86c7-4cef-8f78-f8f44f9eacab admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:40.140337 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e1ae6-86c7-4cef-8f78-f8f44f9eacab admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:40.143245 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e1ae6-86c7-4cef-8f78-f8f44f9eacab admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:40.152834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12b2c4-21a7-4d81-b424-77412be5ec15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:40.153722 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12b2c4-21a7-4d81-b424-77412be5ec15 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:40.154027 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12b2c4-21a7-4d81-b424-77412be5ec15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:40.154303 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12b2c4-21a7-4d81-b424-77412be5ec15 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:40.173770 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12b2c4-21a7-4d81-b424-77412be5ec15 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:40.173958 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 277/559] 10.222.0.41 () {56 vars in 1160 bytes} [Fri Oct 29 16:01:40 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:40.174074 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12b2c4-21a7-4d81-b424-77412be5ec15 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:40.179258 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e1ae6-86c7-4cef-8f78-f8f44f9eacab admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:40.189580 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e1ae6-86c7-4cef-8f78-f8f44f9eacab admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:40.194186 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-dd12b2c4-21a7-4d81-b424-77412be5ec15 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 16:01:40.194306 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413adc7-0fbd-4de4-89dc-64ab3772b0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:40.194830 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413adc7-0fbd-4de4-89dc-64ab3772b0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:40.195160 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413adc7-0fbd-4de4-89dc-64ab3772b0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:40.195438 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413adc7-0fbd-4de4-89dc-64ab3772b0b7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:40.198056 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 283/560] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:40 2021] GET /identity/v3/users/cinder => generated 84 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:40.212981 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12b2c4-21a7-4d81-b424-77412be5ec15 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:40.221832 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413adc7-0fbd-4de4-89dc-64ab3772b0b7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:40.224683 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413adc7-0fbd-4de4-89dc-64ab3772b0b7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:40.228172 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12b2c4-21a7-4d81-b424-77412be5ec15 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:40.236547 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fadfe2-85d3-484c-99c8-dd0e21834653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:40.237216 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fadfe2-85d3-484c-99c8-dd0e21834653 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:40.237503 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fadfe2-85d3-484c-99c8-dd0e21834653 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:40.238132 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fadfe2-85d3-484c-99c8-dd0e21834653 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:40.240212 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fadfe2-85d3-484c-99c8-dd0e21834653 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:40.240531 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fadfe2-85d3-484c-99c8-dd0e21834653 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:40.244412 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fadfe2-85d3-484c-99c8-dd0e21834653 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:40.244551 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 278/561] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:40.252194 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413adc7-0fbd-4de4-89dc-64ab3772b0b7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:40.270556 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 284/562] 10.222.0.41 () {56 vars in 1158 bytes} [Fri Oct 29 16:01:40 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:40.274045 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413adc7-0fbd-4de4-89dc-64ab3772b0b7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:40.276669 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fadfe2-85d3-484c-99c8-dd0e21834653 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:40.286733 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06154b31-cb0c-44ff-9694-0850ac2ba829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:40.287873 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06154b31-cb0c-44ff-9694-0850ac2ba829 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:40.288432 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06154b31-cb0c-44ff-9694-0850ac2ba829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:40.289640 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06154b31-cb0c-44ff-9694-0850ac2ba829 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:40.291535 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fadfe2-85d3-484c-99c8-dd0e21834653 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:40.302559 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa9c93-8d34-4698-9671-ac1268691503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:40.303420 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa9c93-8d34-4698-9671-ac1268691503 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:40.303804 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa9c93-8d34-4698-9671-ac1268691503 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:40.304078 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aa9c93-8d34-4698-9671-ac1268691503 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:40.309882 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06154b31-cb0c-44ff-9694-0850ac2ba829 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:40.315094 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06154b31-cb0c-44ff-9694-0850ac2ba829 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:40.323141 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa9c93-8d34-4698-9671-ac1268691503 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:40.328045 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aa9c93-8d34-4698-9671-ac1268691503 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:40.348994 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 285/563] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:40 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:40.350748 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa9c93-8d34-4698-9671-ac1268691503 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:40.355079 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-06154b31-cb0c-44ff-9694-0850ac2ba829 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:40.356498 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 279/564] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:40.361368 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aa9c93-8d34-4698-9671-ac1268691503 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:40.363665 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06154b31-cb0c-44ff-9694-0850ac2ba829 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:40.376804 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db16b0a-8d8c-45cc-ac1a-bf26e33ffdb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:40.378184 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06154b31-cb0c-44ff-9694-0850ac2ba829 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:40.379065 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db16b0a-8d8c-45cc-ac1a-bf26e33ffdb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:40.379516 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db16b0a-8d8c-45cc-ac1a-bf26e33ffdb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:40.380529 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db16b0a-8d8c-45cc-ac1a-bf26e33ffdb4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:40.389675 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45514984-664a-4cb8-9171-f17bdcc83d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:40.390618 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45514984-664a-4cb8-9171-f17bdcc83d37 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:40.391085 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45514984-664a-4cb8-9171-f17bdcc83d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:40.391527 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45514984-664a-4cb8-9171-f17bdcc83d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:40.393189 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45514984-664a-4cb8-9171-f17bdcc83d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:40.395135 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45514984-664a-4cb8-9171-f17bdcc83d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:40.398643 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45514984-664a-4cb8-9171-f17bdcc83d37 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:40.402490 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db16b0a-8d8c-45cc-ac1a-bf26e33ffdb4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:40.405675 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db16b0a-8d8c-45cc-ac1a-bf26e33ffdb4 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:40.422935 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 280/565] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:40.429189 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45514984-664a-4cb8-9171-f17bdcc83d37 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:40.443334 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-8db16b0a-8d8c-45cc-ac1a-bf26e33ffdb4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:40.444480 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 286/566] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:40.447978 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45514984-664a-4cb8-9171-f17bdcc83d37 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:40.451410 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db16b0a-8d8c-45cc-ac1a-bf26e33ffdb4 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:40.453264 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9e032-5f6c-49b8-b995-b43219e1cb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:40.454276 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9e032-5f6c-49b8-b995-b43219e1cb86 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:40.455370 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9e032-5f6c-49b8-b995-b43219e1cb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:40.455816 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9e032-5f6c-49b8-b995-b43219e1cb86 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:40.462792 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db16b0a-8d8c-45cc-ac1a-bf26e33ffdb4 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:40.467278 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0eca7-65c5-434e-b15e-db991104a891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:40.467939 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0eca7-65c5-434e-b15e-db991104a891 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:40.468198 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0eca7-65c5-434e-b15e-db991104a891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:40.468470 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0eca7-65c5-434e-b15e-db991104a891 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:40.473958 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0eca7-65c5-434e-b15e-db991104a891 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:40.473958 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0eca7-65c5-434e-b15e-db991104a891 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:40.473958 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c0eca7-65c5-434e-b15e-db991104a891 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:40.475834 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9e032-5f6c-49b8-b995-b43219e1cb86 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:40.478126 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9e032-5f6c-49b8-b995-b43219e1cb86 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:40.483820 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 287/567] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:40.490883 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0eca7-65c5-434e-b15e-db991104a891 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:40.505016 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0eca7-65c5-434e-b15e-db991104a891 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:40.506358 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-44a9e032-5f6c-49b8-b995-b43219e1cb86 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:40.508305 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 281/568] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:40.515285 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce673687-6123-4a26-ac71-a2966c90a2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:40.515447 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9e032-5f6c-49b8-b995-b43219e1cb86 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:40.516216 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce673687-6123-4a26-ac71-a2966c90a2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:40.516517 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce673687-6123-4a26-ac71-a2966c90a2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:40.516793 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce673687-6123-4a26-ac71-a2966c90a2c1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:40.525796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce673687-6123-4a26-ac71-a2966c90a2c1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:40.528834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce673687-6123-4a26-ac71-a2966c90a2c1 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:40.531616 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9e032-5f6c-49b8-b995-b43219e1cb86 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:40.543259 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-ce673687-6123-4a26-ac71-a2966c90a2c1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:40.544916 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 288/569] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:40.545264 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e91d38-de4d-416b-884a-e017d7fb2607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:40.549987 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e91d38-de4d-416b-884a-e017d7fb2607 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:40.549987 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e91d38-de4d-416b-884a-e017d7fb2607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:40.549987 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e91d38-de4d-416b-884a-e017d7fb2607 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:40.549987 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e91d38-de4d-416b-884a-e017d7fb2607 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:40.549987 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e91d38-de4d-416b-884a-e017d7fb2607 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:40.549987 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e91d38-de4d-416b-884a-e017d7fb2607 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:40.559058 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce673687-6123-4a26-ac71-a2966c90a2c1 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:40.574669 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce673687-6123-4a26-ac71-a2966c90a2c1 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:40.576798 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 282/570] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:40.583649 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e91d38-de4d-416b-884a-e017d7fb2607 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:40.584932 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a23d73-ddea-43ed-8d56-a820ab2b6af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:40.585606 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a23d73-ddea-43ed-8d56-a820ab2b6af5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:40.585884 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a23d73-ddea-43ed-8d56-a820ab2b6af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:40.586249 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a23d73-ddea-43ed-8d56-a820ab2b6af5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:40.587054 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a23d73-ddea-43ed-8d56-a820ab2b6af5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:40.587362 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a23d73-ddea-43ed-8d56-a820ab2b6af5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:40.589221 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a23d73-ddea-43ed-8d56-a820ab2b6af5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:40.601956 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e91d38-de4d-416b-884a-e017d7fb2607 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:40.603650 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 289/571] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:40.608444 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fc4cd-b00a-4d27-992f-b8c34ab62f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:40.610037 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a23d73-ddea-43ed-8d56-a820ab2b6af5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:40.611880 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fc4cd-b00a-4d27-992f-b8c34ab62f91 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:40.616398 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fc4cd-b00a-4d27-992f-b8c34ab62f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:40.616766 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fc4cd-b00a-4d27-992f-b8c34ab62f91 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:40.617719 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fc4cd-b00a-4d27-992f-b8c34ab62f91 admin admin] RBAC: Adding query filter params (role.id=01b3b9b5c0d846968d6a5219373998f8, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=3bb8aa43328d4be08455441d0ffa4e8a) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:40.618126 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fc4cd-b00a-4d27-992f-b8c34ab62f91 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:40.622996 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fc4cd-b00a-4d27-992f-b8c34ab62f91 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:40.625149 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a23d73-ddea-43ed-8d56-a820ab2b6af5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:40.634368 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44579e4b-78a9-430f-b281-067fa1a6238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:40.635099 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44579e4b-78a9-430f-b281-067fa1a6238b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:40.635446 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44579e4b-78a9-430f-b281-067fa1a6238b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:40.636018 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44579e4b-78a9-430f-b281-067fa1a6238b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:40.636125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 283/572] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:40 2021] GET /identity/v3/role_assignments?user.id=3bb8aa43328d4be08455441d0ffa4e8a&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=01b3b9b5c0d846968d6a5219373998f8 => generated 608 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:40.643004 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44579e4b-78a9-430f-b281-067fa1a6238b admin admin] RBAC: Adding query filter params (role.id=01b3b9b5c0d846968d6a5219373998f8, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=9652ec3b44ee410dba2491c8f9795e20) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:40.643399 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44579e4b-78a9-430f-b281-067fa1a6238b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:40.645356 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44579e4b-78a9-430f-b281-067fa1a6238b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:40.658239 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 290/573] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:40 2021] GET /identity/v3/role_assignments?user.id=9652ec3b44ee410dba2491c8f9795e20&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=01b3b9b5c0d846968d6a5219373998f8 => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:41.840893 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6c6de-a0dd-4002-a07a-b0b2df2abbab None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:41.841576 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6c6de-a0dd-4002-a07a-b0b2df2abbab None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:41.841576 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6c6de-a0dd-4002-a07a-b0b2df2abbab None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:41.843327 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 284/574] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:41.860054 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691a192-8336-4d91-8dab-5aa6755a7373 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:41.860735 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691a192-8336-4d91-8dab-5aa6755a7373 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:41.860735 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691a192-8336-4d91-8dab-5aa6755a7373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:41.883242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-4691a192-8336-4d91-8dab-5aa6755a7373 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:41.884450 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4691a192-8336-4d91-8dab-5aa6755a7373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:41.897291 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 291/575] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:41.922179 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6c6de-a0dd-4002-a07a-b0b2df2abbab None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:41.940211 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6c6de-a0dd-4002-a07a-b0b2df2abbab None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:41.950007 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3973c-7576-473d-a0e6-211304d914db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:41.951065 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3973c-7576-473d-a0e6-211304d914db admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:41.951346 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3973c-7576-473d-a0e6-211304d914db admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:41.951621 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a3973c-7576-473d-a0e6-211304d914db admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:41.964246 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3973c-7576-473d-a0e6-211304d914db admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:41.966133 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a3973c-7576-473d-a0e6-211304d914db admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:41.982983 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-a8a3973c-7576-473d-a0e6-211304d914db admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:41.988824 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 285/576] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:41 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:41.990455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a008e-1d22-4e4c-8092-7fe1c48bb5ae None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:41.990749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a008e-1d22-4e4c-8092-7fe1c48bb5ae None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:41.991031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36a008e-1d22-4e4c-8092-7fe1c48bb5ae None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:41.991188 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3973c-7576-473d-a0e6-211304d914db admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:41.993208 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 292/577] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:41.998797 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7ab29-60e9-465c-b87b-fde0c015c2ce None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:41.999086 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7ab29-60e9-465c-b87b-fde0c015c2ce None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:41.999368 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7ab29-60e9-465c-b87b-fde0c015c2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.002110 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a3973c-7576-473d-a0e6-211304d914db admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.006642 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ede282-dd2a-44e8-9952-f545a2d0714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.007292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ede282-dd2a-44e8-9952-f545a2d0714e admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.007574 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ede282-dd2a-44e8-9952-f545a2d0714e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.008072 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ede282-dd2a-44e8-9952-f545a2d0714e admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.008816 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ede282-dd2a-44e8-9952-f545a2d0714e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:42.009119 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ede282-dd2a-44e8-9952-f545a2d0714e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:42.010740 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ede282-dd2a-44e8-9952-f545a2d0714e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:42.030267 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 286/578] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:42.031761 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ede282-dd2a-44e8-9952-f545a2d0714e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:42.034590 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-96d7ab29-60e9-465c-b87b-fde0c015c2ce None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:42.035785 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-96d7ab29-60e9-465c-b87b-fde0c015c2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:42.041555 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ede282-dd2a-44e8-9952-f545a2d0714e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.050008 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe350a0-a0ed-4a75-a82b-0a55f1157057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.050660 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe350a0-a0ed-4a75-a82b-0a55f1157057 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.050940 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe350a0-a0ed-4a75-a82b-0a55f1157057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.051218 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe350a0-a0ed-4a75-a82b-0a55f1157057 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.051937 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe350a0-a0ed-4a75-a82b-0a55f1157057 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:42.055020 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 293/579] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:41 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:42.055906 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe350a0-a0ed-4a75-a82b-0a55f1157057 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:42.086060 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 287/580] 10.222.0.41 () {60 vars in 1153 bytes} [Fri Oct 29 16:01:42 2021] POST /identity/v3/users => generated 254 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:01:42.090426 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7ab29-60e9-465c-b87b-fde0c015c2ce None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:42.101420 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7ab29-60e9-465c-b87b-fde0c015c2ce None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.112552 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36e06c-befe-4868-9036-305986cd2f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.113377 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36e06c-befe-4868-9036-305986cd2f68 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.113714 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36e06c-befe-4868-9036-305986cd2f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.114068 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36e06c-befe-4868-9036-305986cd2f68 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.132903 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e36e06c-befe-4868-9036-305986cd2f68 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:42.140492 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-9e36e06c-befe-4868-9036-305986cd2f68 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:01:42.146502 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 294/581] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:42.153788 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe350a0-a0ed-4a75-a82b-0a55f1157057 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:42.167937 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe350a0-a0ed-4a75-a82b-0a55f1157057 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.179036 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f92292-f600-4a48-8db9-bcbd6e5916c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.180154 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f92292-f600-4a48-8db9-bcbd6e5916c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.180656 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f92292-f600-4a48-8db9-bcbd6e5916c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.181158 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f92292-f600-4a48-8db9-bcbd6e5916c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.182244 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f92292-f600-4a48-8db9-bcbd6e5916c0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:42.182789 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f92292-f600-4a48-8db9-bcbd6e5916c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:42.184700 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f92292-f600-4a48-8db9-bcbd6e5916c0 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:42.204617 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 288/582] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:42.211249 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36e06c-befe-4868-9036-305986cd2f68 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:42.223331 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36e06c-befe-4868-9036-305986cd2f68 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.234371 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7c08a-acc8-4296-bed6-2f7da99d82ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.235326 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7c08a-acc8-4296-bed6-2f7da99d82ff admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.236190 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7c08a-acc8-4296-bed6-2f7da99d82ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.236466 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f7c08a-acc8-4296-bed6-2f7da99d82ff admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.254895 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7c08a-acc8-4296-bed6-2f7da99d82ff admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:42.256872 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f7c08a-acc8-4296-bed6-2f7da99d82ff admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:42.276025 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-16f7c08a-acc8-4296-bed6-2f7da99d82ff admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:42.277681 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 295/583] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:42.287628 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f92292-f600-4a48-8db9-bcbd6e5916c0 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:42.304077 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f92292-f600-4a48-8db9-bcbd6e5916c0 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.319953 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3513f720-7c20-4299-ab0b-7a32f4465154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.320957 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513f720-7c20-4299-ab0b-7a32f4465154 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.321394 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513f720-7c20-4299-ab0b-7a32f4465154 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.321819 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3513f720-7c20-4299-ab0b-7a32f4465154 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.322803 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513f720-7c20-4299-ab0b-7a32f4465154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:42.323279 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513f720-7c20-4299-ab0b-7a32f4465154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:42.325177 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3513f720-7c20-4299-ab0b-7a32f4465154 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:42.352168 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 289/584] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:42.361475 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7c08a-acc8-4296-bed6-2f7da99d82ff admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:42.375654 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f7c08a-acc8-4296-bed6-2f7da99d82ff admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.386152 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5437d1ed-d2ec-46d8-8c42-227cdb3420be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.387063 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437d1ed-d2ec-46d8-8c42-227cdb3420be admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.387347 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437d1ed-d2ec-46d8-8c42-227cdb3420be admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.387620 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5437d1ed-d2ec-46d8-8c42-227cdb3420be admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.400416 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437d1ed-d2ec-46d8-8c42-227cdb3420be admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:42.402873 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5437d1ed-d2ec-46d8-8c42-227cdb3420be admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:42.411505 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102e39c-4893-41d3-aec2-eecce8ba892a None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.412198 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102e39c-4893-41d3-aec2-eecce8ba892a None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.412709 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f102e39c-4893-41d3-aec2-eecce8ba892a None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.415157 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 290/585] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:42 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:42.418650 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-5437d1ed-d2ec-46d8-8c42-227cdb3420be admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 16:01:42.420274 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 296/586] 10.222.0.41 () {56 vars in 1114 bytes} [Fri Oct 29 16:01:42 2021] GET /identity/v3/users/nova => generated 82 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:42.426188 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102e39c-4893-41d3-aec2-eecce8ba892a None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:42.429987 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13e05b-8a6e-4328-9b31-5a94b87a3d62 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.430324 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13e05b-8a6e-4328-9b31-5a94b87a3d62 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.430604 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13e05b-8a6e-4328-9b31-5a94b87a3d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.457242 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f102e39c-4893-41d3-aec2-eecce8ba892a None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.468909 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda37783-18c5-4671-af17-809c5d1099ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.469250 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-ac13e05b-8a6e-4328-9b31-5a94b87a3d62 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:42.470242 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda37783-18c5-4671-af17-809c5d1099ad admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.470744 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ac13e05b-8a6e-4328-9b31-5a94b87a3d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:42.471007 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda37783-18c5-4671-af17-809c5d1099ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.471487 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda37783-18c5-4671-af17-809c5d1099ad admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.472655 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda37783-18c5-4671-af17-809c5d1099ad admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:42.473262 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda37783-18c5-4671-af17-809c5d1099ad admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:42.475446 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda37783-18c5-4671-af17-809c5d1099ad admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:42.484798 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 297/587] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:42.502027 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 291/588] 10.222.0.41 () {56 vars in 1154 bytes} [Fri Oct 29 16:01:42 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:42.513270 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13e05b-8a6e-4328-9b31-5a94b87a3d62 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:42.525957 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13e05b-8a6e-4328-9b31-5a94b87a3d62 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.531112 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda37783-18c5-4671-af17-809c5d1099ad admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:42.531403 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cc0a8-92e8-488d-b382-a0fbb0118810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.532301 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cc0a8-92e8-488d-b382-a0fbb0118810 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.532845 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cc0a8-92e8-488d-b382-a0fbb0118810 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.533405 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7cc0a8-92e8-488d-b382-a0fbb0118810 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.547266 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda37783-18c5-4671-af17-809c5d1099ad admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.550756 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cc0a8-92e8-488d-b382-a0fbb0118810 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:42.554372 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7cc0a8-92e8-488d-b382-a0fbb0118810 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:42.563275 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde5b82-d5bd-4130-8051-57a68290e1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.565833 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde5b82-d5bd-4130-8051-57a68290e1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.565833 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde5b82-d5bd-4130-8051-57a68290e1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.566163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde5b82-d5bd-4130-8051-57a68290e1a3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.578331 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 298/589] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:42 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:42.586323 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cc0a8-92e8-488d-b382-a0fbb0118810 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:42.587876 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde5b82-d5bd-4130-8051-57a68290e1a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:42.600934 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-bbde5b82-d5bd-4130-8051-57a68290e1a3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:01:42.603626 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 292/590] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:42.604891 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7cc0a8-92e8-488d-b382-a0fbb0118810 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.612945 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb0450-b15b-4421-8bd3-913657104d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.615089 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb0450-b15b-4421-8bd3-913657104d26 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.615292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde5b82-d5bd-4130-8051-57a68290e1a3 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:42.616047 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb0450-b15b-4421-8bd3-913657104d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.616754 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb0450-b15b-4421-8bd3-913657104d26 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.635076 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde5b82-d5bd-4130-8051-57a68290e1a3 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.637025 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb0450-b15b-4421-8bd3-913657104d26 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:42.640756 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6eb0450-b15b-4421-8bd3-913657104d26 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:42.647967 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b41778-aa91-42b3-a639-00fad578a7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.649019 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b41778-aa91-42b3-a639-00fad578a7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.649514 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b41778-aa91-42b3-a639-00fad578a7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.650004 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b41778-aa91-42b3-a639-00fad578a7d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.651343 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b41778-aa91-42b3-a639-00fad578a7d7 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:42.651877 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b41778-aa91-42b3-a639-00fad578a7d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:42.654794 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b41778-aa91-42b3-a639-00fad578a7d7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:42.671792 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 293/591] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:01:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:42.677997 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-e6eb0450-b15b-4421-8bd3-913657104d26 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:42.677997 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 299/592] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:42.683206 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b41778-aa91-42b3-a639-00fad578a7d7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:42.687631 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb0450-b15b-4421-8bd3-913657104d26 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:42.703367 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b41778-aa91-42b3-a639-00fad578a7d7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.709492 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb0450-b15b-4421-8bd3-913657104d26 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.716882 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912a83a-b147-4adb-b4a0-3c498626f369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.717052 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769c64e-facf-4797-a1da-5fa180b9ad37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.717942 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769c64e-facf-4797-a1da-5fa180b9ad37 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.718125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912a83a-b147-4adb-b4a0-3c498626f369 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.718417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769c64e-facf-4797-a1da-5fa180b9ad37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.718534 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912a83a-b147-4adb-b4a0-3c498626f369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.718913 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769c64e-facf-4797-a1da-5fa180b9ad37 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.719015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d912a83a-b147-4adb-b4a0-3c498626f369 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.720266 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769c64e-facf-4797-a1da-5fa180b9ad37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:42.720750 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769c64e-facf-4797-a1da-5fa180b9ad37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:42.723665 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769c64e-facf-4797-a1da-5fa180b9ad37 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:42.737626 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912a83a-b147-4adb-b4a0-3c498626f369 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:42.741833 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d912a83a-b147-4adb-b4a0-3c498626f369 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:42.744328 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 300/593] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:42.755357 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769c64e-facf-4797-a1da-5fa180b9ad37 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:42.773941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769c64e-facf-4797-a1da-5fa180b9ad37 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.777158 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-d912a83a-b147-4adb-b4a0-3c498626f369 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:42.777158 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 294/594] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:42.786153 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912a83a-b147-4adb-b4a0-3c498626f369 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:42.787448 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1812d-7aff-4f0e-85a2-3c72cceaee94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.788407 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1812d-7aff-4f0e-85a2-3c72cceaee94 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.788799 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1812d-7aff-4f0e-85a2-3c72cceaee94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.789186 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e1812d-7aff-4f0e-85a2-3c72cceaee94 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.801046 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d912a83a-b147-4adb-b4a0-3c498626f369 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.802420 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1812d-7aff-4f0e-85a2-3c72cceaee94 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:42.804655 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e1812d-7aff-4f0e-85a2-3c72cceaee94 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:42.816390 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ba52e-e0df-4b98-9339-4fe16c5f8edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.817168 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ba52e-e0df-4b98-9339-4fe16c5f8edb admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.817529 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ba52e-e0df-4b98-9339-4fe16c5f8edb admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.817882 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4ba52e-e0df-4b98-9339-4fe16c5f8edb admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.818736 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ba52e-e0df-4b98-9339-4fe16c5f8edb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:42.819189 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ba52e-e0df-4b98-9339-4fe16c5f8edb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:42.820868 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4ba52e-e0df-4b98-9339-4fe16c5f8edb admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:42.822397 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-d8e1812d-7aff-4f0e-85a2-3c72cceaee94 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:42.824219 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 301/595] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:42.830817 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1812d-7aff-4f0e-85a2-3c72cceaee94 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:42.843223 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e1812d-7aff-4f0e-85a2-3c72cceaee94 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.846908 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 295/596] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:42.851354 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44430324-1a82-4afc-a19d-760b3cac4338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.852281 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44430324-1a82-4afc-a19d-760b3cac4338 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.852876 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44430324-1a82-4afc-a19d-760b3cac4338 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.853365 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44430324-1a82-4afc-a19d-760b3cac4338 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.855055 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ba52e-e0df-4b98-9339-4fe16c5f8edb admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:42.861432 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44430324-1a82-4afc-a19d-760b3cac4338 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:42.863470 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44430324-1a82-4afc-a19d-760b3cac4338 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:42.867315 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44430324-1a82-4afc-a19d-760b3cac4338 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:42.870371 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4ba52e-e0df-4b98-9339-4fe16c5f8edb admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.880215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f264d-63a3-4647-bebb-78ac27712cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.881427 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f264d-63a3-4647-bebb-78ac27712cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.883656 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f264d-63a3-4647-bebb-78ac27712cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.884253 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330f264d-63a3-4647-bebb-78ac27712cb1 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.899891 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 302/597] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:42.907134 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f264d-63a3-4647-bebb-78ac27712cb1 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:42.909458 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330f264d-63a3-4647-bebb-78ac27712cb1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:42.913152 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44430324-1a82-4afc-a19d-760b3cac4338 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:42.927329 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44430324-1a82-4afc-a19d-760b3cac4338 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.936243 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d537e14-7b4e-4f5d-a15d-8993b914bbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.937250 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d537e14-7b4e-4f5d-a15d-8993b914bbd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.937734 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d537e14-7b4e-4f5d-a15d-8993b914bbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.938249 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d537e14-7b4e-4f5d-a15d-8993b914bbd2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.938554 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-330f264d-63a3-4647-bebb-78ac27712cb1 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 29 16:01:42.940148 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d537e14-7b4e-4f5d-a15d-8993b914bbd2 admin admin] RBAC: Adding query filter params (role.id=f28d3f93a0524078a592a15459808378, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=4f13d0e9f79a433c81759ecd819a6dfa) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:42.940641 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 296/598] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:42 2021] GET /identity/v3/users/swift => generated 83 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:42.940872 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d537e14-7b4e-4f5d-a15d-8993b914bbd2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:42.943076 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d537e14-7b4e-4f5d-a15d-8993b914bbd2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:42.947013 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f264d-63a3-4647-bebb-78ac27712cb1 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:42.950181 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 303/599] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:42 2021] GET /identity/v3/role_assignments?user.id=4f13d0e9f79a433c81759ecd819a6dfa&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=f28d3f93a0524078a592a15459808378 => generated 259 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:42.972584 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330f264d-63a3-4647-bebb-78ac27712cb1 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:42.982129 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a31624-de44-4db4-84e1-0343abf0f347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:42.982820 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a31624-de44-4db4-84e1-0343abf0f347 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:42.983105 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a31624-de44-4db4-84e1-0343abf0f347 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:42.983382 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a31624-de44-4db4-84e1-0343abf0f347 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:42.984260 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a31624-de44-4db4-84e1-0343abf0f347 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:42.984572 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a31624-de44-4db4-84e1-0343abf0f347 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:42.987069 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a31624-de44-4db4-84e1-0343abf0f347 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:43.026305 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 297/600] 10.222.0.41 () {56 vars in 1156 bytes} [Fri Oct 29 16:01:42 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:43.032494 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d537e14-7b4e-4f5d-a15d-8993b914bbd2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:43.050289 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d537e14-7b4e-4f5d-a15d-8993b914bbd2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:43.055455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996e58e-ead9-4fac-ac62-90a4840d0bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:43.056411 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996e58e-ead9-4fac-ac62-90a4840d0bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:43.056919 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996e58e-ead9-4fac-ac62-90a4840d0bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:43.057393 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996e58e-ead9-4fac-ac62-90a4840d0bd4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:43.074381 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996e58e-ead9-4fac-ac62-90a4840d0bd4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:43.076486 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a996e58e-ead9-4fac-ac62-90a4840d0bd4 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:43.092596 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 304/601] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:43 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:43.099367 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a31624-de44-4db4-84e1-0343abf0f347 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:43.116244 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a31624-de44-4db4-84e1-0343abf0f347 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:43.125231 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4aa5c-7e4a-4148-b4cc-bf0a6bd54910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:43.126179 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4aa5c-7e4a-4148-b4cc-bf0a6bd54910 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:43.126932 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4aa5c-7e4a-4148-b4cc-bf0a6bd54910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:43.127212 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4aa5c-7e4a-4148-b4cc-bf0a6bd54910 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:43.143924 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4aa5c-7e4a-4148-b4cc-bf0a6bd54910 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:43.145822 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4aa5c-7e4a-4148-b4cc-bf0a6bd54910 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:43.168943 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-b9e4aa5c-7e4a-4148-b4cc-bf0a6bd54910 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:43.170225 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 298/602] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:43.177278 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996e58e-ead9-4fac-ac62-90a4840d0bd4 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:43.191537 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996e58e-ead9-4fac-ac62-90a4840d0bd4 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:43.207722 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd260337-af44-4952-b059-95223d574c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:43.208440 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd260337-af44-4952-b059-95223d574c2f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:43.208808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd260337-af44-4952-b059-95223d574c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:43.209603 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd260337-af44-4952-b059-95223d574c2f admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:43.210716 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd260337-af44-4952-b059-95223d574c2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:43.211149 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd260337-af44-4952-b059-95223d574c2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:43.213488 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd260337-af44-4952-b059-95223d574c2f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:43.236858 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 305/603] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:43.243618 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4aa5c-7e4a-4148-b4cc-bf0a6bd54910 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:43.259067 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4aa5c-7e4a-4148-b4cc-bf0a6bd54910 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:43.270903 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618aa871-23a2-4536-97e4-9b27a3a875ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:43.272005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618aa871-23a2-4536-97e4-9b27a3a875ae admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:43.272422 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618aa871-23a2-4536-97e4-9b27a3a875ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:43.272793 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618aa871-23a2-4536-97e4-9b27a3a875ae admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:43.287352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618aa871-23a2-4536-97e4-9b27a3a875ae admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:43.290714 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618aa871-23a2-4536-97e4-9b27a3a875ae admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:43.313995 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-618aa871-23a2-4536-97e4-9b27a3a875ae admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:43.315950 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 299/604] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:43.322183 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd260337-af44-4952-b059-95223d574c2f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:43.336662 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd260337-af44-4952-b059-95223d574c2f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:43.341502 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0540d75-1a6d-455d-9074-90767bb0c2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:43.342554 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0540d75-1a6d-455d-9074-90767bb0c2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:43.343080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0540d75-1a6d-455d-9074-90767bb0c2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:43.343544 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0540d75-1a6d-455d-9074-90767bb0c2c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:43.344540 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0540d75-1a6d-455d-9074-90767bb0c2c5 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:43.349944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0540d75-1a6d-455d-9074-90767bb0c2c5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:43.352317 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0540d75-1a6d-455d-9074-90767bb0c2c5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:43.375477 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 306/605] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:43.382191 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618aa871-23a2-4536-97e4-9b27a3a875ae admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:43.396403 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618aa871-23a2-4536-97e4-9b27a3a875ae admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:43.410668 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb2b8d-e915-4058-88a2-b17de0ce0c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:43.411352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb2b8d-e915-4058-88a2-b17de0ce0c9d admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:43.411644 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb2b8d-e915-4058-88a2-b17de0ce0c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:43.412114 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb2b8d-e915-4058-88a2-b17de0ce0c9d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:43.413273 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb2b8d-e915-4058-88a2-b17de0ce0c9d admin admin] RBAC: Adding query filter params (role.id=01b3b9b5c0d846968d6a5219373998f8, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=f518ae309c4b4f7eacca882b58e58bd0) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:43.413591 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb2b8d-e915-4058-88a2-b17de0ce0c9d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:43.415495 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bb2b8d-e915-4058-88a2-b17de0ce0c9d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:43.422463 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 300/606] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:43 2021] GET /identity/v3/role_assignments?user.id=f518ae309c4b4f7eacca882b58e58bd0&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=01b3b9b5c0d846968d6a5219373998f8 => generated 608 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:43.704868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f9479-d13a-4efc-b153-c06229370bc1 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:43.705552 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f9479-d13a-4efc-b153-c06229370bc1 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:43.706048 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f9479-d13a-4efc-b153-c06229370bc1 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:43.708383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 307/607] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:43 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:43.714457 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514e7dd-2fc3-4fdd-a00f-ebab819c171d None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:43.714743 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514e7dd-2fc3-4fdd-a00f-ebab819c171d None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:43.715015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6514e7dd-2fc3-4fdd-a00f-ebab819c171d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:43.743073 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-6514e7dd-2fc3-4fdd-a00f-ebab819c171d None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:43.744313 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-6514e7dd-2fc3-4fdd-a00f-ebab819c171d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:43.752700 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 301/608] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:43.788027 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f9479-d13a-4efc-b153-c06229370bc1 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:43.809414 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f9479-d13a-4efc-b153-c06229370bc1 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:43.815151 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2f294-a0ce-40a5-8126-fcdb727a8f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:43.815950 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2f294-a0ce-40a5-8126-fcdb727a8f17 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:43.816234 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2f294-a0ce-40a5-8126-fcdb727a8f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:43.816506 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a2f294-a0ce-40a5-8126-fcdb727a8f17 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:43.817180 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2f294-a0ce-40a5-8126-fcdb727a8f17 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:43.818227 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING py.warnings [None req-39a2f294-a0ce-40a5-8126-fcdb727a8f17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:01:43.818227 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: warnings.warn(msg) Oct 29 16:01:43.818227 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: Oct 29 16:01:43.819114 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a2f294-a0ce-40a5-8126-fcdb727a8f17 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:43.836105 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-39a2f294-a0ce-40a5-8126-fcdb727a8f17 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 16:01:43.837582 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 308/609] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:43 2021] GET /identity/v3/services/network => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:43.838569 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d915-fa82-4f0c-bc20-443f7d6b5c58 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:43.838842 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d915-fa82-4f0c-bc20-443f7d6b5c58 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:43.839120 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018d915-fa82-4f0c-bc20-443f7d6b5c58 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:43.841116 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 302/610] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:43.843999 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2f294-a0ce-40a5-8126-fcdb727a8f17 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:43.847435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f74b6a-a35e-4598-83b2-49efc9dc5a68 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:43.847880 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f74b6a-a35e-4598-83b2-49efc9dc5a68 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:43.848045 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f74b6a-a35e-4598-83b2-49efc9dc5a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:43.857590 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a2f294-a0ce-40a5-8126-fcdb727a8f17 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:43.862709 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1321b-a15e-4310-8d59-7558e49c8e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:43.863668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1321b-a15e-4310-8d59-7558e49c8e1b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:43.863950 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1321b-a15e-4310-8d59-7558e49c8e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:43.864226 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1321b-a15e-4310-8d59-7558e49c8e1b admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:43.864959 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1321b-a15e-4310-8d59-7558e49c8e1b admin admin] RBAC: Adding query filter params (name=network) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:43.865266 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1321b-a15e-4310-8d59-7558e49c8e1b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:43.866319 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING py.warnings [None req-c7b1321b-a15e-4310-8d59-7558e49c8e1b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:01:43.866319 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: warnings.warn(msg) Oct 29 16:01:43.866319 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: Oct 29 16:01:43.867103 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-89f74b6a-a35e-4598-83b2-49efc9dc5a68 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:43.867272 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1321b-a15e-4310-8d59-7558e49c8e1b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:43.868552 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-89f74b6a-a35e-4598-83b2-49efc9dc5a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:43.878249 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 303/612] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:43.878562 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 309/612] 10.222.0.41 () {56 vars in 1133 bytes} [Fri Oct 29 16:01:43 2021] GET /identity/v3/services?name=network => generated 124 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:43.883312 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f74b6a-a35e-4598-83b2-49efc9dc5a68 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:43.899929 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f74b6a-a35e-4598-83b2-49efc9dc5a68 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:43.904504 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fe7f4-8b00-482f-bdd4-d04b828a3689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:43.905161 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fe7f4-8b00-482f-bdd4-d04b828a3689 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:43.905446 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fe7f4-8b00-482f-bdd4-d04b828a3689 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:43.905720 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4fe7f4-8b00-482f-bdd4-d04b828a3689 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:43.906480 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fe7f4-8b00-482f-bdd4-d04b828a3689 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:43.906788 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fe7f4-8b00-482f-bdd4-d04b828a3689 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:43.907825 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING py.warnings [None req-ae4fe7f4-8b00-482f-bdd4-d04b828a3689 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:01:43.907825 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: warnings.warn(msg) Oct 29 16:01:43.907825 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: Oct 29 16:01:43.908715 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4fe7f4-8b00-482f-bdd4-d04b828a3689 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:43.910703 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1321b-a15e-4310-8d59-7558e49c8e1b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:43.915023 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 304/613] 10.222.0.41 () {56 vars in 1133 bytes} [Fri Oct 29 16:01:43 2021] GET /identity/v3/services?type=network => generated 124 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:43.928580 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1321b-a15e-4310-8d59-7558e49c8e1b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:43.936965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a93258-944d-40e9-b98d-ce1b3dd729b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:43.937802 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a93258-944d-40e9-b98d-ce1b3dd729b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:43.938127 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a93258-944d-40e9-b98d-ce1b3dd729b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:43.938405 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a93258-944d-40e9-b98d-ce1b3dd729b9 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:43.939793 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a93258-944d-40e9-b98d-ce1b3dd729b9 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:43.941635 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a93258-944d-40e9-b98d-ce1b3dd729b9 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:43.958240 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-30a93258-944d-40e9-b98d-ce1b3dd729b9 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 16:01:43.959754 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 310/614] 10.222.0.41 () {56 vars in 1150 bytes} [Fri Oct 29 16:01:43 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:43.966688 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fe7f4-8b00-482f-bdd4-d04b828a3689 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:43.977801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4fe7f4-8b00-482f-bdd4-d04b828a3689 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:43.983071 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6e8dc-ed51-4eed-8ebf-df90398c7c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:43.983758 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6e8dc-ed51-4eed-8ebf-df90398c7c15 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:43.984042 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6e8dc-ed51-4eed-8ebf-df90398c7c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:43.984321 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6e8dc-ed51-4eed-8ebf-df90398c7c15 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:43.985071 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6e8dc-ed51-4eed-8ebf-df90398c7c15 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:43.985382 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6e8dc-ed51-4eed-8ebf-df90398c7c15 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:43.987306 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6e8dc-ed51-4eed-8ebf-df90398c7c15 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:43.993109 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 305/615] 10.222.0.41 () {56 vars in 1145 bytes} [Fri Oct 29 16:01:43 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:43.999494 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a93258-944d-40e9-b98d-ce1b3dd729b9 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:44.010617 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a93258-944d-40e9-b98d-ce1b3dd729b9 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:44.015412 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad2363-1f98-4a6e-a743-9c477bb3e72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:44.016091 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad2363-1f98-4a6e-a743-9c477bb3e72b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:44.016372 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad2363-1f98-4a6e-a743-9c477bb3e72b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:44.016649 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad2363-1f98-4a6e-a743-9c477bb3e72b admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:44.018007 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad2363-1f98-4a6e-a743-9c477bb3e72b admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:44.018319 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad2363-1f98-4a6e-a743-9c477bb3e72b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:44.020815 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad2363-1f98-4a6e-a743-9c477bb3e72b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:44.027536 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 311/616] 10.222.0.41 () {56 vars in 1145 bytes} [Fri Oct 29 16:01:43 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:45.207202 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466ca8e-952b-4d4f-824f-0f0222c1d06f None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:45.207760 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466ca8e-952b-4d4f-824f-0f0222c1d06f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:45.207760 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1466ca8e-952b-4d4f-824f-0f0222c1d06f None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:45.209515 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 306/617] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:45.221565 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5c49b-02cc-43ca-bbde-dbfaa1901ff1 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:45.222080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5c49b-02cc-43ca-bbde-dbfaa1901ff1 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:45.222181 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a5c49b-02cc-43ca-bbde-dbfaa1901ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:45.251645 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-26a5c49b-02cc-43ca-bbde-dbfaa1901ff1 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:45.252829 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-26a5c49b-02cc-43ca-bbde-dbfaa1901ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:45.265600 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 312/618] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:45.314643 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466ca8e-952b-4d4f-824f-0f0222c1d06f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:45.332214 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1466ca8e-952b-4d4f-824f-0f0222c1d06f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:45.341441 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115b0ce-e4e8-416e-b33b-15fb84480b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:45.342819 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115b0ce-e4e8-416e-b33b-15fb84480b49 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:45.343316 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115b0ce-e4e8-416e-b33b-15fb84480b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:45.343795 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115b0ce-e4e8-416e-b33b-15fb84480b49 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:45.366870 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115b0ce-e4e8-416e-b33b-15fb84480b49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:45.374402 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-7115b0ce-e4e8-416e-b33b-15fb84480b49 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:01:45.375836 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 307/619] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:45 2021] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:45.382804 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5c49b-02cc-43ca-bbde-dbfaa1901ff1 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:45.395413 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a5c49b-02cc-43ca-bbde-dbfaa1901ff1 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:45.400022 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d9d67-97aa-4351-bbb3-18feddf77fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:45.400713 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d9d67-97aa-4351-bbb3-18feddf77fce admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:45.400992 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d9d67-97aa-4351-bbb3-18feddf77fce admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:45.401261 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d9d67-97aa-4351-bbb3-18feddf77fce admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:45.402081 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d9d67-97aa-4351-bbb3-18feddf77fce admin admin] RBAC: Adding query filter params (name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:45.402386 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d9d67-97aa-4351-bbb3-18feddf77fce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:45.404024 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d9d67-97aa-4351-bbb3-18feddf77fce admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:45.421556 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 313/620] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:01:45 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:45.427975 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115b0ce-e4e8-416e-b33b-15fb84480b49 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:45.443111 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115b0ce-e4e8-416e-b33b-15fb84480b49 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:45.452086 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48b2bd-c6c8-4c4f-9411-57c316d6855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:45.453119 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48b2bd-c6c8-4c4f-9411-57c316d6855c admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:45.453638 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48b2bd-c6c8-4c4f-9411-57c316d6855c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:45.454174 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d48b2bd-c6c8-4c4f-9411-57c316d6855c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:45.472430 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48b2bd-c6c8-4c4f-9411-57c316d6855c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:45.474630 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d48b2bd-c6c8-4c4f-9411-57c316d6855c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:45.495564 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-0d48b2bd-c6c8-4c4f-9411-57c316d6855c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:45.497497 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 308/621] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:45.503375 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d9d67-97aa-4351-bbb3-18feddf77fce admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:45.519049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d9d67-97aa-4351-bbb3-18feddf77fce admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:45.523433 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a93f8f-82f9-491f-b6d0-b429adbb31d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:45.524090 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a93f8f-82f9-491f-b6d0-b429adbb31d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:45.524368 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a93f8f-82f9-491f-b6d0-b429adbb31d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:45.524638 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a93f8f-82f9-491f-b6d0-b429adbb31d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:45.525365 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a93f8f-82f9-491f-b6d0-b429adbb31d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:45.525666 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a93f8f-82f9-491f-b6d0-b429adbb31d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:45.527273 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a93f8f-82f9-491f-b6d0-b429adbb31d2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:45.544963 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 314/622] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:45.551412 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48b2bd-c6c8-4c4f-9411-57c316d6855c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:45.567972 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d48b2bd-c6c8-4c4f-9411-57c316d6855c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:45.579217 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c42336-57cd-4610-884f-9a86ba1cced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:45.580434 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c42336-57cd-4610-884f-9a86ba1cced4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:45.580968 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c42336-57cd-4610-884f-9a86ba1cced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:45.581465 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c42336-57cd-4610-884f-9a86ba1cced4 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:45.599387 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c42336-57cd-4610-884f-9a86ba1cced4 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:45.602049 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c42336-57cd-4610-884f-9a86ba1cced4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:45.626966 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-b1c42336-57cd-4610-884f-9a86ba1cced4 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 16:01:45.628942 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 309/623] 10.222.0.41 () {56 vars in 1138 bytes} [Fri Oct 29 16:01:45 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:45.635656 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a93f8f-82f9-491f-b6d0-b429adbb31d2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:45.651476 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a93f8f-82f9-491f-b6d0-b429adbb31d2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:45.656141 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049fb99-d5c3-41ff-8927-f7ac99423d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:45.656977 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049fb99-d5c3-41ff-8927-f7ac99423d18 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:45.657939 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049fb99-d5c3-41ff-8927-f7ac99423d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:45.658208 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c049fb99-d5c3-41ff-8927-f7ac99423d18 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:45.659121 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049fb99-d5c3-41ff-8927-f7ac99423d18 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:45.659428 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049fb99-d5c3-41ff-8927-f7ac99423d18 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:45.661321 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c049fb99-d5c3-41ff-8927-f7ac99423d18 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:45.693993 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 315/624] 10.222.0.41 () {56 vars in 1170 bytes} [Fri Oct 29 16:01:45 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:45.700968 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c42336-57cd-4610-884f-9a86ba1cced4 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:45.715524 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c42336-57cd-4610-884f-9a86ba1cced4 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:45.729039 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595f0c1-5eb8-40b6-808e-0caab2ee7ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:45.730134 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595f0c1-5eb8-40b6-808e-0caab2ee7ba4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:45.730631 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595f0c1-5eb8-40b6-808e-0caab2ee7ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:45.731109 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595f0c1-5eb8-40b6-808e-0caab2ee7ba4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:45.749636 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595f0c1-5eb8-40b6-808e-0caab2ee7ba4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:45.751826 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595f0c1-5eb8-40b6-808e-0caab2ee7ba4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:45.778624 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 310/625] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:45.781941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049fb99-d5c3-41ff-8927-f7ac99423d18 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:45.797361 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c049fb99-d5c3-41ff-8927-f7ac99423d18 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:45.814604 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8311c5a-133f-4c5e-8d2d-55578bc49528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:45.815419 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8311c5a-133f-4c5e-8d2d-55578bc49528 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:45.815784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8311c5a-133f-4c5e-8d2d-55578bc49528 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:45.816062 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8311c5a-133f-4c5e-8d2d-55578bc49528 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:45.817405 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d07f42-102c-4029-8d72-3e5fd6538eea None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:45.817699 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d07f42-102c-4029-8d72-3e5fd6538eea None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:45.818229 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d07f42-102c-4029-8d72-3e5fd6538eea None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:45.820826 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 311/626] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:45.828196 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7385064-eb7d-4e43-aec5-814006e0fb25 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:45.828549 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7385064-eb7d-4e43-aec5-814006e0fb25 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:45.829663 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7385064-eb7d-4e43-aec5-814006e0fb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:45.830362 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8311c5a-133f-4c5e-8d2d-55578bc49528 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:45.832237 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8311c5a-133f-4c5e-8d2d-55578bc49528 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:45.855213 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-e8311c5a-133f-4c5e-8d2d-55578bc49528 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:45.856712 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 316/627] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:45.862924 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8311c5a-133f-4c5e-8d2d-55578bc49528 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:45.866099 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-a7385064-eb7d-4e43-aec5-814006e0fb25 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:45.867354 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a7385064-eb7d-4e43-aec5-814006e0fb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:45.872597 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8311c5a-133f-4c5e-8d2d-55578bc49528 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:45.875632 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 312/628] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:45.884462 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ac095-1594-4499-b2fd-a26eedfae117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:45.885127 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ac095-1594-4499-b2fd-a26eedfae117 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:45.885412 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ac095-1594-4499-b2fd-a26eedfae117 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:45.885689 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ac095-1594-4499-b2fd-a26eedfae117 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:45.886459 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ac095-1594-4499-b2fd-a26eedfae117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:45.886765 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ac095-1594-4499-b2fd-a26eedfae117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:45.888361 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ac095-1594-4499-b2fd-a26eedfae117 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:45.901156 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7385064-eb7d-4e43-aec5-814006e0fb25 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:45.910341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 317/629] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:45.913754 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ac095-1594-4499-b2fd-a26eedfae117 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:45.922142 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7385064-eb7d-4e43-aec5-814006e0fb25 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:45.928802 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ac095-1594-4499-b2fd-a26eedfae117 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:45.932861 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0021e3-5e8a-41ed-9380-ab90eef8596b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:45.933659 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0021e3-5e8a-41ed-9380-ab90eef8596b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:45.933969 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0021e3-5e8a-41ed-9380-ab90eef8596b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:45.934249 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0021e3-5e8a-41ed-9380-ab90eef8596b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:45.943852 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7c21a-8222-4677-bb69-9655cf30dc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:45.944659 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7c21a-8222-4677-bb69-9655cf30dc78 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:45.944942 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7c21a-8222-4677-bb69-9655cf30dc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:45.945220 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7c21a-8222-4677-bb69-9655cf30dc78 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:45.958300 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0021e3-5e8a-41ed-9380-ab90eef8596b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:45.965367 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-3b0021e3-5e8a-41ed-9380-ab90eef8596b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:01:45.966805 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 313/630] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:45.967981 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7c21a-8222-4677-bb69-9655cf30dc78 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:45.970640 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea7c21a-8222-4677-bb69-9655cf30dc78 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:45.977011 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0021e3-5e8a-41ed-9380-ab90eef8596b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:45.989038 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-9ea7c21a-8222-4677-bb69-9655cf30dc78 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:45.990642 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 318/631] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:45 2021] GET /identity/v3/projects/service => generated 88 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:45.994780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0021e3-5e8a-41ed-9380-ab90eef8596b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:45.999064 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7c21a-8222-4677-bb69-9655cf30dc78 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:46.005834 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad8848-c428-4d6c-8bf8-e102b863507f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:46.006710 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad8848-c428-4d6c-8bf8-e102b863507f admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.006996 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad8848-c428-4d6c-8bf8-e102b863507f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.007274 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dad8848-c428-4d6c-8bf8-e102b863507f admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.008250 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad8848-c428-4d6c-8bf8-e102b863507f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:46.008560 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad8848-c428-4d6c-8bf8-e102b863507f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:46.010521 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dad8848-c428-4d6c-8bf8-e102b863507f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:46.016444 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7c21a-8222-4677-bb69-9655cf30dc78 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:46.020859 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 314/632] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:46.027449 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad8848-c428-4d6c-8bf8-e102b863507f admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:46.031330 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a9137-2405-4df9-a71f-af49d740068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:46.032014 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a9137-2405-4df9-a71f-af49d740068d admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.032358 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a9137-2405-4df9-a71f-af49d740068d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.033141 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a9137-2405-4df9-a71f-af49d740068d admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.033959 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a9137-2405-4df9-a71f-af49d740068d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:46.034272 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a9137-2405-4df9-a71f-af49d740068d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:46.036125 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a9137-2405-4df9-a71f-af49d740068d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:46.044294 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dad8848-c428-4d6c-8bf8-e102b863507f admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:46.052918 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197be89b-cf23-4452-8aa3-5870d4836442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:46.054039 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197be89b-cf23-4452-8aa3-5870d4836442 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.054523 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197be89b-cf23-4452-8aa3-5870d4836442 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.055396 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197be89b-cf23-4452-8aa3-5870d4836442 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.058290 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 319/633] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:45 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:46.064625 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a9137-2405-4df9-a71f-af49d740068d admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:46.079010 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197be89b-cf23-4452-8aa3-5870d4836442 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:46.081715 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a9137-2405-4df9-a71f-af49d740068d admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:46.083976 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197be89b-cf23-4452-8aa3-5870d4836442 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:46.093856 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049c478-d2ea-45e2-965b-86a9234be65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:46.095540 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049c478-d2ea-45e2-965b-86a9234be65f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.097535 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049c478-d2ea-45e2-965b-86a9234be65f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.098047 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049c478-d2ea-45e2-965b-86a9234be65f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.099086 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049c478-d2ea-45e2-965b-86a9234be65f admin admin] RBAC: Adding query filter params (role.id=01b3b9b5c0d846968d6a5219373998f8, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=10b4daa146fa4b638d90ea1e9a4878eb) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:46.100280 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049c478-d2ea-45e2-965b-86a9234be65f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:46.104468 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e049c478-d2ea-45e2-965b-86a9234be65f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:46.116766 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 320/634] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:46 2021] GET /identity/v3/role_assignments?user.id=10b4daa146fa4b638d90ea1e9a4878eb&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=01b3b9b5c0d846968d6a5219373998f8 => generated 259 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:46.120390 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-197be89b-cf23-4452-8aa3-5870d4836442 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:46.122452 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 315/635] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 95 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:46.129852 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049c478-d2ea-45e2-965b-86a9234be65f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:46.140802 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049c478-d2ea-45e2-965b-86a9234be65f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:46.147211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd6b94-80d9-4f80-9da8-ea06642530df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:46.148345 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd6b94-80d9-4f80-9da8-ea06642530df admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.148813 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd6b94-80d9-4f80-9da8-ea06642530df admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.149375 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd6b94-80d9-4f80-9da8-ea06642530df admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.150405 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd6b94-80d9-4f80-9da8-ea06642530df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:46.150919 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd6b94-80d9-4f80-9da8-ea06642530df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:46.153059 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd6b94-80d9-4f80-9da8-ea06642530df admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:46.172451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 321/636] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:46.178903 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197be89b-cf23-4452-8aa3-5870d4836442 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:46.192374 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197be89b-cf23-4452-8aa3-5870d4836442 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:46.198203 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a9c37-ac4c-4e20-a530-2d93d9227e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:46.199294 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a9c37-ac4c-4e20-a530-2d93d9227e33 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.199869 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a9c37-ac4c-4e20-a530-2d93d9227e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.200320 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7a9c37-ac4c-4e20-a530-2d93d9227e33 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.215429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a9c37-ac4c-4e20-a530-2d93d9227e33 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:46.217542 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7a9c37-ac4c-4e20-a530-2d93d9227e33 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:46.237780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-ae7a9c37-ac4c-4e20-a530-2d93d9227e33 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 16:01:46.239504 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 316/637] 10.222.0.41 () {56 vars in 1114 bytes} [Fri Oct 29 16:01:46 2021] GET /identity/v3/users/nova => generated 82 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:46.245506 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd6b94-80d9-4f80-9da8-ea06642530df admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:46.265175 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd6b94-80d9-4f80-9da8-ea06642530df admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:46.277627 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53062c4e-4da3-4b1f-b401-7ad6aec423cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:46.279014 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53062c4e-4da3-4b1f-b401-7ad6aec423cf admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.279624 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53062c4e-4da3-4b1f-b401-7ad6aec423cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.280238 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53062c4e-4da3-4b1f-b401-7ad6aec423cf admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.281666 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53062c4e-4da3-4b1f-b401-7ad6aec423cf admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:46.282359 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53062c4e-4da3-4b1f-b401-7ad6aec423cf admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:46.284702 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53062c4e-4da3-4b1f-b401-7ad6aec423cf admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:46.310537 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 322/638] 10.222.0.41 () {56 vars in 1154 bytes} [Fri Oct 29 16:01:46 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:46.316833 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a9c37-ac4c-4e20-a530-2d93d9227e33 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:46.331711 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7a9c37-ac4c-4e20-a530-2d93d9227e33 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:46.344263 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c90fb8-a16b-425e-bf2d-80980fdef1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:46.345586 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c90fb8-a16b-425e-bf2d-80980fdef1ef admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.346097 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c90fb8-a16b-425e-bf2d-80980fdef1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.346545 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c90fb8-a16b-425e-bf2d-80980fdef1ef admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.365815 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c90fb8-a16b-425e-bf2d-80980fdef1ef admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:46.367722 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c90fb8-a16b-425e-bf2d-80980fdef1ef admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:46.395130 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-01c90fb8-a16b-425e-bf2d-80980fdef1ef admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:46.396705 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 317/639] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:46.402520 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53062c4e-4da3-4b1f-b401-7ad6aec423cf admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:46.420181 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53062c4e-4da3-4b1f-b401-7ad6aec423cf admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:46.431574 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859b5b1-8d58-4fee-bfe1-e37ce38ba7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:46.432685 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859b5b1-8d58-4fee-bfe1-e37ce38ba7d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.433126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859b5b1-8d58-4fee-bfe1-e37ce38ba7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.434056 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859b5b1-8d58-4fee-bfe1-e37ce38ba7d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.435090 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859b5b1-8d58-4fee-bfe1-e37ce38ba7d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:46.435620 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859b5b1-8d58-4fee-bfe1-e37ce38ba7d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:46.437536 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4859b5b1-8d58-4fee-bfe1-e37ce38ba7d1 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:46.452958 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 323/640] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:46.459218 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c90fb8-a16b-425e-bf2d-80980fdef1ef admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:46.475814 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c90fb8-a16b-425e-bf2d-80980fdef1ef admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:46.480510 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041fe78-8785-421f-8680-af1e8dd72bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:46.481376 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041fe78-8785-421f-8680-af1e8dd72bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.481717 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041fe78-8785-421f-8680-af1e8dd72bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.482082 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041fe78-8785-421f-8680-af1e8dd72bc9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.490000 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041fe78-8785-421f-8680-af1e8dd72bc9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:46.491917 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041fe78-8785-421f-8680-af1e8dd72bc9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:46.505006 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-f041fe78-8785-421f-8680-af1e8dd72bc9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:46.506543 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 318/641] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:46.512461 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859b5b1-8d58-4fee-bfe1-e37ce38ba7d1 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:46.530701 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859b5b1-8d58-4fee-bfe1-e37ce38ba7d1 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:46.538136 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef523a-efe4-4412-ab25-a52651211add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:46.538808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef523a-efe4-4412-ab25-a52651211add admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.539090 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef523a-efe4-4412-ab25-a52651211add admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.539364 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef523a-efe4-4412-ab25-a52651211add admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.540175 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef523a-efe4-4412-ab25-a52651211add admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:46.540495 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef523a-efe4-4412-ab25-a52651211add admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:46.542367 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef523a-efe4-4412-ab25-a52651211add admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:46.567777 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 324/642] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:46.574087 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041fe78-8785-421f-8680-af1e8dd72bc9 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:46.591572 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041fe78-8785-421f-8680-af1e8dd72bc9 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:46.600269 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ef46b4-e30b-4dce-a77e-6e4ee5f70a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:46.601877 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef46b4-e30b-4dce-a77e-6e4ee5f70a4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.602488 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef46b4-e30b-4dce-a77e-6e4ee5f70a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.602960 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ef46b4-e30b-4dce-a77e-6e4ee5f70a4f admin admin] PATH_INFO: `/v3/projects/4939afba2b604181b67577f309c9550a/users/4f13d0e9f79a433c81759ecd819a6dfa/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.605591 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef46b4-e30b-4dce-a77e-6e4ee5f70a4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4939afba2b604181b67577f309c9550a, user_id=4f13d0e9f79a433c81759ecd819a6dfa, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:46.608714 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ef46b4-e30b-4dce-a77e-6e4ee5f70a4f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:46.624057 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f7065-2c7b-4e4f-8c61-c1631e867f63 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.624957 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f7065-2c7b-4e4f-8c61-c1631e867f63 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.625561 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f7065-2c7b-4e4f-8c61-c1631e867f63 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.631183 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 325/643] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:46 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:01:46.636729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 319/644] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:01:46 2021] PUT /identity/v3/projects/4939afba2b604181b67577f309c9550a/users/4f13d0e9f79a433c81759ecd819a6dfa/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:01:46.643705 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3e6e0-5b2a-4945-b46a-5611c2ac653e None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.644348 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3e6e0-5b2a-4945-b46a-5611c2ac653e None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.644818 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3e6e0-5b2a-4945-b46a-5611c2ac653e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.671924 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-abb3e6e0-5b2a-4945-b46a-5611c2ac653e None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:46.673597 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-abb3e6e0-5b2a-4945-b46a-5611c2ac653e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:46.729379 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf0920-28b1-4970-9856-a8e80ad9635d None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.729696 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf0920-28b1-4970-9856-a8e80ad9635d None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.729959 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf0920-28b1-4970-9856-a8e80ad9635d None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.733309 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 320/645] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:01:46.738590 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd91d6-7f6f-477a-b4ec-fb56550bc222 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.738876 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd91d6-7f6f-477a-b4ec-fb56550bc222 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.739135 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dd91d6-7f6f-477a-b4ec-fb56550bc222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.758714 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-d5dd91d6-7f6f-477a-b4ec-fb56550bc222 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:46.759857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d5dd91d6-7f6f-477a-b4ec-fb56550bc222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:46.768982 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 326/646] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:46.781796 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 321/647] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:46.794738 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3e6e0-5b2a-4945-b46a-5611c2ac653e None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:46.804712 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3e6e0-5b2a-4945-b46a-5611c2ac653e None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:46.810025 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a5ef5-db74-428b-9eca-9e2c93e28b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:46.811240 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a5ef5-db74-428b-9eca-9e2c93e28b3d admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.811787 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a5ef5-db74-428b-9eca-9e2c93e28b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.812283 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155a5ef5-db74-428b-9eca-9e2c93e28b3d admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.823269 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd91d6-7f6f-477a-b4ec-fb56550bc222 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:46.825343 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155a5ef5-db74-428b-9eca-9e2c93e28b3d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:46.833588 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-155a5ef5-db74-428b-9eca-9e2c93e28b3d admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:01:46.835527 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 327/648] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:46 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:46.842388 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a5ef5-db74-428b-9eca-9e2c93e28b3d admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:46.843606 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dd91d6-7f6f-477a-b4ec-fb56550bc222 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:46.853779 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e85b8-a432-46e7-a91c-e9fa21d351fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:46.854324 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155a5ef5-db74-428b-9eca-9e2c93e28b3d admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:46.854516 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e85b8-a432-46e7-a91c-e9fa21d351fb admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.854760 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e85b8-a432-46e7-a91c-e9fa21d351fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.855036 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e85b8-a432-46e7-a91c-e9fa21d351fb admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.855803 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e85b8-a432-46e7-a91c-e9fa21d351fb admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:46.856814 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING py.warnings [None req-c01e85b8-a432-46e7-a91c-e9fa21d351fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:01:46.856814 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: warnings.warn(msg) Oct 29 16:01:46.856814 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: Oct 29 16:01:46.857703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e85b8-a432-46e7-a91c-e9fa21d351fb admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:46.861170 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc586f-9407-4862-8131-2295dff2585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:46.862203 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc586f-9407-4862-8131-2295dff2585a admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.862729 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc586f-9407-4862-8131-2295dff2585a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.863302 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc586f-9407-4862-8131-2295dff2585a admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.864273 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc586f-9407-4862-8131-2295dff2585a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:46.864905 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc586f-9407-4862-8131-2295dff2585a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:46.867504 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdc586f-9407-4862-8131-2295dff2585a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:46.878664 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 328/649] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:46 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:46.881994 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 322/650] 10.222.0.41 () {60 vars in 1162 bytes} [Fri Oct 29 16:01:46 2021] POST /identity/v3/services => generated 240 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:01:46.885493 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc586f-9407-4862-8131-2295dff2585a admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:46.896125 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc586f-9407-4862-8131-2295dff2585a admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:46.915334 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ddab4-92d1-433e-83a9-db688f7280a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:46.916473 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ddab4-92d1-433e-83a9-db688f7280a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:46.917053 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ddab4-92d1-433e-83a9-db688f7280a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:46.917508 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ddab4-92d1-433e-83a9-db688f7280a8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:46.931235 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ddab4-92d1-433e-83a9-db688f7280a8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:46.933575 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7ddab4-92d1-433e-83a9-db688f7280a8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:46.963680 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-2f7ddab4-92d1-433e-83a9-db688f7280a8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:46.965437 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 329/651] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:46.971399 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e85b8-a432-46e7-a91c-e9fa21d351fb admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:46.991215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e85b8-a432-46e7-a91c-e9fa21d351fb admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:47.000917 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceaf02-6407-4787-ae97-e6879ac1d661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:47.002709 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceaf02-6407-4787-ae97-e6879ac1d661 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:47.003224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceaf02-6407-4787-ae97-e6879ac1d661 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:47.003705 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceaf02-6407-4787-ae97-e6879ac1d661 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:47.004665 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ceaf02-6407-4787-ae97-e6879ac1d661 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:47.005185 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ceaf02-6407-4787-ae97-e6879ac1d661 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:47.007129 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ceaf02-6407-4787-ae97-e6879ac1d661 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:47.029767 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 323/652] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:47.036000 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ddab4-92d1-433e-83a9-db688f7280a8 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:47.051671 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ddab4-92d1-433e-83a9-db688f7280a8 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:47.060127 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8f5f3-c810-43fa-9964-61c5460670e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:47.061102 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8f5f3-c810-43fa-9964-61c5460670e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:47.061385 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8f5f3-c810-43fa-9964-61c5460670e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:47.061687 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8f5f3-c810-43fa-9964-61c5460670e5 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:47.075318 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8f5f3-c810-43fa-9964-61c5460670e5 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:47.077726 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8f5f3-c810-43fa-9964-61c5460670e5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:47.096535 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-92f8f5f3-c810-43fa-9964-61c5460670e5 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 29 16:01:47.098082 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 330/653] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:47 2021] GET /identity/v3/users/swift => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:47.104727 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceaf02-6407-4787-ae97-e6879ac1d661 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:47.116191 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceaf02-6407-4787-ae97-e6879ac1d661 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:47.122059 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd96b52-6fc8-41bc-8c59-9084bdb961d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:47.122962 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd96b52-6fc8-41bc-8c59-9084bdb961d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:47.123458 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd96b52-6fc8-41bc-8c59-9084bdb961d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:47.123923 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd96b52-6fc8-41bc-8c59-9084bdb961d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:47.124958 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd96b52-6fc8-41bc-8c59-9084bdb961d5 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:47.125465 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd96b52-6fc8-41bc-8c59-9084bdb961d5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:47.128045 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd96b52-6fc8-41bc-8c59-9084bdb961d5 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:47.148971 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 324/654] 10.222.0.41 () {56 vars in 1156 bytes} [Fri Oct 29 16:01:47 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:47.155505 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8f5f3-c810-43fa-9964-61c5460670e5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:47.166741 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8f5f3-c810-43fa-9964-61c5460670e5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:47.171797 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d581d-e899-4c0a-90e8-a6d993d01d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:47.172851 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d581d-e899-4c0a-90e8-a6d993d01d55 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:47.173352 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d581d-e899-4c0a-90e8-a6d993d01d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:47.173815 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d581d-e899-4c0a-90e8-a6d993d01d55 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:47.183009 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d581d-e899-4c0a-90e8-a6d993d01d55 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:47.185195 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d581d-e899-4c0a-90e8-a6d993d01d55 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:47.196161 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 331/655] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:47 2021] GET /identity/v3/auth/tokens => generated 1166 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:01:47.203174 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd96b52-6fc8-41bc-8c59-9084bdb961d5 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:47.213907 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd96b52-6fc8-41bc-8c59-9084bdb961d5 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:47.218645 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388d026-dae9-4382-a3c1-303279d94246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:47.220215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388d026-dae9-4382-a3c1-303279d94246 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:47.220740 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388d026-dae9-4382-a3c1-303279d94246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:47.221219 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388d026-dae9-4382-a3c1-303279d94246 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:47.232742 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388d026-dae9-4382-a3c1-303279d94246 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:47.234980 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388d026-dae9-4382-a3c1-303279d94246 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:47.252567 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-8388d026-dae9-4382-a3c1-303279d94246 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:47.254357 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 325/656] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:47.260682 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d581d-e899-4c0a-90e8-a6d993d01d55 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:47.271506 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d581d-e899-4c0a-90e8-a6d993d01d55 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:47.276474 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a0014c-9a7d-46a8-9aa1-b8ca857f55c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:47.277438 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0014c-9a7d-46a8-9aa1-b8ca857f55c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:47.277978 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0014c-9a7d-46a8-9aa1-b8ca857f55c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:47.278449 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a0014c-9a7d-46a8-9aa1-b8ca857f55c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:47.279383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0014c-9a7d-46a8-9aa1-b8ca857f55c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:47.279990 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0014c-9a7d-46a8-9aa1-b8ca857f55c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:47.281883 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a0014c-9a7d-46a8-9aa1-b8ca857f55c8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:47.295391 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 332/657] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:47.302297 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388d026-dae9-4382-a3c1-303279d94246 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:47.314772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388d026-dae9-4382-a3c1-303279d94246 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:47.319694 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e4fd9-1cd7-4943-aab1-1597d70404e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:47.320750 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e4fd9-1cd7-4943-aab1-1597d70404e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:47.321275 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e4fd9-1cd7-4943-aab1-1597d70404e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:47.321757 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e4fd9-1cd7-4943-aab1-1597d70404e8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:47.329472 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e4fd9-1cd7-4943-aab1-1597d70404e8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:47.333017 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e4fd9-1cd7-4943-aab1-1597d70404e8 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:47.333395 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cefd1-8d62-46db-87f3-af4c8360a250 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:47.333987 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cefd1-8d62-46db-87f3-af4c8360a250 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:47.334268 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880cefd1-8d62-46db-87f3-af4c8360a250 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:47.336194 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 333/658] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:01:47.347146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-e84e4fd9-1cd7-4943-aab1-1597d70404e8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:47.347490 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d46df-2ac8-45b1-a99a-c787c8a493e1 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:47.347774 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d46df-2ac8-45b1-a99a-c787c8a493e1 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:47.348050 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d46df-2ac8-45b1-a99a-c787c8a493e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:47.348600 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 326/659] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:47.356537 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e4fd9-1cd7-4943-aab1-1597d70404e8 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:47.377650 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e4fd9-1cd7-4943-aab1-1597d70404e8 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:47.379298 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-019d46df-2ac8-45b1-a99a-c787c8a493e1 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:47.380503 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-019d46df-2ac8-45b1-a99a-c787c8a493e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:47.387299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2051a97-fe85-49bf-947d-05461eba1417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:47.388023 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2051a97-fe85-49bf-947d-05461eba1417 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:47.388308 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2051a97-fe85-49bf-947d-05461eba1417 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:47.388583 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2051a97-fe85-49bf-947d-05461eba1417 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:47.389389 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2051a97-fe85-49bf-947d-05461eba1417 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:47.389695 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2051a97-fe85-49bf-947d-05461eba1417 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:47.391618 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2051a97-fe85-49bf-947d-05461eba1417 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:47.399525 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 334/660] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:47 2021] POST /identity/v3/auth/tokens => generated 1166 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:47.409483 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 327/661] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:47.416096 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d46df-2ac8-45b1-a99a-c787c8a493e1 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:47.426272 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d46df-2ac8-45b1-a99a-c787c8a493e1 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:47.430896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b541b-4890-4b9a-b7ec-eac88e252aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:47.431544 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b541b-4890-4b9a-b7ec-eac88e252aee admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:47.431836 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b541b-4890-4b9a-b7ec-eac88e252aee admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:47.432110 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b541b-4890-4b9a-b7ec-eac88e252aee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:47.433041 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b541b-4890-4b9a-b7ec-eac88e252aee admin admin] RBAC: Adding query filter params (role.id=f28d3f93a0524078a592a15459808378, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=f518ae309c4b4f7eacca882b58e58bd0) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:47.433357 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b541b-4890-4b9a-b7ec-eac88e252aee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:47.435241 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b541b-4890-4b9a-b7ec-eac88e252aee admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:47.441738 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 335/662] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:47 2021] GET /identity/v3/role_assignments?user.id=f518ae309c4b4f7eacca882b58e58bd0&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=f28d3f93a0524078a592a15459808378 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:47.447076 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2051a97-fe85-49bf-947d-05461eba1417 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:47.457699 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2051a97-fe85-49bf-947d-05461eba1417 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:47.467831 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db177e17-39ec-4d86-9c59-eaf472d05623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:47.468518 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db177e17-39ec-4d86-9c59-eaf472d05623 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:47.468800 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db177e17-39ec-4d86-9c59-eaf472d05623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:47.469072 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db177e17-39ec-4d86-9c59-eaf472d05623 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:47.469866 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db177e17-39ec-4d86-9c59-eaf472d05623 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:47.471540 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db177e17-39ec-4d86-9c59-eaf472d05623 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:47.498236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 328/663] 10.222.0.41 () {60 vars in 1162 bytes} [Fri Oct 29 16:01:47 2021] POST /identity/v3/services => generated 251 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:01:49.192911 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c9c1d-02d9-4928-84c4-fafe1dfdc5ba None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.193425 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c9c1d-02d9-4928-84c4-fafe1dfdc5ba None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.193502 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9c9c1d-02d9-4928-84c4-fafe1dfdc5ba None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.195545 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 336/664] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:49.201702 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913e85e-69cf-42a1-b460-85e6c52ec4c1 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.202119 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913e85e-69cf-42a1-b460-85e6c52ec4c1 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.202283 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913e85e-69cf-42a1-b460-85e6c52ec4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.230912 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-e913e85e-69cf-42a1-b460-85e6c52ec4c1 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:49.232123 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e913e85e-69cf-42a1-b460-85e6c52ec4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:49.262727 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 329/665] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:49 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:49.286589 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c9c1d-02d9-4928-84c4-fafe1dfdc5ba None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.304643 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9c9c1d-02d9-4928-84c4-fafe1dfdc5ba None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.313834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c9138-5899-4244-8e88-457faf7cad6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.315042 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c9138-5899-4244-8e88-457faf7cad6f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.315543 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c9138-5899-4244-8e88-457faf7cad6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.316008 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8c9138-5899-4244-8e88-457faf7cad6f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.335307 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8c9138-5899-4244-8e88-457faf7cad6f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:49.342983 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-4d8c9138-5899-4244-8e88-457faf7cad6f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:01:49.345207 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 337/666] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/roles/service => generated 85 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:49.352147 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913e85e-69cf-42a1-b460-85e6c52ec4c1 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.367204 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913e85e-69cf-42a1-b460-85e6c52ec4c1 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.378331 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287a839f-9785-4e04-b5b9-72c20581bf65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.379012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a839f-9785-4e04-b5b9-72c20581bf65 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.379291 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a839f-9785-4e04-b5b9-72c20581bf65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.379563 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287a839f-9785-4e04-b5b9-72c20581bf65 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.380338 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a839f-9785-4e04-b5b9-72c20581bf65 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:49.380642 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a839f-9785-4e04-b5b9-72c20581bf65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:49.382296 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287a839f-9785-4e04-b5b9-72c20581bf65 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:49.393952 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 330/667] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:49.400830 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c9138-5899-4244-8e88-457faf7cad6f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.416143 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8c9138-5899-4244-8e88-457faf7cad6f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.421266 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573d27f-0ebe-4ce4-830b-e312a0b3686a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.426669 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573d27f-0ebe-4ce4-830b-e312a0b3686a admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.427266 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573d27f-0ebe-4ce4-830b-e312a0b3686a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.427756 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573d27f-0ebe-4ce4-830b-e312a0b3686a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.439188 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573d27f-0ebe-4ce4-830b-e312a0b3686a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:49.441342 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573d27f-0ebe-4ce4-830b-e312a0b3686a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:49.464261 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-1573d27f-0ebe-4ce4-830b-e312a0b3686a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:49.464968 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af9cf4-4365-45fb-b2fc-a8bd43e96623 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.465262 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af9cf4-4365-45fb-b2fc-a8bd43e96623 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.465546 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af9cf4-4365-45fb-b2fc-a8bd43e96623 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.466411 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 338/668] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:49.467592 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 331/669] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:01:49.473174 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573d27f-0ebe-4ce4-830b-e312a0b3686a admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.473801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee403a58-2c07-4699-89a8-b9c738b8bb21 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.474122 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee403a58-2c07-4699-89a8-b9c738b8bb21 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.474406 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee403a58-2c07-4699-89a8-b9c738b8bb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.487335 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573d27f-0ebe-4ce4-830b-e312a0b3686a admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.492867 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-ee403a58-2c07-4699-89a8-b9c738b8bb21 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:49.494119 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-ee403a58-2c07-4699-89a8-b9c738b8bb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:49.496247 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83af43-c7a9-4488-bd00-78300c6aef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.497317 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83af43-c7a9-4488-bd00-78300c6aef43 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.497877 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83af43-c7a9-4488-bd00-78300c6aef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.498435 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b83af43-c7a9-4488-bd00-78300c6aef43 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.499378 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83af43-c7a9-4488-bd00-78300c6aef43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:49.499979 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83af43-c7a9-4488-bd00-78300c6aef43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:49.501990 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b83af43-c7a9-4488-bd00-78300c6aef43 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:49.502406 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 332/670] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:49 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:49.522924 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 339/671] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:49.528394 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee403a58-2c07-4699-89a8-b9c738b8bb21 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.529015 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83af43-c7a9-4488-bd00-78300c6aef43 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.538559 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee403a58-2c07-4699-89a8-b9c738b8bb21 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.543137 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b83af43-c7a9-4488-bd00-78300c6aef43 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.543508 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822c786-add2-4cd4-bf3e-43bd390b04c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.544357 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822c786-add2-4cd4-bf3e-43bd390b04c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.544640 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822c786-add2-4cd4-bf3e-43bd390b04c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.544973 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822c786-add2-4cd4-bf3e-43bd390b04c0 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.553617 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05543eb0-e1d6-4e1a-aea3-4b60d0808145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.554481 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05543eb0-e1d6-4e1a-aea3-4b60d0808145 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.554763 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05543eb0-e1d6-4e1a-aea3-4b60d0808145 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.555036 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05543eb0-e1d6-4e1a-aea3-4b60d0808145 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.556447 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822c786-add2-4cd4-bf3e-43bd390b04c0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:49.563232 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05543eb0-e1d6-4e1a-aea3-4b60d0808145 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:49.564889 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-8822c786-add2-4cd4-bf3e-43bd390b04c0 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:01:49.565291 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05543eb0-e1d6-4e1a-aea3-4b60d0808145 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:49.566442 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 333/672] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:49.570261 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f108a0-1674-4fb8-81fa-ddca1c4770ba None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.570555 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f108a0-1674-4fb8-81fa-ddca1c4770ba None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.570830 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f108a0-1674-4fb8-81fa-ddca1c4770ba None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.572842 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 334/673] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:49 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:49.573780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f108a0-1674-4fb8-81fa-ddca1c4770ba None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.587668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-05543eb0-e1d6-4e1a-aea3-4b60d0808145 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 16:01:49.589155 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 340/674] 10.222.0.41 () {56 vars in 1138 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:49.590380 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e03eae-bd59-4f7e-a8f9-dc2659e0e34d None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.590665 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e03eae-bd59-4f7e-a8f9-dc2659e0e34d None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.590941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e03eae-bd59-4f7e-a8f9-dc2659e0e34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.594587 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f108a0-1674-4fb8-81fa-ddca1c4770ba None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.602477 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd894785-42a5-468a-beaf-668c5f9b6cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.603453 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd894785-42a5-468a-beaf-668c5f9b6cbe admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.604023 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd894785-42a5-468a-beaf-668c5f9b6cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.604513 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd894785-42a5-468a-beaf-668c5f9b6cbe admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.605565 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd894785-42a5-468a-beaf-668c5f9b6cbe admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:49.606635 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd894785-42a5-468a-beaf-668c5f9b6cbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:49.608864 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd894785-42a5-468a-beaf-668c5f9b6cbe admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:49.611986 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-b6e03eae-bd59-4f7e-a8f9-dc2659e0e34d None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:49.613246 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b6e03eae-bd59-4f7e-a8f9-dc2659e0e34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:49.620062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 335/675] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:49.625944 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd894785-42a5-468a-beaf-668c5f9b6cbe admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.626079 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 341/676] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:49 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:49.627278 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e03eae-bd59-4f7e-a8f9-dc2659e0e34d None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.636626 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd894785-42a5-468a-beaf-668c5f9b6cbe admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.642887 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdda62-111e-41b1-954f-8ab701a71f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.643796 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdda62-111e-41b1-954f-8ab701a71f04 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.644087 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e03eae-bd59-4f7e-a8f9-dc2659e0e34d None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.644509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdda62-111e-41b1-954f-8ab701a71f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.644955 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bdda62-111e-41b1-954f-8ab701a71f04 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.646134 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdda62-111e-41b1-954f-8ab701a71f04 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:49.646741 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdda62-111e-41b1-954f-8ab701a71f04 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:49.648890 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bdda62-111e-41b1-954f-8ab701a71f04 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:49.655101 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fd1fe-c03e-4803-a602-d6c82b802aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.655898 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fd1fe-c03e-4803-a602-d6c82b802aad admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.656179 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fd1fe-c03e-4803-a602-d6c82b802aad admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.656451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1fd1fe-c03e-4803-a602-d6c82b802aad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.670875 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fd1fe-c03e-4803-a602-d6c82b802aad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:49.671369 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 336/677] 10.222.0.41 () {56 vars in 1170 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:49.672405 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdda62-111e-41b1-954f-8ab701a71f04 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.672878 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1fd1fe-c03e-4803-a602-d6c82b802aad admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:49.687359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bdda62-111e-41b1-954f-8ab701a71f04 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.692969 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b8eb9-55ac-4581-a3ba-bd0eb09cbf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.694350 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b8eb9-55ac-4581-a3ba-bd0eb09cbf3a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.694910 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b8eb9-55ac-4581-a3ba-bd0eb09cbf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.695372 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2b8eb9-55ac-4581-a3ba-bd0eb09cbf3a admin admin] PATH_INFO: `/v3/services/network` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.695524 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-4d1fd1fe-c03e-4803-a602-d6c82b802aad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:49.696492 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b8eb9-55ac-4581-a3ba-bd0eb09cbf3a admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:49.697103 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 342/678] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:49.703075 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fd1fe-c03e-4803-a602-d6c82b802aad admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.704604 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING py.warnings [None req-2e2b8eb9-55ac-4581-a3ba-bd0eb09cbf3a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:01:49.704604 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: warnings.warn(msg) Oct 29 16:01:49.704604 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: Oct 29 16:01:49.707939 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2b8eb9-55ac-4581-a3ba-bd0eb09cbf3a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:49.712351 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1fd1fe-c03e-4803-a602-d6c82b802aad admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.716421 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cea897-6761-4bd9-a8c8-f5d233e6e8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.717133 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cea897-6761-4bd9-a8c8-f5d233e6e8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.717395 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cea897-6761-4bd9-a8c8-f5d233e6e8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.717668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cea897-6761-4bd9-a8c8-f5d233e6e8b2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.729147 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cea897-6761-4bd9-a8c8-f5d233e6e8b2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:49.731043 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cea897-6761-4bd9-a8c8-f5d233e6e8b2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:49.743227 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-2e2b8eb9-55ac-4581-a3ba-bd0eb09cbf3a admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 16:01:49.746272 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 337/679] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/services/network => generated 88 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:49.748129 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b8eb9-55ac-4581-a3ba-bd0eb09cbf3a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.755539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-18cea897-6761-4bd9-a8c8-f5d233e6e8b2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:49.757079 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 343/680] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:49.757912 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cea897-6761-4bd9-a8c8-f5d233e6e8b2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.767392 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2b8eb9-55ac-4581-a3ba-bd0eb09cbf3a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.779524 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cea897-6761-4bd9-a8c8-f5d233e6e8b2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.780099 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6ed29-e7fd-4dd1-87e4-c1e7ada714fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.783661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6ed29-e7fd-4dd1-87e4-c1e7ada714fa admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.784468 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6ed29-e7fd-4dd1-87e4-c1e7ada714fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.785345 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5dcc3-63f0-4261-8e11-1a2a2e9cc852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.785658 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6ed29-e7fd-4dd1-87e4-c1e7ada714fa admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.786161 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5dcc3-63f0-4261-8e11-1a2a2e9cc852 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.786505 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5dcc3-63f0-4261-8e11-1a2a2e9cc852 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.786842 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5dcc3-63f0-4261-8e11-1a2a2e9cc852 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.787660 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5dcc3-63f0-4261-8e11-1a2a2e9cc852 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:49.788043 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5dcc3-63f0-4261-8e11-1a2a2e9cc852 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:49.788648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6ed29-e7fd-4dd1-87e4-c1e7ada714fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:49.789462 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6ed29-e7fd-4dd1-87e4-c1e7ada714fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:49.789873 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5dcc3-63f0-4261-8e11-1a2a2e9cc852 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:49.793954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6ed29-e7fd-4dd1-87e4-c1e7ada714fa admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:49.795351 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 344/681] 10.222.0.41 () {56 vars in 1133 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/services?name=network => generated 124 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:49.801396 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5dcc3-63f0-4261-8e11-1a2a2e9cc852 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.811307 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5dcc3-63f0-4261-8e11-1a2a2e9cc852 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.816148 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5ad3e-6775-4858-8fa9-3d5e54dd643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.816912 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5ad3e-6775-4858-8fa9-3d5e54dd643f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.817255 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5ad3e-6775-4858-8fa9-3d5e54dd643f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.817599 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5ad3e-6775-4858-8fa9-3d5e54dd643f admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.818446 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5ad3e-6775-4858-8fa9-3d5e54dd643f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:49.818815 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5ad3e-6775-4858-8fa9-3d5e54dd643f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:49.820517 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5ad3e-6775-4858-8fa9-3d5e54dd643f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:49.821741 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 338/682] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:49.827321 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6ed29-e7fd-4dd1-87e4-c1e7ada714fa admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.842800 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 345/683] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:49.843426 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5ad3e-6775-4858-8fa9-3d5e54dd643f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.846007 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6ed29-e7fd-4dd1-87e4-c1e7ada714fa admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.853861 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5ad3e-6775-4858-8fa9-3d5e54dd643f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.856043 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10a366-2b8d-4ad3-a98c-43c33c2d431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.857777 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10a366-2b8d-4ad3-a98c-43c33c2d431f admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.858734 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10a366-2b8d-4ad3-a98c-43c33c2d431f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.858909 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd65f02-ceaf-41ca-8e3b-204cd27b0484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.859693 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c10a366-2b8d-4ad3-a98c-43c33c2d431f admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.859849 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd65f02-ceaf-41ca-8e3b-204cd27b0484 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.860063 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd65f02-ceaf-41ca-8e3b-204cd27b0484 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.860501 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd65f02-ceaf-41ca-8e3b-204cd27b0484 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.862438 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10a366-2b8d-4ad3-a98c-43c33c2d431f admin admin] RBAC: Adding query filter params (type=network) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:49.863486 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10a366-2b8d-4ad3-a98c-43c33c2d431f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:49.867501 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c10a366-2b8d-4ad3-a98c-43c33c2d431f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:49.869565 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd65f02-ceaf-41ca-8e3b-204cd27b0484 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:49.871723 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd65f02-ceaf-41ca-8e3b-204cd27b0484 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:49.880188 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 339/684] 10.222.0.41 () {56 vars in 1133 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/services?type=network => generated 350 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:49.881998 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10a366-2b8d-4ad3-a98c-43c33c2d431f admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.892340 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-ebd65f02-ceaf-41ca-8e3b-204cd27b0484 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 16:01:49.894282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 346/685] 10.222.0.41 () {56 vars in 1114 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/users/nova => generated 82 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:49.894519 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd65f02-ceaf-41ca-8e3b-204cd27b0484 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.901780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c10a366-2b8d-4ad3-a98c-43c33c2d431f admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.904800 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd65f02-ceaf-41ca-8e3b-204cd27b0484 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.910223 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273a4cc-893d-4f24-b239-460cfb2ef1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.911123 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273a4cc-893d-4f24-b239-460cfb2ef1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.911481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273a4cc-893d-4f24-b239-460cfb2ef1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.911850 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273a4cc-893d-4f24-b239-460cfb2ef1b0 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.912349 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fbca2-06a9-4b28-a0f4-abb0096bc08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.914122 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fbca2-06a9-4b28-a0f4-abb0096bc08a admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.915191 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fbca2-06a9-4b28-a0f4-abb0096bc08a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.916346 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fbca2-06a9-4b28-a0f4-abb0096bc08a admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.918064 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fbca2-06a9-4b28-a0f4-abb0096bc08a admin admin] RBAC: Adding query filter params (interface=public, service_id=d1e18ec871f748a1bb33fae880ded72d, region_id=RegionOne) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:49.918850 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fbca2-06a9-4b28-a0f4-abb0096bc08a admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:49.920470 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273a4cc-893d-4f24-b239-460cfb2ef1b0 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:49.921424 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING py.warnings [None req-442fbca2-06a9-4b28-a0f4-abb0096bc08a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:01:49.921424 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: warnings.warn(msg) Oct 29 16:01:49.921424 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: Oct 29 16:01:49.922792 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273a4cc-893d-4f24-b239-460cfb2ef1b0 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:49.923739 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fbca2-06a9-4b28-a0f4-abb0096bc08a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:49.936543 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-2273a4cc-893d-4f24-b239-460cfb2ef1b0 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:49.938091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 340/686] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:49.939657 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273a4cc-893d-4f24-b239-460cfb2ef1b0 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.940018 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 347/687] 10.222.0.41 () {56 vars in 1272 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/endpoints?service_id=d1e18ec871f748a1bb33fae880ded72d&interface=public®ion_id=RegionOne => generated 194 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:49.947517 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fbca2-06a9-4b28-a0f4-abb0096bc08a admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.957682 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273a4cc-893d-4f24-b239-460cfb2ef1b0 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.963223 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ccd88-429a-45ee-991b-8aff54561cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.963893 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ccd88-429a-45ee-991b-8aff54561cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.964189 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ccd88-429a-45ee-991b-8aff54561cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.964498 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ccd88-429a-45ee-991b-8aff54561cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.965470 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ccd88-429a-45ee-991b-8aff54561cf5 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:49.965788 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ccd88-429a-45ee-991b-8aff54561cf5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:49.967891 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ccd88-429a-45ee-991b-8aff54561cf5 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:49.970311 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fbca2-06a9-4b28-a0f4-abb0096bc08a admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:49.981242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e9f81-9798-4016-85d6-494fe7ae2789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:49.982710 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e9f81-9798-4016-85d6-494fe7ae2789 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:49.983454 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e9f81-9798-4016-85d6-494fe7ae2789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:49.984858 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e9f81-9798-4016-85d6-494fe7ae2789 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:49.987068 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e9f81-9798-4016-85d6-494fe7ae2789 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:49.989078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 341/688] 10.222.0.41 () {56 vars in 1154 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:49.990071 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ccd88-429a-45ee-991b-8aff54561cf5 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:49.991188 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e9f81-9798-4016-85d6-494fe7ae2789 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:50.001400 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ccd88-429a-45ee-991b-8aff54561cf5 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:50.003795 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 348/689] 10.222.0.41 () {56 vars in 1108 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/services => generated 772 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:50.005371 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e9f81-9798-4016-85d6-494fe7ae2789 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:50.023541 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ed225-98f2-45ca-a885-24f09bf73963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:50.025132 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ed225-98f2-45ca-a885-24f09bf73963 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.025856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ed225-98f2-45ca-a885-24f09bf73963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.026602 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ed225-98f2-45ca-a885-24f09bf73963 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.028313 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ed225-98f2-45ca-a885-24f09bf73963 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:50.031513 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ed225-98f2-45ca-a885-24f09bf73963 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:50.034182 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ed225-98f2-45ca-a885-24f09bf73963 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:50.038900 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e9f81-9798-4016-85d6-494fe7ae2789 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:50.047009 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c380dc2-5e0a-40ca-adf4-9d0407025a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:50.048637 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380dc2-5e0a-40ca-adf4-9d0407025a1f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.049409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380dc2-5e0a-40ca-adf4-9d0407025a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.050336 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c380dc2-5e0a-40ca-adf4-9d0407025a1f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.068446 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c380dc2-5e0a-40ca-adf4-9d0407025a1f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:50.072126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c380dc2-5e0a-40ca-adf4-9d0407025a1f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:50.093208 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 349/690] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:50 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:50.093956 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 342/691] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:50.111803 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c380dc2-5e0a-40ca-adf4-9d0407025a1f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:50.112951 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ed225-98f2-45ca-a885-24f09bf73963 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:50.129064 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c380dc2-5e0a-40ca-adf4-9d0407025a1f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:50.142524 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ed225-98f2-45ca-a885-24f09bf73963 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:50.150549 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48121d-3efb-4901-9d75-d83ae52b518b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:50.151875 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48121d-3efb-4901-9d75-d83ae52b518b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.152335 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48121d-3efb-4901-9d75-d83ae52b518b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.152791 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48121d-3efb-4901-9d75-d83ae52b518b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.164052 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4757eb7-3a3f-44a6-8180-3b3c03e0768d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:50.164955 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4757eb7-3a3f-44a6-8180-3b3c03e0768d admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.165279 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4757eb7-3a3f-44a6-8180-3b3c03e0768d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.165561 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4757eb7-3a3f-44a6-8180-3b3c03e0768d admin admin] PATH_INFO: `/v3/projects/4939afba2b604181b67577f309c9550a/users/10b4daa146fa4b638d90ea1e9a4878eb/roles/01b3b9b5c0d846968d6a5219373998f8` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.178993 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48121d-3efb-4901-9d75-d83ae52b518b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:50.180905 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48121d-3efb-4901-9d75-d83ae52b518b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:50.201362 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4757eb7-3a3f-44a6-8180-3b3c03e0768d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4939afba2b604181b67577f309c9550a, user_id=10b4daa146fa4b638d90ea1e9a4878eb, role_id=01b3b9b5c0d846968d6a5219373998f8)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:50.205729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4757eb7-3a3f-44a6-8180-3b3c03e0768d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:50.216619 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-9e48121d-3efb-4901-9d75-d83ae52b518b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:50.217887 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 350/692] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 108 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:50.227954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48121d-3efb-4901-9d75-d83ae52b518b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:50.237277 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 343/693] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:01:50 2021] PUT /identity/v3/projects/4939afba2b604181b67577f309c9550a/users/10b4daa146fa4b638d90ea1e9a4878eb/roles/01b3b9b5c0d846968d6a5219373998f8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:01:50.247118 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48121d-3efb-4901-9d75-d83ae52b518b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:50.314634 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527e5f1-53a3-4d30-b357-b3eed7a39a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:50.315353 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527e5f1-53a3-4d30-b357-b3eed7a39a70 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.315639 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527e5f1-53a3-4d30-b357-b3eed7a39a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.315914 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5527e5f1-53a3-4d30-b357-b3eed7a39a70 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.316803 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527e5f1-53a3-4d30-b357-b3eed7a39a70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:50.317117 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527e5f1-53a3-4d30-b357-b3eed7a39a70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:50.319049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5527e5f1-53a3-4d30-b357-b3eed7a39a70 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:50.338681 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 351/694] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:50.346098 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4757eb7-3a3f-44a6-8180-3b3c03e0768d admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:50.357050 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4757eb7-3a3f-44a6-8180-3b3c03e0768d admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:50.362190 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ef584-9ac7-4c0e-8d85-c7fdca9edca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:50.363068 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ef584-9ac7-4c0e-8d85-c7fdca9edca1 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.363352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ef584-9ac7-4c0e-8d85-c7fdca9edca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.363631 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ef584-9ac7-4c0e-8d85-c7fdca9edca1 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.371701 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ef584-9ac7-4c0e-8d85-c7fdca9edca1 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:50.373835 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ef584-9ac7-4c0e-8d85-c7fdca9edca1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:50.389147 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-228ef584-9ac7-4c0e-8d85-c7fdca9edca1 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:50.396582 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 344/695] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:50.398081 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527e5f1-53a3-4d30-b357-b3eed7a39a70 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:50.409736 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5527e5f1-53a3-4d30-b357-b3eed7a39a70 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:50.414742 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7230d43b-3968-4276-bfaa-233111de75da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:50.415432 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230d43b-3968-4276-bfaa-233111de75da admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.415768 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230d43b-3968-4276-bfaa-233111de75da admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.416040 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7230d43b-3968-4276-bfaa-233111de75da admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.416925 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230d43b-3968-4276-bfaa-233111de75da admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:50.417241 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230d43b-3968-4276-bfaa-233111de75da admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:50.419376 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7230d43b-3968-4276-bfaa-233111de75da admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:50.438408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 352/696] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:50 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:50.446101 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ef584-9ac7-4c0e-8d85-c7fdca9edca1 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:50.462433 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ef584-9ac7-4c0e-8d85-c7fdca9edca1 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:50.470578 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0128613-d7f6-498a-a954-afa63482dfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:50.471732 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0128613-d7f6-498a-a954-afa63482dfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.472288 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0128613-d7f6-498a-a954-afa63482dfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.472775 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0128613-d7f6-498a-a954-afa63482dfd2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.474507 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0128613-d7f6-498a-a954-afa63482dfd2 admin admin] RBAC: Adding query filter params (role.id=f28d3f93a0524078a592a15459808378, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=4f13d0e9f79a433c81759ecd819a6dfa) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:50.475121 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0128613-d7f6-498a-a954-afa63482dfd2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:50.478912 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0128613-d7f6-498a-a954-afa63482dfd2 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:50.487871 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be9d65-abc4-46a2-8764-78af6ab26049 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.488223 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be9d65-abc4-46a2-8764-78af6ab26049 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.488465 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86be9d65-abc4-46a2-8764-78af6ab26049 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.490432 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 353/697] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:01:50.493511 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 345/698] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:50 2021] GET /identity/v3/role_assignments?user.id=4f13d0e9f79a433c81759ecd819a6dfa&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=f28d3f93a0524078a592a15459808378 => generated 608 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:50.498066 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77795f5-f7ba-458c-a9e7-c0eec68e6952 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.498377 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77795f5-f7ba-458c-a9e7-c0eec68e6952 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.498668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77795f5-f7ba-458c-a9e7-c0eec68e6952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.532241 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e77795f5-f7ba-458c-a9e7-c0eec68e6952 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:50.534032 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e77795f5-f7ba-458c-a9e7-c0eec68e6952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:50.551890 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 354/699] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:50 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:50.592664 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0128613-d7f6-498a-a954-afa63482dfd2 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:50.607126 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0128613-d7f6-498a-a954-afa63482dfd2 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:50.612214 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532ae22-0aae-40de-92e1-b78be39f6d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:50.613081 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532ae22-0aae-40de-92e1-b78be39f6d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.613366 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532ae22-0aae-40de-92e1-b78be39f6d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.613659 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4532ae22-0aae-40de-92e1-b78be39f6d77 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.627598 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4532ae22-0aae-40de-92e1-b78be39f6d77 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:50.635190 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-4532ae22-0aae-40de-92e1-b78be39f6d77 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:01:50.636523 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 346/700] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:50 2021] GET /identity/v3/roles/admin => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:50.646058 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77795f5-f7ba-458c-a9e7-c0eec68e6952 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:50.657789 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77795f5-f7ba-458c-a9e7-c0eec68e6952 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:50.664067 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470ca5a-ed95-417f-b868-950b27379564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:50.664771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470ca5a-ed95-417f-b868-950b27379564 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.665101 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470ca5a-ed95-417f-b868-950b27379564 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.665385 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2470ca5a-ed95-417f-b868-950b27379564 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.666229 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470ca5a-ed95-417f-b868-950b27379564 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:50.666539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470ca5a-ed95-417f-b868-950b27379564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:50.669043 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2470ca5a-ed95-417f-b868-950b27379564 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:50.680147 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 355/701] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:50 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:50.686835 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532ae22-0aae-40de-92e1-b78be39f6d77 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:50.698006 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4532ae22-0aae-40de-92e1-b78be39f6d77 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:50.703320 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405e279-6b40-472a-be7d-fe6cbbb68afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:50.704762 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405e279-6b40-472a-be7d-fe6cbbb68afe admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.705049 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405e279-6b40-472a-be7d-fe6cbbb68afe admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.705330 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405e279-6b40-472a-be7d-fe6cbbb68afe admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.717347 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405e279-6b40-472a-be7d-fe6cbbb68afe admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:50.719402 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405e279-6b40-472a-be7d-fe6cbbb68afe admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:50.739316 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-4405e279-6b40-472a-be7d-fe6cbbb68afe admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:50.740545 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 347/702] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:50.747314 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470ca5a-ed95-417f-b868-950b27379564 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:50.758795 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2470ca5a-ed95-417f-b868-950b27379564 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:50.766166 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef384d-65d0-498d-b203-85a79e4998d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:50.767450 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef384d-65d0-498d-b203-85a79e4998d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.767735 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef384d-65d0-498d-b203-85a79e4998d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.768014 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ef384d-65d0-498d-b203-85a79e4998d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.768818 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef384d-65d0-498d-b203-85a79e4998d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:50.769129 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef384d-65d0-498d-b203-85a79e4998d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:50.770901 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ef384d-65d0-498d-b203-85a79e4998d5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:50.784385 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 356/703] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:50.790994 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405e279-6b40-472a-be7d-fe6cbbb68afe admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:50.802706 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405e279-6b40-472a-be7d-fe6cbbb68afe admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:50.807785 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd708d8d-3c06-478d-a382-162afff9d85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:50.808656 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd708d8d-3c06-478d-a382-162afff9d85c admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.808937 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd708d8d-3c06-478d-a382-162afff9d85c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.809259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd708d8d-3c06-478d-a382-162afff9d85c admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.819371 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd708d8d-3c06-478d-a382-162afff9d85c admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:50.821581 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd708d8d-3c06-478d-a382-162afff9d85c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:50.837148 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-cd708d8d-3c06-478d-a382-162afff9d85c admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 29 16:01:50.838634 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 348/704] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:50 2021] GET /identity/v3/users/swift => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:50.845023 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef384d-65d0-498d-b203-85a79e4998d5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:50.855884 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ef384d-65d0-498d-b203-85a79e4998d5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:50.861052 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411e7fb-6409-423e-89a0-be8aaac8a02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:50.861730 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411e7fb-6409-423e-89a0-be8aaac8a02e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.862093 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411e7fb-6409-423e-89a0-be8aaac8a02e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.862377 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411e7fb-6409-423e-89a0-be8aaac8a02e admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.863290 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411e7fb-6409-423e-89a0-be8aaac8a02e admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:50.863602 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411e7fb-6409-423e-89a0-be8aaac8a02e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:50.865622 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d411e7fb-6409-423e-89a0-be8aaac8a02e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:50.884405 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 357/705] 10.222.0.41 () {56 vars in 1156 bytes} [Fri Oct 29 16:01:50 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:50.891004 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd708d8d-3c06-478d-a382-162afff9d85c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:50.901766 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd708d8d-3c06-478d-a382-162afff9d85c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:50.906795 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449833a5-4160-4039-90bd-93f8c40ecbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:50.907617 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449833a5-4160-4039-90bd-93f8c40ecbd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.907958 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449833a5-4160-4039-90bd-93f8c40ecbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.908237 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449833a5-4160-4039-90bd-93f8c40ecbd5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.920814 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449833a5-4160-4039-90bd-93f8c40ecbd5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:50.922838 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449833a5-4160-4039-90bd-93f8c40ecbd5 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:50.941249 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-449833a5-4160-4039-90bd-93f8c40ecbd5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:50.946088 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 349/706] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:50.950442 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411e7fb-6409-423e-89a0-be8aaac8a02e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:50.958809 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab07124-22c9-48b4-98bd-f46e7cf47813 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.959094 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab07124-22c9-48b4-98bd-f46e7cf47813 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.959373 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab07124-22c9-48b4-98bd-f46e7cf47813 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.961479 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 350/707] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:50.962048 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411e7fb-6409-423e-89a0-be8aaac8a02e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:50.966880 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1f0ea-911f-41f0-abca-072c31deff58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:50.967587 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1f0ea-911f-41f0-abca-072c31deff58 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.967760 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e7726-a9a5-4e9b-a383-2d6f358d1bda None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:50.967912 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1f0ea-911f-41f0-abca-072c31deff58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.968093 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e7726-a9a5-4e9b-a383-2d6f358d1bda None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:50.968240 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e7726-a9a5-4e9b-a383-2d6f358d1bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.968382 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d1f0ea-911f-41f0-abca-072c31deff58 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:50.968910 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1f0ea-911f-41f0-abca-072c31deff58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:50.969266 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1f0ea-911f-41f0-abca-072c31deff58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:50.971502 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d1f0ea-911f-41f0-abca-072c31deff58 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:50.986057 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 358/708] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:50.988503 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-480e7726-a9a5-4e9b-a383-2d6f358d1bda None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:50.989764 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-480e7726-a9a5-4e9b-a383-2d6f358d1bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:50.991534 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1f0ea-911f-41f0-abca-072c31deff58 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:50.999246 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 351/709] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:50 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:51.006938 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d1f0ea-911f-41f0-abca-072c31deff58 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:51.013769 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fa706-cadb-4fdf-9cd1-3c2fbf430e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:51.015170 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fa706-cadb-4fdf-9cd1-3c2fbf430e01 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:51.015612 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fa706-cadb-4fdf-9cd1-3c2fbf430e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:51.016104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2fa706-cadb-4fdf-9cd1-3c2fbf430e01 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:51.028345 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fa706-cadb-4fdf-9cd1-3c2fbf430e01 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:51.030913 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e7726-a9a5-4e9b-a383-2d6f358d1bda None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:51.031845 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2fa706-cadb-4fdf-9cd1-3c2fbf430e01 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:51.044092 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e7726-a9a5-4e9b-a383-2d6f358d1bda None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:51.048407 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-db2fa706-cadb-4fdf-9cd1-3c2fbf430e01 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:51.049158 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc2035-9503-4efe-9576-d09acb2db636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:51.050266 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc2035-9503-4efe-9576-d09acb2db636 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:51.050753 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc2035-9503-4efe-9576-d09acb2db636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:51.051226 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc2035-9503-4efe-9576-d09acb2db636 admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:51.052953 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc2035-9503-4efe-9576-d09acb2db636 admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:51.054042 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 359/710] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:50 2021] GET /identity/v3/projects/service => generated 88 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:51.055090 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc2035-9503-4efe-9576-d09acb2db636 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:51.056380 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fa706-cadb-4fdf-9cd1-3c2fbf430e01 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:51.067472 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2fa706-cadb-4fdf-9cd1-3c2fbf430e01 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:51.074080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387de5ee-6c1e-420d-a523-a61613f15b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:51.074573 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-eccc2035-9503-4efe-9576-d09acb2db636 admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 16:01:51.074793 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387de5ee-6c1e-420d-a523-a61613f15b11 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:51.075081 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387de5ee-6c1e-420d-a523-a61613f15b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:51.075359 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387de5ee-6c1e-420d-a523-a61613f15b11 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:51.076533 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387de5ee-6c1e-420d-a523-a61613f15b11 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:51.076898 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387de5ee-6c1e-420d-a523-a61613f15b11 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:51.077642 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 352/711] 10.222.0.41 () {56 vars in 1150 bytes} [Fri Oct 29 16:01:51 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:51.084796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387de5ee-6c1e-420d-a523-a61613f15b11 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:51.084935 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc2035-9503-4efe-9576-d09acb2db636 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:51.092691 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 360/712] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:51 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:51.105733 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc2035-9503-4efe-9576-d09acb2db636 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:51.112709 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387de5ee-6c1e-420d-a523-a61613f15b11 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:51.122020 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8db1e-583d-4623-877f-f9b852b64af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:51.122892 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8db1e-583d-4623-877f-f9b852b64af5 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:51.123178 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8db1e-583d-4623-877f-f9b852b64af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:51.123463 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8db1e-583d-4623-877f-f9b852b64af5 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:51.124238 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8db1e-583d-4623-877f-f9b852b64af5 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:51.124546 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8db1e-583d-4623-877f-f9b852b64af5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:51.125548 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387de5ee-6c1e-420d-a523-a61613f15b11 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:51.126297 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8db1e-583d-4623-877f-f9b852b64af5 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:51.130707 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7c8f9-8862-42b3-8aca-5461ec082eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:51.131835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7c8f9-8862-42b3-8aca-5461ec082eca admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:51.132338 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7c8f9-8862-42b3-8aca-5461ec082eca admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:51.132823 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7c8f9-8862-42b3-8aca-5461ec082eca admin admin] PATH_INFO: `/v3/projects/4939afba2b604181b67577f309c9550a/users/f518ae309c4b4f7eacca882b58e58bd0/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:51.135071 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7c8f9-8862-42b3-8aca-5461ec082eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=4939afba2b604181b67577f309c9550a, user_id=f518ae309c4b4f7eacca882b58e58bd0, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:51.137960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7c8f9-8862-42b3-8aca-5461ec082eca admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:51.138199 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 353/713] 10.222.0.41 () {56 vars in 1145 bytes} [Fri Oct 29 16:01:51 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:51.145488 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8db1e-583d-4623-877f-f9b852b64af5 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:51.156041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8db1e-583d-4623-877f-f9b852b64af5 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:51.162777 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26039a-ecf8-4a37-937b-9061fe1ef7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:51.163879 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26039a-ecf8-4a37-937b-9061fe1ef7ee admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:51.164555 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26039a-ecf8-4a37-937b-9061fe1ef7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:51.165014 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da26039a-ecf8-4a37-937b-9061fe1ef7ee admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:51.166184 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26039a-ecf8-4a37-937b-9061fe1ef7ee admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:51.166703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26039a-ecf8-4a37-937b-9061fe1ef7ee admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:51.168662 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da26039a-ecf8-4a37-937b-9061fe1ef7ee admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:51.168945 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 361/714] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:01:51 2021] PUT /identity/v3/projects/4939afba2b604181b67577f309c9550a/users/f518ae309c4b4f7eacca882b58e58bd0/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:01:51.175080 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 354/715] 10.222.0.41 () {56 vars in 1145 bytes} [Fri Oct 29 16:01:51 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:51.181750 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7c8f9-8862-42b3-8aca-5461ec082eca admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:51.294681 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7c8f9-8862-42b3-8aca-5461ec082eca admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:51.301847 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f4443-45fc-44e2-abff-c8291b494954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:51.302559 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f4443-45fc-44e2-abff-c8291b494954 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:51.302842 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f4443-45fc-44e2-abff-c8291b494954 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:51.303116 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f4443-45fc-44e2-abff-c8291b494954 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:51.303932 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f4443-45fc-44e2-abff-c8291b494954 admin admin] RBAC: Adding query filter params (interface=public, service_id=ed32100b498b4fd4b6ff7b3fe08b4a4a, region_id=RegionOne) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:51.304245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f4443-45fc-44e2-abff-c8291b494954 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:51.305879 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f4443-45fc-44e2-abff-c8291b494954 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:51.314547 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 362/716] 10.222.0.41 () {56 vars in 1272 bytes} [Fri Oct 29 16:01:51 2021] GET /identity/v3/endpoints?service_id=ed32100b498b4fd4b6ff7b3fe08b4a4a&interface=public®ion_id=RegionOne => generated 194 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:51.320471 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26039a-ecf8-4a37-937b-9061fe1ef7ee admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:51.336828 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da26039a-ecf8-4a37-937b-9061fe1ef7ee admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:51.345273 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591c494-aa79-41dd-b290-32345d6414dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:51.346337 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591c494-aa79-41dd-b290-32345d6414dc admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:51.346859 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591c494-aa79-41dd-b290-32345d6414dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:51.347481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591c494-aa79-41dd-b290-32345d6414dc admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:51.348491 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591c494-aa79-41dd-b290-32345d6414dc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:51.350439 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9591c494-aa79-41dd-b290-32345d6414dc admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:51.363003 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 355/717] 10.222.0.41 () {56 vars in 1108 bytes} [Fri Oct 29 16:01:51 2021] GET /identity/v3/services => generated 772 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:52.930540 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880e7f6-d859-43e5-9a18-8d156dc4e789 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:52.931047 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880e7f6-d859-43e5-9a18-8d156dc4e789 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:52.931121 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5880e7f6-d859-43e5-9a18-8d156dc4e789 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:52.933172 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 363/718] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:52.948078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84769a90-827f-4ce3-be37-aa090a8ff755 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:52.948624 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84769a90-827f-4ce3-be37-aa090a8ff755 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:52.948624 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84769a90-827f-4ce3-be37-aa090a8ff755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:52.972855 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-84769a90-827f-4ce3-be37-aa090a8ff755 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:52.974147 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-84769a90-827f-4ce3-be37-aa090a8ff755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:52.988617 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 356/719] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:52 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:53.012512 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880e7f6-d859-43e5-9a18-8d156dc4e789 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:53.034708 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5880e7f6-d859-43e5-9a18-8d156dc4e789 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:53.039196 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deec8a0-42aa-4852-87fa-0184169255b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:53.039992 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deec8a0-42aa-4852-87fa-0184169255b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.040264 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deec8a0-42aa-4852-87fa-0184169255b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.040532 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deec8a0-42aa-4852-87fa-0184169255b4 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.041247 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deec8a0-42aa-4852-87fa-0184169255b4 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:53.044080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deec8a0-42aa-4852-87fa-0184169255b4 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:53.056578 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-5deec8a0-42aa-4852-87fa-0184169255b4 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 29 16:01:53.058450 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 364/720] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:53 2021] GET /identity/v3/services/network => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:53.064970 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84769a90-827f-4ce3-be37-aa090a8ff755 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:53.076753 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84769a90-827f-4ce3-be37-aa090a8ff755 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:53.090446 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713e064-1c58-407d-9c0e-bc5b37410ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:53.091126 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713e064-1c58-407d-9c0e-bc5b37410ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.091409 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713e064-1c58-407d-9c0e-bc5b37410ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.091688 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713e064-1c58-407d-9c0e-bc5b37410ab3 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.092428 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713e064-1c58-407d-9c0e-bc5b37410ab3 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:53.092736 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713e064-1c58-407d-9c0e-bc5b37410ab3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:53.094377 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713e064-1c58-407d-9c0e-bc5b37410ab3 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:53.100281 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 357/721] 10.222.0.41 () {56 vars in 1133 bytes} [Fri Oct 29 16:01:53 2021] GET /identity/v3/services?name=network => generated 124 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:53.106603 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deec8a0-42aa-4852-87fa-0184169255b4 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:53.117573 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deec8a0-42aa-4852-87fa-0184169255b4 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:53.130193 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f19486-f84f-40b9-a371-3a473f784397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:53.130878 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f19486-f84f-40b9-a371-3a473f784397 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.131161 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f19486-f84f-40b9-a371-3a473f784397 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.131437 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f19486-f84f-40b9-a371-3a473f784397 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.132172 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f19486-f84f-40b9-a371-3a473f784397 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:53.132480 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f19486-f84f-40b9-a371-3a473f784397 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:53.134118 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f19486-f84f-40b9-a371-3a473f784397 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:53.142327 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 365/722] 10.222.0.41 () {56 vars in 1133 bytes} [Fri Oct 29 16:01:53 2021] GET /identity/v3/services?type=network => generated 350 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:53.148736 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713e064-1c58-407d-9c0e-bc5b37410ab3 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:53.159237 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713e064-1c58-407d-9c0e-bc5b37410ab3 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:53.170316 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c13fa-794c-444f-a19e-3a64c5e6b520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:53.170991 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c13fa-794c-444f-a19e-3a64c5e6b520 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.171275 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c13fa-794c-444f-a19e-3a64c5e6b520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.171552 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c13fa-794c-444f-a19e-3a64c5e6b520 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.171649 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cd527-2066-4f0e-bdc4-e26cfde6b3ae None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.171927 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cd527-2066-4f0e-bdc4-e26cfde6b3ae None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.172197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351cd527-2066-4f0e-bdc4-e26cfde6b3ae None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.172312 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c13fa-794c-444f-a19e-3a64c5e6b520 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:53.173936 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING py.warnings [None req-d23c13fa-794c-444f-a19e-3a64c5e6b520 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:01:53.173936 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: warnings.warn(msg) Oct 29 16:01:53.173936 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: Oct 29 16:01:53.174825 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c13fa-794c-444f-a19e-3a64c5e6b520 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:53.174924 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 366/723] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:01:53.180683 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62d631-1e75-42f7-88b5-0ab4aee2bd8e None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.180966 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62d631-1e75-42f7-88b5-0ab4aee2bd8e None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.181242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62d631-1e75-42f7-88b5-0ab4aee2bd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.201102 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-5f62d631-1e75-42f7-88b5-0ab4aee2bd8e None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:53.202384 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-5f62d631-1e75-42f7-88b5-0ab4aee2bd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:53.211272 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 367/724] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:53 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:53.213265 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 358/725] 10.222.0.41 () {60 vars in 1165 bytes} [Fri Oct 29 16:01:53 2021] POST /identity/v3/endpoints => generated 327 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:01:53.260019 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62d631-1e75-42f7-88b5-0ab4aee2bd8e None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:53.269579 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62d631-1e75-42f7-88b5-0ab4aee2bd8e None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:53.284679 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017f7ef-9548-4c41-aec4-d7a10fd3a7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:53.285528 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017f7ef-9548-4c41-aec4-d7a10fd3a7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.285750 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017f7ef-9548-4c41-aec4-d7a10fd3a7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.286140 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017f7ef-9548-4c41-aec4-d7a10fd3a7a2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.297448 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5017f7ef-9548-4c41-aec4-d7a10fd3a7a2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:53.304550 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-5017f7ef-9548-4c41-aec4-d7a10fd3a7a2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:01:53.306073 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 368/726] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:01:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:53.312588 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c13fa-794c-444f-a19e-3a64c5e6b520 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:53.330608 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c13fa-794c-444f-a19e-3a64c5e6b520 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:53.337857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0056a1e-2e57-42d5-92d2-ee122d62e9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:53.338706 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0056a1e-2e57-42d5-92d2-ee122d62e9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.339050 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0056a1e-2e57-42d5-92d2-ee122d62e9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.339394 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0056a1e-2e57-42d5-92d2-ee122d62e9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.340243 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0056a1e-2e57-42d5-92d2-ee122d62e9d9 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:53.340617 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0056a1e-2e57-42d5-92d2-ee122d62e9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:53.342412 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0056a1e-2e57-42d5-92d2-ee122d62e9d9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:53.358417 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 359/727] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:01:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:53.365159 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017f7ef-9548-4c41-aec4-d7a10fd3a7a2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:53.379778 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5017f7ef-9548-4c41-aec4-d7a10fd3a7a2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:53.390379 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72436a5-8ebd-4876-a7bd-d825784cc570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:53.392121 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72436a5-8ebd-4876-a7bd-d825784cc570 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.392603 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72436a5-8ebd-4876-a7bd-d825784cc570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.393046 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72436a5-8ebd-4876-a7bd-d825784cc570 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.414401 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72436a5-8ebd-4876-a7bd-d825784cc570 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:53.416660 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72436a5-8ebd-4876-a7bd-d825784cc570 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:53.447008 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-b72436a5-8ebd-4876-a7bd-d825784cc570 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:53.448617 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 369/728] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 84 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:53.455943 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0056a1e-2e57-42d5-92d2-ee122d62e9d9 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:53.471691 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0056a1e-2e57-42d5-92d2-ee122d62e9d9 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:53.483385 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a5c3c-e580-4d5d-ada0-fc6ef2963928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:53.484105 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a5c3c-e580-4d5d-ada0-fc6ef2963928 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.484381 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a5c3c-e580-4d5d-ada0-fc6ef2963928 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.484655 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a5c3c-e580-4d5d-ada0-fc6ef2963928 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.485457 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a5c3c-e580-4d5d-ada0-fc6ef2963928 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:53.485757 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a5c3c-e580-4d5d-ada0-fc6ef2963928 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:53.487352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a5c3c-e580-4d5d-ada0-fc6ef2963928 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:53.501735 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 360/729] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:53.507561 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72436a5-8ebd-4876-a7bd-d825784cc570 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:53.519353 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72436a5-8ebd-4876-a7bd-d825784cc570 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:53.526191 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e63b7f-e03e-4340-ba0e-154d29025598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:53.527283 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e63b7f-e03e-4340-ba0e-154d29025598 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.527798 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e63b7f-e03e-4340-ba0e-154d29025598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.528347 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e63b7f-e03e-4340-ba0e-154d29025598 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.541609 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e63b7f-e03e-4340-ba0e-154d29025598 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:53.544062 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e63b7f-e03e-4340-ba0e-154d29025598 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:53.560067 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-c4e63b7f-e03e-4340-ba0e-154d29025598 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 16:01:53.561606 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 370/730] 10.222.0.41 () {56 vars in 1138 bytes} [Fri Oct 29 16:01:53 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:53.567616 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a5c3c-e580-4d5d-ada0-fc6ef2963928 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:53.581551 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a5c3c-e580-4d5d-ada0-fc6ef2963928 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:53.590516 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354424c-e263-4f90-8191-b05ad64b52b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:53.591197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354424c-e263-4f90-8191-b05ad64b52b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.591474 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354424c-e263-4f90-8191-b05ad64b52b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.591759 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354424c-e263-4f90-8191-b05ad64b52b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.592618 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354424c-e263-4f90-8191-b05ad64b52b5 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:53.592923 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354424c-e263-4f90-8191-b05ad64b52b5 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:53.595455 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354424c-e263-4f90-8191-b05ad64b52b5 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:53.624110 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 361/731] 10.222.0.41 () {56 vars in 1170 bytes} [Fri Oct 29 16:01:53 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:53.631258 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e63b7f-e03e-4340-ba0e-154d29025598 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:53.647133 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e63b7f-e03e-4340-ba0e-154d29025598 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:53.651673 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1567df5-d9fd-4605-a8e6-9acc6771014c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:53.652317 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1567df5-d9fd-4605-a8e6-9acc6771014c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.652593 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1567df5-d9fd-4605-a8e6-9acc6771014c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.652863 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1567df5-d9fd-4605-a8e6-9acc6771014c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.661220 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1567df5-d9fd-4605-a8e6-9acc6771014c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:53.663070 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1567df5-d9fd-4605-a8e6-9acc6771014c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:53.674580 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 371/732] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:53 2021] GET /identity/v3/auth/tokens => generated 1419 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:53.680757 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354424c-e263-4f90-8191-b05ad64b52b5 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:53.693993 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354424c-e263-4f90-8191-b05ad64b52b5 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:53.698544 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f82bc-edcf-45e4-8f20-d71bb5c68422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:53.699329 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f82bc-edcf-45e4-8f20-d71bb5c68422 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.699609 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f82bc-edcf-45e4-8f20-d71bb5c68422 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.699881 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f82bc-edcf-45e4-8f20-d71bb5c68422 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.711690 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f82bc-edcf-45e4-8f20-d71bb5c68422 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:53.713508 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f82bc-edcf-45e4-8f20-d71bb5c68422 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:53.733592 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-cb9f82bc-edcf-45e4-8f20-d71bb5c68422 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:53.735161 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 362/733] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:53.741256 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1567df5-d9fd-4605-a8e6-9acc6771014c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:53.750340 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1567df5-d9fd-4605-a8e6-9acc6771014c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:53.757035 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb44be-7ca8-45fd-86e7-e02eb85c78d7 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.757527 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb44be-7ca8-45fd-86e7-e02eb85c78d7 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.757653 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824fefd-6aa2-42bf-aba8-ce93ae28368f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:53.758159 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fceb44be-7ca8-45fd-86e7-e02eb85c78d7 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.758280 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824fefd-6aa2-42bf-aba8-ce93ae28368f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.758526 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824fefd-6aa2-42bf-aba8-ce93ae28368f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.758803 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6824fefd-6aa2-42bf-aba8-ce93ae28368f admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.759547 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824fefd-6aa2-42bf-aba8-ce93ae28368f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:53.759856 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824fefd-6aa2-42bf-aba8-ce93ae28368f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:53.761246 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 363/734] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:53 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:01:53.762553 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6824fefd-6aa2-42bf-aba8-ce93ae28368f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:53.770704 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c607e3-ffd5-47b3-acef-ae64a5459b7e None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.771227 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c607e3-ffd5-47b3-acef-ae64a5459b7e None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.771694 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c607e3-ffd5-47b3-acef-ae64a5459b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.784960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 372/735] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:53.792177 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824fefd-6aa2-42bf-aba8-ce93ae28368f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:53.792325 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-98c607e3-ffd5-47b3-acef-ae64a5459b7e None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:53.793566 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-98c607e3-ffd5-47b3-acef-ae64a5459b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:53.803900 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6824fefd-6aa2-42bf-aba8-ce93ae28368f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:53.804597 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 364/736] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:53 2021] POST /identity/v3/auth/tokens => generated 1419 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:53.808873 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57373a92-1853-4fa1-913a-9076dc583410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:53.809880 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57373a92-1853-4fa1-913a-9076dc583410 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.810387 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57373a92-1853-4fa1-913a-9076dc583410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.810829 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57373a92-1853-4fa1-913a-9076dc583410 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.818993 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57373a92-1853-4fa1-913a-9076dc583410 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:53.821172 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57373a92-1853-4fa1-913a-9076dc583410 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:53.828310 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c607e3-ffd5-47b3-acef-ae64a5459b7e None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:53.836117 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-57373a92-1853-4fa1-913a-9076dc583410 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:53.837579 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 373/737] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:01:53.842054 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c607e3-ffd5-47b3-acef-ae64a5459b7e None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:53.844069 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57373a92-1853-4fa1-913a-9076dc583410 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:53.846586 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73686d-bb3b-4a85-9c8b-95c862d785a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:53.847676 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73686d-bb3b-4a85-9c8b-95c862d785a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.848115 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73686d-bb3b-4a85-9c8b-95c862d785a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.848536 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73686d-bb3b-4a85-9c8b-95c862d785a8 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.849405 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73686d-bb3b-4a85-9c8b-95c862d785a8 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:53.851247 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73686d-bb3b-4a85-9c8b-95c862d785a8 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:53.854866 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57373a92-1853-4fa1-913a-9076dc583410 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:53.859313 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4fb3-06b8-4ac8-a32d-187ffa99ff90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:53.859954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4fb3-06b8-4ac8-a32d-187ffa99ff90 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.860293 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4fb3-06b8-4ac8-a32d-187ffa99ff90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.860568 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16d4fb3-06b8-4ac8-a32d-187ffa99ff90 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.861355 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d4fb3-06b8-4ac8-a32d-187ffa99ff90 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:53.861662 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d4fb3-06b8-4ac8-a32d-187ffa99ff90 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:53.863812 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16d4fb3-06b8-4ac8-a32d-187ffa99ff90 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:53.865516 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-fd73686d-bb3b-4a85-9c8b-95c862d785a8 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 16:01:53.867232 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 365/738] 10.222.0.41 () {56 vars in 1153 bytes} [Fri Oct 29 16:01:53 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:53.874516 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73686d-bb3b-4a85-9c8b-95c862d785a8 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:53.876947 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 374/739] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:53.883240 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4fb3-06b8-4ac8-a32d-187ffa99ff90 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:53.885747 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73686d-bb3b-4a85-9c8b-95c862d785a8 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:53.890741 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db7c2f-a977-4a91-95ff-5e8d09dee113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:53.892278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db7c2f-a977-4a91-95ff-5e8d09dee113 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.892756 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db7c2f-a977-4a91-95ff-5e8d09dee113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.893179 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db7c2f-a977-4a91-95ff-5e8d09dee113 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.893999 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16d4fb3-06b8-4ac8-a32d-187ffa99ff90 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:53.894320 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db7c2f-a977-4a91-95ff-5e8d09dee113 admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:53.894789 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db7c2f-a977-4a91-95ff-5e8d09dee113 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:53.896940 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db7c2f-a977-4a91-95ff-5e8d09dee113 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:53.898542 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84718291-5c67-4089-9719-dcb46ef2e29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:53.899199 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84718291-5c67-4089-9719-dcb46ef2e29a admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.899478 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84718291-5c67-4089-9719-dcb46ef2e29a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.899745 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84718291-5c67-4089-9719-dcb46ef2e29a admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.900599 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84718291-5c67-4089-9719-dcb46ef2e29a admin admin] RBAC: Adding query filter params (role.id=01b3b9b5c0d846968d6a5219373998f8, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=10b4daa146fa4b638d90ea1e9a4878eb) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:53.900906 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84718291-5c67-4089-9719-dcb46ef2e29a admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:53.902787 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84718291-5c67-4089-9719-dcb46ef2e29a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:53.903442 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 366/740] 10.222.0.41 () {56 vars in 1147 bytes} [Fri Oct 29 16:01:53 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:53.909215 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 375/741] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:53 2021] GET /identity/v3/role_assignments?user.id=10b4daa146fa4b638d90ea1e9a4878eb&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=01b3b9b5c0d846968d6a5219373998f8 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:53.909905 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db7c2f-a977-4a91-95ff-5e8d09dee113 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:53.923742 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db7c2f-a977-4a91-95ff-5e8d09dee113 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:53.928976 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26695632-6963-41e4-b861-bdcf13cde4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:53.930043 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26695632-6963-41e4-b861-bdcf13cde4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:53.930478 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26695632-6963-41e4-b861-bdcf13cde4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:53.930930 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26695632-6963-41e4-b861-bdcf13cde4b9 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:53.931845 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26695632-6963-41e4-b861-bdcf13cde4b9 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:53.932340 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26695632-6963-41e4-b861-bdcf13cde4b9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:53.934252 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26695632-6963-41e4-b861-bdcf13cde4b9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:53.940843 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 367/742] 10.222.0.41 () {56 vars in 1147 bytes} [Fri Oct 29 16:01:53 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:54.249803 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6c606-391e-493d-a9b3-1eda3bb77551 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:54.250452 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6c606-391e-493d-a9b3-1eda3bb77551 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:54.250452 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d6c606-391e-493d-a9b3-1eda3bb77551 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:54.253200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 376/743] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:54.260011 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268ec0b-5d0c-4903-a8e4-2426b0cd05e4 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:54.260522 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268ec0b-5d0c-4903-a8e4-2426b0cd05e4 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:54.260611 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268ec0b-5d0c-4903-a8e4-2426b0cd05e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:54.280669 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-a268ec0b-5d0c-4903-a8e4-2426b0cd05e4 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:54.281904 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a268ec0b-5d0c-4903-a8e4-2426b0cd05e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:54.290936 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 368/744] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:54 2021] POST /identity/v3/auth/tokens => generated 1419 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:54.314408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6c606-391e-493d-a9b3-1eda3bb77551 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:54.327152 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d6c606-391e-493d-a9b3-1eda3bb77551 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:54.332348 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a747e-010d-4f28-8a95-37f51550991f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:54.333364 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a747e-010d-4f28-8a95-37f51550991f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:54.333799 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a747e-010d-4f28-8a95-37f51550991f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:54.334260 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a747e-010d-4f28-8a95-37f51550991f admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:54.335075 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a747e-010d-4f28-8a95-37f51550991f admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:54.336825 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a747e-010d-4f28-8a95-37f51550991f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:54.349105 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-9a6a747e-010d-4f28-8a95-37f51550991f admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 29 16:01:54.350947 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 377/745] 10.222.0.41 () {56 vars in 1150 bytes} [Fri Oct 29 16:01:54 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:54.357642 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268ec0b-5d0c-4903-a8e4-2426b0cd05e4 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:54.367263 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268ec0b-5d0c-4903-a8e4-2426b0cd05e4 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:54.372026 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d97f577-0db2-44cb-b647-c9b2abd856bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:54.372795 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97f577-0db2-44cb-b647-c9b2abd856bc admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:54.373181 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97f577-0db2-44cb-b647-c9b2abd856bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:54.373558 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97f577-0db2-44cb-b647-c9b2abd856bc admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:54.374429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97f577-0db2-44cb-b647-c9b2abd856bc admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:54.374836 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97f577-0db2-44cb-b647-c9b2abd856bc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:54.377168 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d97f577-0db2-44cb-b647-c9b2abd856bc admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:54.382532 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 369/746] 10.222.0.41 () {56 vars in 1145 bytes} [Fri Oct 29 16:01:54 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:54.391267 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a747e-010d-4f28-8a95-37f51550991f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:54.401673 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a747e-010d-4f28-8a95-37f51550991f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:54.404886 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58782577-3f75-4039-b09f-069a466c759f None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:54.405194 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58782577-3f75-4039-b09f-069a466c759f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:54.405445 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58782577-3f75-4039-b09f-069a466c759f None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:54.406915 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8161713-e9eb-4c34-b38f-87f4be461bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:54.407758 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8161713-e9eb-4c34-b38f-87f4be461bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:54.408183 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8161713-e9eb-4c34-b38f-87f4be461bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:54.408586 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 370/747] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:01:54.408844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8161713-e9eb-4c34-b38f-87f4be461bd3 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:54.409701 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8161713-e9eb-4c34-b38f-87f4be461bd3 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:54.410169 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8161713-e9eb-4c34-b38f-87f4be461bd3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:54.411910 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8161713-e9eb-4c34-b38f-87f4be461bd3 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:54.413398 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977c969-ade3-42a9-8ef1-091f2c12b086 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:54.413688 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977c969-ade3-42a9-8ef1-091f2c12b086 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:54.413995 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977c969-ade3-42a9-8ef1-091f2c12b086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:54.418341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 378/748] 10.222.0.41 () {56 vars in 1145 bytes} [Fri Oct 29 16:01:54 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:54.424386 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8161713-e9eb-4c34-b38f-87f4be461bd3 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:54.433910 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8161713-e9eb-4c34-b38f-87f4be461bd3 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:54.436992 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-0977c969-ade3-42a9-8ef1-091f2c12b086 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:54.438751 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-0977c969-ade3-42a9-8ef1-091f2c12b086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:54.439988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8947925-a467-4cc0-9970-fe459b1e7996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:54.440953 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8947925-a467-4cc0-9970-fe459b1e7996 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:54.441393 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8947925-a467-4cc0-9970-fe459b1e7996 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:54.441967 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8947925-a467-4cc0-9970-fe459b1e7996 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:54.442979 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8947925-a467-4cc0-9970-fe459b1e7996 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:54.444297 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING py.warnings [None req-c8947925-a467-4cc0-9970-fe459b1e7996 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:01:54.444297 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: warnings.warn(msg) Oct 29 16:01:54.444297 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: Oct 29 16:01:54.445760 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8947925-a467-4cc0-9970-fe459b1e7996 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:54.458078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 371/749] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:54 2021] POST /identity/v3/auth/tokens => generated 1419 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:54.473455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 379/750] 10.222.0.41 () {60 vars in 1165 bytes} [Fri Oct 29 16:01:54 2021] POST /identity/v3/endpoints => generated 346 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:01:54.481839 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977c969-ade3-42a9-8ef1-091f2c12b086 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:54.491646 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977c969-ade3-42a9-8ef1-091f2c12b086 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:54.507399 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d338f-f45b-4cb3-a1c3-a095ec2ebb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:54.508278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d338f-f45b-4cb3-a1c3-a095ec2ebb80 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:54.508657 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d338f-f45b-4cb3-a1c3-a095ec2ebb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:54.509038 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d338f-f45b-4cb3-a1c3-a095ec2ebb80 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:54.521483 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d338f-f45b-4cb3-a1c3-a095ec2ebb80 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:54.528550 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-020d338f-f45b-4cb3-a1c3-a095ec2ebb80 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:01:54.534143 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 372/751] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:54.537636 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8947925-a467-4cc0-9970-fe459b1e7996 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:54.549087 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8947925-a467-4cc0-9970-fe459b1e7996 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:54.554098 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4402991-0964-463a-858e-57b3a6d6ed5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:54.555147 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4402991-0964-463a-858e-57b3a6d6ed5c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:54.555580 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4402991-0964-463a-858e-57b3a6d6ed5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:54.555995 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4402991-0964-463a-858e-57b3a6d6ed5c admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:54.557126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4402991-0964-463a-858e-57b3a6d6ed5c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:54.557583 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4402991-0964-463a-858e-57b3a6d6ed5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:54.559484 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4402991-0964-463a-858e-57b3a6d6ed5c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:54.570665 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 380/752] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:01:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:54.578299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d338f-f45b-4cb3-a1c3-a095ec2ebb80 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:54.589115 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d338f-f45b-4cb3-a1c3-a095ec2ebb80 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:54.594289 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091a745-5ed7-4ee5-8399-8a430538a0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:54.595939 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091a745-5ed7-4ee5-8399-8a430538a0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:54.596473 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091a745-5ed7-4ee5-8399-8a430538a0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:54.596948 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091a745-5ed7-4ee5-8399-8a430538a0f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:54.609539 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091a745-5ed7-4ee5-8399-8a430538a0f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:54.612472 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091a745-5ed7-4ee5-8399-8a430538a0f4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:54.631962 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-c091a745-5ed7-4ee5-8399-8a430538a0f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:54.638110 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 373/753] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:54.641100 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4402991-0964-463a-858e-57b3a6d6ed5c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:54.652044 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4402991-0964-463a-858e-57b3a6d6ed5c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:54.657843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe38e84-a792-4ef8-8bb0-54f530b89914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:54.659010 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe38e84-a792-4ef8-8bb0-54f530b89914 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:54.659496 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe38e84-a792-4ef8-8bb0-54f530b89914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:54.660016 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe38e84-a792-4ef8-8bb0-54f530b89914 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:54.660972 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe38e84-a792-4ef8-8bb0-54f530b89914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:54.661512 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe38e84-a792-4ef8-8bb0-54f530b89914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:54.663467 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe38e84-a792-4ef8-8bb0-54f530b89914 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:54.682060 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 381/754] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:54.684629 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091a745-5ed7-4ee5-8399-8a430538a0f4 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:54.695206 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091a745-5ed7-4ee5-8399-8a430538a0f4 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:54.700089 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852c761-21f0-48d6-8369-4cbc6ad2c4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:54.701408 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852c761-21f0-48d6-8369-4cbc6ad2c4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:54.701788 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852c761-21f0-48d6-8369-4cbc6ad2c4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:54.702184 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852c761-21f0-48d6-8369-4cbc6ad2c4f0 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:54.710425 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852c761-21f0-48d6-8369-4cbc6ad2c4f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:54.712731 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852c761-21f0-48d6-8369-4cbc6ad2c4f0 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:54.729715 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-0852c761-21f0-48d6-8369-4cbc6ad2c4f0 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 29 16:01:54.731528 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 374/755] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:01:54 2021] GET /identity/v3/users/swift => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:54.740551 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe38e84-a792-4ef8-8bb0-54f530b89914 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:54.751166 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe38e84-a792-4ef8-8bb0-54f530b89914 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:54.756415 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3c638-c493-43c8-9548-b2fa54f8b483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:54.757095 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3c638-c493-43c8-9548-b2fa54f8b483 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:54.757379 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3c638-c493-43c8-9548-b2fa54f8b483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:54.757727 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3c638-c493-43c8-9548-b2fa54f8b483 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:54.758547 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3c638-c493-43c8-9548-b2fa54f8b483 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:54.758859 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3c638-c493-43c8-9548-b2fa54f8b483 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:54.760727 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3c638-c493-43c8-9548-b2fa54f8b483 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:54.780117 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 382/756] 10.222.0.41 () {56 vars in 1156 bytes} [Fri Oct 29 16:01:54 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:54.786920 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852c761-21f0-48d6-8369-4cbc6ad2c4f0 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:54.796868 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852c761-21f0-48d6-8369-4cbc6ad2c4f0 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:54.801477 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c81b70-1ad1-4c35-8f05-888208847c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:54.802225 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c81b70-1ad1-4c35-8f05-888208847c17 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:54.802510 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c81b70-1ad1-4c35-8f05-888208847c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:54.802789 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c81b70-1ad1-4c35-8f05-888208847c17 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:54.810940 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c81b70-1ad1-4c35-8f05-888208847c17 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:54.812706 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c81b70-1ad1-4c35-8f05-888208847c17 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:54.822263 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 375/757] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:54 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:54.829438 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3c638-c493-43c8-9548-b2fa54f8b483 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:54.839540 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3c638-c493-43c8-9548-b2fa54f8b483 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:54.845280 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a2bca-0923-4548-9af5-2c99fa9d4d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:54.846339 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a2bca-0923-4548-9af5-2c99fa9d4d09 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:54.846788 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a2bca-0923-4548-9af5-2c99fa9d4d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:54.847207 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a2bca-0923-4548-9af5-2c99fa9d4d09 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:54.858311 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a2bca-0923-4548-9af5-2c99fa9d4d09 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:54.860444 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3a2bca-0923-4548-9af5-2c99fa9d4d09 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:54.877794 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-ef3a2bca-0923-4548-9af5-2c99fa9d4d09 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:54.884505 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 383/758] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:54.886103 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c81b70-1ad1-4c35-8f05-888208847c17 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:54.896094 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c81b70-1ad1-4c35-8f05-888208847c17 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:54.900855 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc67db-d2cf-4498-bc4f-1b5410959026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:54.901738 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc67db-d2cf-4498-bc4f-1b5410959026 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:54.902147 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc67db-d2cf-4498-bc4f-1b5410959026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:54.902523 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc67db-d2cf-4498-bc4f-1b5410959026 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:54.903402 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc67db-d2cf-4498-bc4f-1b5410959026 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:54.903808 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc67db-d2cf-4498-bc4f-1b5410959026 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:54.905531 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc67db-d2cf-4498-bc4f-1b5410959026 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:54.918703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 376/759] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:54.925010 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a2bca-0923-4548-9af5-2c99fa9d4d09 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:54.935125 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a2bca-0923-4548-9af5-2c99fa9d4d09 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:54.939998 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d7994-723f-4b99-8b7b-08a4b87ce946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:54.940993 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d7994-723f-4b99-8b7b-08a4b87ce946 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:54.941420 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d7994-723f-4b99-8b7b-08a4b87ce946 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:54.941835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d7994-723f-4b99-8b7b-08a4b87ce946 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:54.949451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d7994-723f-4b99-8b7b-08a4b87ce946 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:54.951972 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d7994-723f-4b99-8b7b-08a4b87ce946 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:54.965485 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-0d3d7994-723f-4b99-8b7b-08a4b87ce946 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:54.966863 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 384/760] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:54.974128 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc67db-d2cf-4498-bc4f-1b5410959026 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:54.984539 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc67db-d2cf-4498-bc4f-1b5410959026 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:54.989568 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287536b-221d-4940-b383-9529b017d394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:54.990448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287536b-221d-4940-b383-9529b017d394 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:54.990879 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287536b-221d-4940-b383-9529b017d394 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:54.991309 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287536b-221d-4940-b383-9529b017d394 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:54.992251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287536b-221d-4940-b383-9529b017d394 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:54.992698 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287536b-221d-4940-b383-9529b017d394 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:54.994733 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287536b-221d-4940-b383-9529b017d394 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:55.013038 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 377/761] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:55.014616 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d7994-723f-4b99-8b7b-08a4b87ce946 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:55.025896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d7994-723f-4b99-8b7b-08a4b87ce946 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:55.030687 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd3985-f1eb-4ce4-9be9-a9b2e2a2d51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:55.031537 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd3985-f1eb-4ce4-9be9-a9b2e2a2d51b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:55.032612 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd3985-f1eb-4ce4-9be9-a9b2e2a2d51b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:55.033035 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd3985-f1eb-4ce4-9be9-a9b2e2a2d51b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:55.034063 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd3985-f1eb-4ce4-9be9-a9b2e2a2d51b admin admin] RBAC: Adding query filter params (role.id=f28d3f93a0524078a592a15459808378, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=f518ae309c4b4f7eacca882b58e58bd0) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:55.034516 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd3985-f1eb-4ce4-9be9-a9b2e2a2d51b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:55.036743 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bd3985-f1eb-4ce4-9be9-a9b2e2a2d51b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:55.050320 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 385/762] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:55 2021] GET /identity/v3/role_assignments?user.id=f518ae309c4b4f7eacca882b58e58bd0&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=f28d3f93a0524078a592a15459808378 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:56.324519 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84c562-e0f8-484a-ba08-b0eb97b62606 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:56.325037 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84c562-e0f8-484a-ba08-b0eb97b62606 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:56.325037 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84c562-e0f8-484a-ba08-b0eb97b62606 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:56.327339 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 378/763] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:56.333762 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e394a5-bfe4-492a-a8d4-4c69018bb2d5 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:56.334255 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e394a5-bfe4-492a-a8d4-4c69018bb2d5 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:56.334438 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e394a5-bfe4-492a-a8d4-4c69018bb2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:56.352584 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-09e394a5-bfe4-492a-a8d4-4c69018bb2d5 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:56.353776 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-09e394a5-bfe4-492a-a8d4-4c69018bb2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:56.362349 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 386/764] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:56 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:56.387806 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84c562-e0f8-484a-ba08-b0eb97b62606 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:56.401312 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84c562-e0f8-484a-ba08-b0eb97b62606 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:56.406222 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44bb88-b755-499a-ab22-407ad405a163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:56.406910 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44bb88-b755-499a-ab22-407ad405a163 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:56.407736 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44bb88-b755-499a-ab22-407ad405a163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:56.408007 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44bb88-b755-499a-ab22-407ad405a163 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:56.408754 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44bb88-b755-499a-ab22-407ad405a163 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:56.410375 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44bb88-b755-499a-ab22-407ad405a163 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:56.426098 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 379/765] 10.222.0.41 () {60 vars in 1162 bytes} [Fri Oct 29 16:01:56 2021] POST /identity/v3/services => generated 269 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:01:56.441404 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f1be7-4b84-4260-888c-dd6725639fcb None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:56.441722 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f1be7-4b84-4260-888c-dd6725639fcb None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:56.441986 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f1be7-4b84-4260-888c-dd6725639fcb None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:56.444665 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 387/766] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:56.452758 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee11d42-93a6-4df3-85f6-45e79c3472e1 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:56.453218 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee11d42-93a6-4df3-85f6-45e79c3472e1 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:56.453679 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee11d42-93a6-4df3-85f6-45e79c3472e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:56.477072 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-3ee11d42-93a6-4df3-85f6-45e79c3472e1 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:56.479204 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3ee11d42-93a6-4df3-85f6-45e79c3472e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:56.502563 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 380/767] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:56 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:56.528250 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f1be7-4b84-4260-888c-dd6725639fcb None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:56.542543 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f1be7-4b84-4260-888c-dd6725639fcb None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:56.547753 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ce5d6-da17-40d1-b586-fc2b0e2438a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:56.548949 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ce5d6-da17-40d1-b586-fc2b0e2438a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:56.549424 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ce5d6-da17-40d1-b586-fc2b0e2438a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:56.549894 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ce5d6-da17-40d1-b586-fc2b0e2438a1 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:56.561764 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ce5d6-da17-40d1-b586-fc2b0e2438a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:56.569868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-679ce5d6-da17-40d1-b586-fc2b0e2438a1 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 16:01:56.571888 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 388/768] 10.222.0.41 () {56 vars in 1141 bytes} [Fri Oct 29 16:01:56 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:56.579744 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee11d42-93a6-4df3-85f6-45e79c3472e1 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:56.589179 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee11d42-93a6-4df3-85f6-45e79c3472e1 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:56.593837 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0656c01-a553-400c-8b8e-36594bcfeff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:56.595162 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0656c01-a553-400c-8b8e-36594bcfeff3 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:56.595440 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0656c01-a553-400c-8b8e-36594bcfeff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:56.595707 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0656c01-a553-400c-8b8e-36594bcfeff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:56.596472 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0656c01-a553-400c-8b8e-36594bcfeff3 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:56.596768 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0656c01-a553-400c-8b8e-36594bcfeff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:56.598760 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0656c01-a553-400c-8b8e-36594bcfeff3 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:56.610782 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 381/769] 10.222.0.41 () {56 vars in 1136 bytes} [Fri Oct 29 16:01:56 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:56.617061 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ce5d6-da17-40d1-b586-fc2b0e2438a1 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:56.628507 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ce5d6-da17-40d1-b586-fc2b0e2438a1 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:56.633661 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460ad1f-fbab-4d1e-b0e9-54507c942681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:56.634828 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460ad1f-fbab-4d1e-b0e9-54507c942681 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:56.635418 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460ad1f-fbab-4d1e-b0e9-54507c942681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:56.635897 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a460ad1f-fbab-4d1e-b0e9-54507c942681 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:56.649358 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460ad1f-fbab-4d1e-b0e9-54507c942681 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:56.651720 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a460ad1f-fbab-4d1e-b0e9-54507c942681 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:56.670184 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-a460ad1f-fbab-4d1e-b0e9-54507c942681 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:56.672128 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 389/770] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:56.678978 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0656c01-a553-400c-8b8e-36594bcfeff3 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:56.689701 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0656c01-a553-400c-8b8e-36594bcfeff3 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:56.694567 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904a45f-7183-458b-b12c-3937ddae8b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:56.695496 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904a45f-7183-458b-b12c-3937ddae8b9b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:56.695954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904a45f-7183-458b-b12c-3937ddae8b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:56.696381 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904a45f-7183-458b-b12c-3937ddae8b9b admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:56.697395 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904a45f-7183-458b-b12c-3937ddae8b9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:56.697698 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904a45f-7183-458b-b12c-3937ddae8b9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:56.699429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904a45f-7183-458b-b12c-3937ddae8b9b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:56.715816 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 382/771] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:56.722625 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460ad1f-fbab-4d1e-b0e9-54507c942681 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:56.733863 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a460ad1f-fbab-4d1e-b0e9-54507c942681 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:56.740168 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170727ff-28db-4b55-a322-f0f618c7717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:56.741092 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170727ff-28db-4b55-a322-f0f618c7717a admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:56.741372 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170727ff-28db-4b55-a322-f0f618c7717a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:56.741644 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170727ff-28db-4b55-a322-f0f618c7717a admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:56.753398 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170727ff-28db-4b55-a322-f0f618c7717a admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:56.755728 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170727ff-28db-4b55-a322-f0f618c7717a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:56.773098 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-170727ff-28db-4b55-a322-f0f618c7717a admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 16:01:56.774695 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 390/772] 10.222.0.41 () {56 vars in 1138 bytes} [Fri Oct 29 16:01:56 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:56.783350 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904a45f-7183-458b-b12c-3937ddae8b9b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:56.793488 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904a45f-7183-458b-b12c-3937ddae8b9b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:56.798329 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8bba3-b548-4e0d-ab84-b711e58ae8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:56.799045 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8bba3-b548-4e0d-ab84-b711e58ae8d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:56.799319 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8bba3-b548-4e0d-ab84-b711e58ae8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:56.799588 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8bba3-b548-4e0d-ab84-b711e58ae8d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:56.800479 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8bba3-b548-4e0d-ab84-b711e58ae8d3 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:56.800778 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8bba3-b548-4e0d-ab84-b711e58ae8d3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:56.802731 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8bba3-b548-4e0d-ab84-b711e58ae8d3 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:56.821829 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 383/773] 10.222.0.41 () {56 vars in 1170 bytes} [Fri Oct 29 16:01:56 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:56.831791 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170727ff-28db-4b55-a322-f0f618c7717a admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:56.842252 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170727ff-28db-4b55-a322-f0f618c7717a admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:56.847164 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77ab83-9317-4ee3-9243-630f51da47c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:56.847854 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77ab83-9317-4ee3-9243-630f51da47c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:56.848134 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77ab83-9317-4ee3-9243-630f51da47c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:56.848400 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77ab83-9317-4ee3-9243-630f51da47c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:56.856856 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77ab83-9317-4ee3-9243-630f51da47c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:56.858695 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77ab83-9317-4ee3-9243-630f51da47c5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:56.868488 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 391/774] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:01:56 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:01:56.869102 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d09c5-9444-45ab-9133-fced6c041e62 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:56.869395 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d09c5-9444-45ab-9133-fced6c041e62 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:56.869764 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82d09c5-9444-45ab-9133-fced6c041e62 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:56.871907 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 384/775] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:01:56.878878 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d09c5-9444-45ab-9133-fced6c041e62 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:56.879613 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc4441-62c9-41bb-8a06-17a55755d546 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:56.879902 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc4441-62c9-41bb-8a06-17a55755d546 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:56.880341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc4441-62c9-41bb-8a06-17a55755d546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:56.892109 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82d09c5-9444-45ab-9133-fced6c041e62 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:56.897067 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d772b40-8ac7-4c28-9683-feaa7f3c0882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:56.897870 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d772b40-8ac7-4c28-9683-feaa7f3c0882 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:56.898181 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d772b40-8ac7-4c28-9683-feaa7f3c0882 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:56.898458 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d772b40-8ac7-4c28-9683-feaa7f3c0882 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:56.900090 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-c2dc4441-62c9-41bb-8a06-17a55755d546 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:56.901407 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c2dc4441-62c9-41bb-8a06-17a55755d546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:56.909712 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 392/776] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:56 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:56.909856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d772b40-8ac7-4c28-9683-feaa7f3c0882 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:56.911666 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d772b40-8ac7-4c28-9683-feaa7f3c0882 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:56.931116 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-7d772b40-8ac7-4c28-9683-feaa7f3c0882 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:56.933096 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 385/777] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:56.937967 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc4441-62c9-41bb-8a06-17a55755d546 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:56.940341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d772b40-8ac7-4c28-9683-feaa7f3c0882 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:56.944867 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc4441-62c9-41bb-8a06-17a55755d546 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:56.952356 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d772b40-8ac7-4c28-9683-feaa7f3c0882 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:56.955064 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644dfac0-a2f9-4998-b585-fca135a0d7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:56.956136 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644dfac0-a2f9-4998-b585-fca135a0d7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:56.956625 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644dfac0-a2f9-4998-b585-fca135a0d7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:56.957084 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644dfac0-a2f9-4998-b585-fca135a0d7e8 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:56.957983 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644dfac0-a2f9-4998-b585-fca135a0d7e8 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:56.959380 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e481f2-f179-4323-9262-46ce102e957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:56.960044 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644dfac0-a2f9-4998-b585-fca135a0d7e8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:56.960148 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e481f2-f179-4323-9262-46ce102e957a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:56.960398 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e481f2-f179-4323-9262-46ce102e957a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:56.960677 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e481f2-f179-4323-9262-46ce102e957a admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:56.961683 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e481f2-f179-4323-9262-46ce102e957a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:56.962012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e481f2-f179-4323-9262-46ce102e957a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:56.963689 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e481f2-f179-4323-9262-46ce102e957a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:56.973063 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-644dfac0-a2f9-4998-b585-fca135a0d7e8 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 16:01:56.974967 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 393/778] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:01:56 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:56.975805 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 386/779] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:56.982205 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644dfac0-a2f9-4998-b585-fca135a0d7e8 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:56.983267 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e481f2-f179-4323-9262-46ce102e957a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:56.993671 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e481f2-f179-4323-9262-46ce102e957a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:56.995788 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644dfac0-a2f9-4998-b585-fca135a0d7e8 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:56.998604 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ada41-97e3-42b3-8920-fc3132157102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:56.999458 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ada41-97e3-42b3-8920-fc3132157102 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:56.999742 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ada41-97e3-42b3-8920-fc3132157102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:57.000018 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ada41-97e3-42b3-8920-fc3132157102 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:57.002538 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f3fc6-044e-44a4-bc22-e91b7717a024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:57.004068 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f3fc6-044e-44a4-bc22-e91b7717a024 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:57.004573 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f3fc6-044e-44a4-bc22-e91b7717a024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:57.005048 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f3fc6-044e-44a4-bc22-e91b7717a024 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:57.006005 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f3fc6-044e-44a4-bc22-e91b7717a024 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:57.006520 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f3fc6-044e-44a4-bc22-e91b7717a024 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:57.008584 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ada41-97e3-42b3-8920-fc3132157102 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:57.008843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f3fc6-044e-44a4-bc22-e91b7717a024 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:57.010789 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ada41-97e3-42b3-8920-fc3132157102 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:57.015001 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 394/780] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:01:56 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:57.023773 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f3fc6-044e-44a4-bc22-e91b7717a024 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:57.029245 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-c71ada41-97e3-42b3-8920-fc3132157102 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:01:57.030888 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 387/781] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:56 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:57.037092 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f3fc6-044e-44a4-bc22-e91b7717a024 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:57.038371 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ada41-97e3-42b3-8920-fc3132157102 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:57.041446 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e798d9-eb1a-48c9-a123-83109860b826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:57.042205 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e798d9-eb1a-48c9-a123-83109860b826 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:57.042490 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e798d9-eb1a-48c9-a123-83109860b826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:57.042821 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e798d9-eb1a-48c9-a123-83109860b826 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:57.043552 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e798d9-eb1a-48c9-a123-83109860b826 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:57.043858 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e798d9-eb1a-48c9-a123-83109860b826 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:57.045614 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e798d9-eb1a-48c9-a123-83109860b826 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:57.051023 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ada41-97e3-42b3-8920-fc3132157102 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:57.052679 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 395/782] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:01:57 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:57.056223 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5436f4a1-588d-4fef-bbaa-c5563d1dffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:57.057221 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436f4a1-588d-4fef-bbaa-c5563d1dffa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:57.057703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436f4a1-588d-4fef-bbaa-c5563d1dffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:57.058205 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5436f4a1-588d-4fef-bbaa-c5563d1dffa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:57.059245 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436f4a1-588d-4fef-bbaa-c5563d1dffa9 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:57.059762 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436f4a1-588d-4fef-bbaa-c5563d1dffa9 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:57.062041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5436f4a1-588d-4fef-bbaa-c5563d1dffa9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:57.077337 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 388/783] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:01:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:57.084732 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e798d9-eb1a-48c9-a123-83109860b826 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:57.095238 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e798d9-eb1a-48c9-a123-83109860b826 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:57.100569 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84042cb9-05ae-42c9-b0fb-a23e7e84a9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:57.101711 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84042cb9-05ae-42c9-b0fb-a23e7e84a9cc admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:57.102372 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84042cb9-05ae-42c9-b0fb-a23e7e84a9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:57.102878 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84042cb9-05ae-42c9-b0fb-a23e7e84a9cc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:57.104004 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84042cb9-05ae-42c9-b0fb-a23e7e84a9cc admin admin] RBAC: Adding query filter params (role.id=d76fb315cd8e43268d4d620325a554ef, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=10b4daa146fa4b638d90ea1e9a4878eb) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:57.104596 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84042cb9-05ae-42c9-b0fb-a23e7e84a9cc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:57.106777 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84042cb9-05ae-42c9-b0fb-a23e7e84a9cc admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:57.116857 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 396/784] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:01:57 2021] GET /identity/v3/role_assignments?user.id=10b4daa146fa4b638d90ea1e9a4878eb&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=d76fb315cd8e43268d4d620325a554ef => generated 259 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:57.402318 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0850af8-e832-4804-9cd7-6163fc6917b3 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:57.402802 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0850af8-e832-4804-9cd7-6163fc6917b3 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:57.402802 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0850af8-e832-4804-9cd7-6163fc6917b3 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:57.404863 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 389/785] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:57.411851 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475b440-5ba9-41a4-8a93-8cdff12af3fd None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:57.412323 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475b440-5ba9-41a4-8a93-8cdff12af3fd None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:57.412398 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475b440-5ba9-41a4-8a93-8cdff12af3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:57.430771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-2475b440-5ba9-41a4-8a93-8cdff12af3fd None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:57.431966 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-2475b440-5ba9-41a4-8a93-8cdff12af3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:57.444786 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 397/786] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:57 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:57.463884 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0850af8-e832-4804-9cd7-6163fc6917b3 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:57.477192 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0850af8-e832-4804-9cd7-6163fc6917b3 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:57.481680 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad465c2a-b97e-479a-91d5-c5a0910755c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:57.482544 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad465c2a-b97e-479a-91d5-c5a0910755c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:57.482822 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad465c2a-b97e-479a-91d5-c5a0910755c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:57.483096 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad465c2a-b97e-479a-91d5-c5a0910755c6 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:57.483780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad465c2a-b97e-479a-91d5-c5a0910755c6 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:57.486023 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad465c2a-b97e-479a-91d5-c5a0910755c6 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:57.497933 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-ad465c2a-b97e-479a-91d5-c5a0910755c6 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 16:01:57.502050 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 390/787] 10.222.0.41 () {56 vars in 1147 bytes} [Fri Oct 29 16:01:57 2021] GET /identity/v3/services/object-store => generated 93 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:57.506528 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475b440-5ba9-41a4-8a93-8cdff12af3fd None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:57.515902 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475b440-5ba9-41a4-8a93-8cdff12af3fd None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:57.520768 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ef92c-5d13-4352-b801-b8b2abcdb7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:57.521553 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ef92c-5d13-4352-b801-b8b2abcdb7aa admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:57.521991 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ef92c-5d13-4352-b801-b8b2abcdb7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:57.522369 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ef92c-5d13-4352-b801-b8b2abcdb7aa admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:57.523202 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ef92c-5d13-4352-b801-b8b2abcdb7aa admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:57.523613 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ef92c-5d13-4352-b801-b8b2abcdb7aa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:57.525329 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ef92c-5d13-4352-b801-b8b2abcdb7aa admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:57.530831 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 398/788] 10.222.0.41 () {56 vars in 1143 bytes} [Fri Oct 29 16:01:57 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:57.538606 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad465c2a-b97e-479a-91d5-c5a0910755c6 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:57.549155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad465c2a-b97e-479a-91d5-c5a0910755c6 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:57.553684 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4490b228-1e0a-48ab-a3b1-bfc95ddd66b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:57.554381 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490b228-1e0a-48ab-a3b1-bfc95ddd66b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:57.554660 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490b228-1e0a-48ab-a3b1-bfc95ddd66b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:57.554932 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490b228-1e0a-48ab-a3b1-bfc95ddd66b2 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:57.555652 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490b228-1e0a-48ab-a3b1-bfc95ddd66b2 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:57.555957 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490b228-1e0a-48ab-a3b1-bfc95ddd66b2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:57.557529 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4490b228-1e0a-48ab-a3b1-bfc95ddd66b2 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:57.566740 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 391/789] 10.222.0.41 () {56 vars in 1143 bytes} [Fri Oct 29 16:01:57 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:58.888799 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097d9b3-fa1d-437b-ba9a-b8e019819b54 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:58.889806 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097d9b3-fa1d-437b-ba9a-b8e019819b54 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:58.890359 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097d9b3-fa1d-437b-ba9a-b8e019819b54 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:58.893140 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 399/790] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:58 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:58.899514 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b4043-ed51-4b30-950a-e60875726ca3 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:58.900343 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b4043-ed51-4b30-950a-e60875726ca3 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:58.900823 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b4043-ed51-4b30-950a-e60875726ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:58.919830 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-c39b4043-ed51-4b30-950a-e60875726ca3 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:58.921371 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-c39b4043-ed51-4b30-950a-e60875726ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:58.929785 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 392/791] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:58 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:58.955168 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097d9b3-fa1d-437b-ba9a-b8e019819b54 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:58.967961 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6097d9b3-fa1d-437b-ba9a-b8e019819b54 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:58.972771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f511d-558b-499a-8645-e0e1ace16195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:58.973818 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f511d-558b-499a-8645-e0e1ace16195 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:58.974392 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f511d-558b-499a-8645-e0e1ace16195 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:58.974896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f511d-558b-499a-8645-e0e1ace16195 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:58.975800 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f511d-558b-499a-8645-e0e1ace16195 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:58.977656 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48f511d-558b-499a-8645-e0e1ace16195 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:58.990176 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-a48f511d-558b-499a-8645-e0e1ace16195 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 16:01:58.991955 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 400/792] 10.222.0.41 () {56 vars in 1153 bytes} [Fri Oct 29 16:01:58 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:58.998756 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b4043-ed51-4b30-950a-e60875726ca3 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:59.008796 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b4043-ed51-4b30-950a-e60875726ca3 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:59.013717 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2983f7-662e-472e-9a8d-65341157bf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:59.014645 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2983f7-662e-472e-9a8d-65341157bf4b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.015150 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2983f7-662e-472e-9a8d-65341157bf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.015633 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2983f7-662e-472e-9a8d-65341157bf4b admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.017131 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2983f7-662e-472e-9a8d-65341157bf4b admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:59.017661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2983f7-662e-472e-9a8d-65341157bf4b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:59.019483 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2983f7-662e-472e-9a8d-65341157bf4b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:59.026404 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 393/793] 10.222.0.41 () {56 vars in 1147 bytes} [Fri Oct 29 16:01:58 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:59.032993 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f511d-558b-499a-8645-e0e1ace16195 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:59.043343 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48f511d-558b-499a-8645-e0e1ace16195 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:59.048327 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143385ed-c264-43a2-bf18-e17cf0c8023e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:59.049214 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143385ed-c264-43a2-bf18-e17cf0c8023e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.049698 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143385ed-c264-43a2-bf18-e17cf0c8023e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.050204 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143385ed-c264-43a2-bf18-e17cf0c8023e admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.051149 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143385ed-c264-43a2-bf18-e17cf0c8023e admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:59.051675 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143385ed-c264-43a2-bf18-e17cf0c8023e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:59.053479 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143385ed-c264-43a2-bf18-e17cf0c8023e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:59.059373 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 401/794] 10.222.0.41 () {56 vars in 1147 bytes} [Fri Oct 29 16:01:59 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:59.066767 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2983f7-662e-472e-9a8d-65341157bf4b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:59.077393 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2983f7-662e-472e-9a8d-65341157bf4b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:59.082993 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d597c-6051-49b2-a4e5-b12d75938222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:59.083908 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d597c-6051-49b2-a4e5-b12d75938222 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.084442 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d597c-6051-49b2-a4e5-b12d75938222 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.084916 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d597c-6051-49b2-a4e5-b12d75938222 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.085980 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d597c-6051-49b2-a4e5-b12d75938222 admin admin] RBAC: Adding query filter params (interface=public, service_id=80063287346d46cb9b06c45097e7aa68, region_id=RegionOne) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:59.086527 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d597c-6051-49b2-a4e5-b12d75938222 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:59.087743 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING py.warnings [None req-b77d597c-6051-49b2-a4e5-b12d75938222 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:01:59.087743 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: warnings.warn(msg) Oct 29 16:01:59.087743 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: Oct 29 16:01:59.088949 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d597c-6051-49b2-a4e5-b12d75938222 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:59.097405 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 394/795] 10.222.0.41 () {56 vars in 1272 bytes} [Fri Oct 29 16:01:59 2021] GET /identity/v3/endpoints?service_id=80063287346d46cb9b06c45097e7aa68&interface=public®ion_id=RegionOne => generated 194 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:59.103940 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143385ed-c264-43a2-bf18-e17cf0c8023e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:59.114400 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143385ed-c264-43a2-bf18-e17cf0c8023e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:59.119577 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e0598c-0897-4e86-a503-a76a769561d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:59.120541 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0598c-0897-4e86-a503-a76a769561d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.121097 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0598c-0897-4e86-a503-a76a769561d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.121572 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e0598c-0897-4e86-a503-a76a769561d0 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.122559 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0598c-0897-4e86-a503-a76a769561d0 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:59.124453 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e0598c-0897-4e86-a503-a76a769561d0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:59.131740 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 402/796] 10.222.0.41 () {56 vars in 1108 bytes} [Fri Oct 29 16:01:59 2021] GET /identity/v3/services => generated 1029 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:01:59.400197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac563a23-8ab8-40db-8b8c-e91ccb31ccb8 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.400580 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac563a23-8ab8-40db-8b8c-e91ccb31ccb8 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.400769 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac563a23-8ab8-40db-8b8c-e91ccb31ccb8 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.402853 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 395/797] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:59.408919 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756ac41-3767-42b3-bce6-33530bdc1e43 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.409207 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756ac41-3767-42b3-bce6-33530bdc1e43 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.409488 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756ac41-3767-42b3-bce6-33530bdc1e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.428445 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-3756ac41-3767-42b3-bce6-33530bdc1e43 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:59.429668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-3756ac41-3767-42b3-bce6-33530bdc1e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:59.437855 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 403/798] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:59 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:01:59.462423 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac563a23-8ab8-40db-8b8c-e91ccb31ccb8 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:59.475849 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac563a23-8ab8-40db-8b8c-e91ccb31ccb8 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:59.481623 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4cc50-1838-4ad4-851d-7e99ade18387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:59.482616 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4cc50-1838-4ad4-851d-7e99ade18387 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.483004 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4cc50-1838-4ad4-851d-7e99ade18387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.483391 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4cc50-1838-4ad4-851d-7e99ade18387 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.484203 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4cc50-1838-4ad4-851d-7e99ade18387 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:59.486506 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b4cc50-1838-4ad4-851d-7e99ade18387 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:59.495234 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dca35-6ff5-4c6f-bca4-111bd9107f00 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.495523 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dca35-6ff5-4c6f-bca4-111bd9107f00 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.495799 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dca35-6ff5-4c6f-bca4-111bd9107f00 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.498046 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 404/799] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:01:59.504113 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 396/800] 10.222.0.41 () {60 vars in 1162 bytes} [Fri Oct 29 16:01:59 2021] POST /identity/v3/services => generated 251 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:01:59.505146 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7cd87-4629-4096-b6c9-fa7215c76dd0 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.505437 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7cd87-4629-4096-b6c9-fa7215c76dd0 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.505711 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7cd87-4629-4096-b6c9-fa7215c76dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.525001 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-26a7cd87-4629-4096-b6c9-fa7215c76dd0 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:59.526303 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-26a7cd87-4629-4096-b6c9-fa7215c76dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:59.545065 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 405/801] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:59 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:59.571195 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4cc50-1838-4ad4-851d-7e99ade18387 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:59.582667 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4cc50-1838-4ad4-851d-7e99ade18387 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:59.588203 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa5ed2-5da6-4e5e-8649-1f5ac776340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:59.589454 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa5ed2-5da6-4e5e-8649-1f5ac776340d admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.589939 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa5ed2-5da6-4e5e-8649-1f5ac776340d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.590426 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa5ed2-5da6-4e5e-8649-1f5ac776340d admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.606030 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fa5ed2-5da6-4e5e-8649-1f5ac776340d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:01:59.615116 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-78fa5ed2-5da6-4e5e-8649-1f5ac776340d admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 16:01:59.620701 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 397/802] 10.222.0.41 () {56 vars in 1141 bytes} [Fri Oct 29 16:01:59 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:59.624357 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7cd87-4629-4096-b6c9-fa7215c76dd0 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:59.635222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7cd87-4629-4096-b6c9-fa7215c76dd0 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:59.640214 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b41ac4-0745-4aa5-93d1-3f2f1564bf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:59.641463 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b41ac4-0745-4aa5-93d1-3f2f1564bf33 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.641979 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b41ac4-0745-4aa5-93d1-3f2f1564bf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.642445 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b41ac4-0745-4aa5-93d1-3f2f1564bf33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.643482 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b41ac4-0745-4aa5-93d1-3f2f1564bf33 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:59.644068 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b41ac4-0745-4aa5-93d1-3f2f1564bf33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:59.646150 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b41ac4-0745-4aa5-93d1-3f2f1564bf33 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:59.655963 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 406/803] 10.222.0.41 () {56 vars in 1136 bytes} [Fri Oct 29 16:01:59 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:59.663407 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa5ed2-5da6-4e5e-8649-1f5ac776340d admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:59.675285 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa5ed2-5da6-4e5e-8649-1f5ac776340d admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:59.680781 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333c29d-6679-4e88-b726-8c461c5ecc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:59.682017 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333c29d-6679-4e88-b726-8c461c5ecc2b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.682514 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333c29d-6679-4e88-b726-8c461c5ecc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.682959 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7333c29d-6679-4e88-b726-8c461c5ecc2b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.695187 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333c29d-6679-4e88-b726-8c461c5ecc2b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:59.697411 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7333c29d-6679-4e88-b726-8c461c5ecc2b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:59.716395 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-7333c29d-6679-4e88-b726-8c461c5ecc2b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:59.722296 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 398/804] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:59.726178 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b41ac4-0745-4aa5-93d1-3f2f1564bf33 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:59.740061 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b41ac4-0745-4aa5-93d1-3f2f1564bf33 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:59.746226 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336492c-d6fd-4515-b9df-6b11c0fbece6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:59.746917 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336492c-d6fd-4515-b9df-6b11c0fbece6 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.747313 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336492c-d6fd-4515-b9df-6b11c0fbece6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.747606 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336492c-d6fd-4515-b9df-6b11c0fbece6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.748366 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336492c-d6fd-4515-b9df-6b11c0fbece6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:59.748681 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336492c-d6fd-4515-b9df-6b11c0fbece6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:59.750424 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336492c-d6fd-4515-b9df-6b11c0fbece6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:59.764687 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 407/805] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:59.771737 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333c29d-6679-4e88-b726-8c461c5ecc2b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:59.783235 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7333c29d-6679-4e88-b726-8c461c5ecc2b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:59.788840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebcd1e-0a15-4d97-bd65-f54e04a54d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:59.789648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebcd1e-0a15-4d97-bd65-f54e04a54d94 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.789969 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebcd1e-0a15-4d97-bd65-f54e04a54d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.790235 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebcd1e-0a15-4d97-bd65-f54e04a54d94 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.799646 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebcd1e-0a15-4d97-bd65-f54e04a54d94 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:59.801831 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebcd1e-0a15-4d97-bd65-f54e04a54d94 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:59.817410 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-e8ebcd1e-0a15-4d97-bd65-f54e04a54d94 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 16:01:59.819150 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 399/806] 10.222.0.41 () {56 vars in 1138 bytes} [Fri Oct 29 16:01:59 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:59.827014 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336492c-d6fd-4515-b9df-6b11c0fbece6 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:59.837413 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336492c-d6fd-4515-b9df-6b11c0fbece6 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:59.842148 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0753a-ba2e-48f9-9bff-37212b42974f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:59.842977 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0753a-ba2e-48f9-9bff-37212b42974f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.843404 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0753a-ba2e-48f9-9bff-37212b42974f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.843820 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0753a-ba2e-48f9-9bff-37212b42974f admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.845365 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0753a-ba2e-48f9-9bff-37212b42974f admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:59.845816 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0753a-ba2e-48f9-9bff-37212b42974f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:59.847823 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0753a-ba2e-48f9-9bff-37212b42974f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:59.866722 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 408/807] 10.222.0.41 () {56 vars in 1170 bytes} [Fri Oct 29 16:01:59 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:01:59.873053 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebcd1e-0a15-4d97-bd65-f54e04a54d94 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:59.879687 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca2e8a-d95b-4116-80ed-ef4c8a0052b2 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.879979 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca2e8a-d95b-4116-80ed-ef4c8a0052b2 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.880261 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca2e8a-d95b-4116-80ed-ef4c8a0052b2 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.882282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 409/808] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:01:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:01:59.883908 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebcd1e-0a15-4d97-bd65-f54e04a54d94 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:59.888532 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c11330-7af1-4529-8ff0-9d32d9ba232c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:59.889380 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c11330-7af1-4529-8ff0-9d32d9ba232c admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.889738 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c11330-7af1-4529-8ff0-9d32d9ba232c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.890437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c11330-7af1-4529-8ff0-9d32d9ba232c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.891995 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d30c6-8816-4015-ada6-e30e926b3fab None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.892815 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d30c6-8816-4015-ada6-e30e926b3fab None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.893267 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d30c6-8816-4015-ada6-e30e926b3fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.901973 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c11330-7af1-4529-8ff0-9d32d9ba232c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:59.903996 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c11330-7af1-4529-8ff0-9d32d9ba232c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:59.913966 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-7a8d30c6-8816-4015-ada6-e30e926b3fab None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:01:59.915509 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-7a8d30c6-8816-4015-ada6-e30e926b3fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:01:59.925970 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 410/809] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:01:59 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:01:59.926155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-23c11330-7af1-4529-8ff0-9d32d9ba232c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:01:59.926751 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 400/810] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:01:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:01:59.932513 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c11330-7af1-4529-8ff0-9d32d9ba232c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:59.942749 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c11330-7af1-4529-8ff0-9d32d9ba232c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:59.948219 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ba0b0-661c-42d8-a693-20a991fbb2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:59.949043 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ba0b0-661c-42d8-a693-20a991fbb2ec admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.949359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ba0b0-661c-42d8-a693-20a991fbb2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.949638 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ba0b0-661c-42d8-a693-20a991fbb2ec admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.950518 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ba0b0-661c-42d8-a693-20a991fbb2ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:01:59.951091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ba0b0-661c-42d8-a693-20a991fbb2ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:59.952874 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ba0b0-661c-42d8-a693-20a991fbb2ec admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:59.955297 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d30c6-8816-4015-ada6-e30e926b3fab None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:59.964177 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d30c6-8816-4015-ada6-e30e926b3fab None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:59.970320 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85656c7-12e9-40a8-b12f-b88045078dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:01:59.970988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85656c7-12e9-40a8-b12f-b88045078dcb admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:01:59.971273 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85656c7-12e9-40a8-b12f-b88045078dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:01:59.971547 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85656c7-12e9-40a8-b12f-b88045078dcb admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:01:59.972299 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85656c7-12e9-40a8-b12f-b88045078dcb admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:01:59.977951 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING py.warnings [None req-a85656c7-12e9-40a8-b12f-b88045078dcb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:01:59.977951 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: warnings.warn(msg) Oct 29 16:01:59.977951 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: Oct 29 16:01:59.977951 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85656c7-12e9-40a8-b12f-b88045078dcb admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:01:59.978790 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 401/811] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:01:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:01:59.979923 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ba0b0-661c-42d8-a693-20a991fbb2ec admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:01:59.992302 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ba0b0-661c-42d8-a693-20a991fbb2ec admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:01:59.993138 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 411/812] 10.222.0.41 () {60 vars in 1162 bytes} [Fri Oct 29 16:01:59 2021] POST /identity/v3/services => generated 241 bytes in 38 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:02:00.017772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ef524-cab7-41e6-9a58-bbca596b94e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:00.018604 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ef524-cab7-41e6-9a58-bbca596b94e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:00.018894 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ef524-cab7-41e6-9a58-bbca596b94e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:00.019154 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ef524-cab7-41e6-9a58-bbca596b94e4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:00.028376 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ef524-cab7-41e6-9a58-bbca596b94e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:00.030516 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ef524-cab7-41e6-9a58-bbca596b94e4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:00.045644 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-c72ef524-cab7-41e6-9a58-bbca596b94e4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:02:00.047238 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 402/813] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:01:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:00.054831 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85656c7-12e9-40a8-b12f-b88045078dcb admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:00.067105 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85656c7-12e9-40a8-b12f-b88045078dcb admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:00.072231 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4530c68-1356-4925-8c11-253f2fd1e9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:00.072911 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4530c68-1356-4925-8c11-253f2fd1e9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:00.073282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4530c68-1356-4925-8c11-253f2fd1e9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:00.073564 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4530c68-1356-4925-8c11-253f2fd1e9b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:00.074473 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4530c68-1356-4925-8c11-253f2fd1e9b6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:00.074783 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4530c68-1356-4925-8c11-253f2fd1e9b6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:00.077021 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4530c68-1356-4925-8c11-253f2fd1e9b6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:00.091632 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 412/814] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:02:00 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:00.098503 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ef524-cab7-41e6-9a58-bbca596b94e4 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:00.108855 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ef524-cab7-41e6-9a58-bbca596b94e4 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:00.114159 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fab77-2faf-419d-aa72-35c288dc9d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:00.115047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fab77-2faf-419d-aa72-35c288dc9d60 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:00.115330 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fab77-2faf-419d-aa72-35c288dc9d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:00.115604 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fab77-2faf-419d-aa72-35c288dc9d60 admin admin] PATH_INFO: `/v3/projects/4939afba2b604181b67577f309c9550a/users/10b4daa146fa4b638d90ea1e9a4878eb/roles/d76fb315cd8e43268d4d620325a554ef` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:00.117867 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fab77-2faf-419d-aa72-35c288dc9d60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4939afba2b604181b67577f309c9550a, user_id=10b4daa146fa4b638d90ea1e9a4878eb, role_id=d76fb315cd8e43268d4d620325a554ef)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:00.120623 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fab77-2faf-419d-aa72-35c288dc9d60 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:00.137894 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 403/815] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:02:00 2021] PUT /identity/v3/projects/4939afba2b604181b67577f309c9550a/users/10b4daa146fa4b638d90ea1e9a4878eb/roles/d76fb315cd8e43268d4d620325a554ef => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:02:01.535870 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0c5b0-5b7e-4b10-b674-fcbd7d78996c None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:01.536387 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0c5b0-5b7e-4b10-b674-fcbd7d78996c None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:01.536464 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0c5b0-5b7e-4b10-b674-fcbd7d78996c None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:01.538555 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 413/816] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:01.545337 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa97ac-f071-40e8-98dc-a9a41156be2f None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:01.545337 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa97ac-f071-40e8-98dc-a9a41156be2f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:01.545337 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa97ac-f071-40e8-98dc-a9a41156be2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:01.566052 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-32fa97ac-f071-40e8-98dc-a9a41156be2f None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:01.567445 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-32fa97ac-f071-40e8-98dc-a9a41156be2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:01.628411 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 404/817] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:01 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:02:01.652141 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0c5b0-5b7e-4b10-b674-fcbd7d78996c None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:01.664660 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0c5b0-5b7e-4b10-b674-fcbd7d78996c None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:01.669217 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11b871-617c-4e8c-b2c6-53c72364abf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:01.670256 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11b871-617c-4e8c-b2c6-53c72364abf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:01.670735 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11b871-617c-4e8c-b2c6-53c72364abf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:01.671241 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11b871-617c-4e8c-b2c6-53c72364abf5 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:01.672103 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11b871-617c-4e8c-b2c6-53c72364abf5 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:01.674464 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11b871-617c-4e8c-b2c6-53c72364abf5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:01.685852 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-8c11b871-617c-4e8c-b2c6-53c72364abf5 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 29 16:02:01.690017 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 414/818] 10.222.0.41 () {56 vars in 1153 bytes} [Fri Oct 29 16:02:01 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:01.695075 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa97ac-f071-40e8-98dc-a9a41156be2f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:01.704245 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa97ac-f071-40e8-98dc-a9a41156be2f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:01.708798 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48be3d2-a5c6-4d6c-bb5e-0e77f1a4b9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:01.709445 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48be3d2-a5c6-4d6c-bb5e-0e77f1a4b9fe admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:01.709726 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48be3d2-a5c6-4d6c-bb5e-0e77f1a4b9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:01.710031 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48be3d2-a5c6-4d6c-bb5e-0e77f1a4b9fe admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:01.710753 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48be3d2-a5c6-4d6c-bb5e-0e77f1a4b9fe admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:01.711055 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48be3d2-a5c6-4d6c-bb5e-0e77f1a4b9fe admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:01.712645 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48be3d2-a5c6-4d6c-bb5e-0e77f1a4b9fe admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:01.717547 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 405/819] 10.222.0.41 () {56 vars in 1147 bytes} [Fri Oct 29 16:02:01 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:01.723715 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11b871-617c-4e8c-b2c6-53c72364abf5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:01.733300 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11b871-617c-4e8c-b2c6-53c72364abf5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:01.738943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95349151-4204-47ee-bff6-fb553d342dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:01.739792 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95349151-4204-47ee-bff6-fb553d342dcf admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:01.740245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95349151-4204-47ee-bff6-fb553d342dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:01.740713 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95349151-4204-47ee-bff6-fb553d342dcf admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:01.741607 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95349151-4204-47ee-bff6-fb553d342dcf admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:01.742116 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95349151-4204-47ee-bff6-fb553d342dcf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:01.743877 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95349151-4204-47ee-bff6-fb553d342dcf admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:01.754048 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 415/820] 10.222.0.41 () {56 vars in 1147 bytes} [Fri Oct 29 16:02:01 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:01.757071 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48be3d2-a5c6-4d6c-bb5e-0e77f1a4b9fe admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:01.778027 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48be3d2-a5c6-4d6c-bb5e-0e77f1a4b9fe admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:01.783489 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc742ef9-f36b-412a-bd14-ddcc86571162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:01.784299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc742ef9-f36b-412a-bd14-ddcc86571162 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:01.784640 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc742ef9-f36b-412a-bd14-ddcc86571162 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:01.784985 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc742ef9-f36b-412a-bd14-ddcc86571162 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:01.785964 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc742ef9-f36b-412a-bd14-ddcc86571162 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:01.787684 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc742ef9-f36b-412a-bd14-ddcc86571162 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:01.810532 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 406/821] 10.222.0.41 () {60 vars in 1165 bytes} [Fri Oct 29 16:02:01 2021] POST /identity/v3/endpoints => generated 347 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:02:01.932228 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf554b6e-5cd8-44e0-af2e-604eb67af064 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:01.932573 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf554b6e-5cd8-44e0-af2e-604eb67af064 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:01.932779 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf554b6e-5cd8-44e0-af2e-604eb67af064 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:01.934862 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 416/822] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:01.941427 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2b50-eba1-457e-879e-de40d1af6c27 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:01.942081 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2b50-eba1-457e-879e-de40d1af6c27 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:01.942571 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad2b50-eba1-457e-879e-de40d1af6c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:01.962638 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-c8ad2b50-eba1-457e-879e-de40d1af6c27 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:01.964295 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-c8ad2b50-eba1-457e-879e-de40d1af6c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:01.984557 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 407/823] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:01 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:02.011103 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf554b6e-5cd8-44e0-af2e-604eb67af064 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:02.023559 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf554b6e-5cd8-44e0-af2e-604eb67af064 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:02.027998 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680693f-4318-4554-ba59-4f52ba88d909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:02.028794 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680693f-4318-4554-ba59-4f52ba88d909 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.029075 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680693f-4318-4554-ba59-4f52ba88d909 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.029334 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680693f-4318-4554-ba59-4f52ba88d909 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.030019 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680693f-4318-4554-ba59-4f52ba88d909 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:02.031607 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1680693f-4318-4554-ba59-4f52ba88d909 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:02.044671 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-1680693f-4318-4554-ba59-4f52ba88d909 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 16:02:02.049994 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 417/824] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:02:02 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:02.053485 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad2b50-eba1-457e-879e-de40d1af6c27 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:02.063877 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad2b50-eba1-457e-879e-de40d1af6c27 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:02.069082 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba58118-bcfb-44bf-a9b7-4ee3cf2a51f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:02.070093 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba58118-bcfb-44bf-a9b7-4ee3cf2a51f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.070595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba58118-bcfb-44bf-a9b7-4ee3cf2a51f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.071088 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba58118-bcfb-44bf-a9b7-4ee3cf2a51f1 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.072086 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba58118-bcfb-44bf-a9b7-4ee3cf2a51f1 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:02.072600 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba58118-bcfb-44bf-a9b7-4ee3cf2a51f1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:02.074597 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba58118-bcfb-44bf-a9b7-4ee3cf2a51f1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:02.080943 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 408/825] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:02:02 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:02.087878 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680693f-4318-4554-ba59-4f52ba88d909 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:02.098906 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680693f-4318-4554-ba59-4f52ba88d909 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:02.103987 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb8f99-e6a0-4a17-b56f-edb861ec4f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:02.104952 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb8f99-e6a0-4a17-b56f-edb861ec4f32 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.105493 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb8f99-e6a0-4a17-b56f-edb861ec4f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.106122 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb8f99-e6a0-4a17-b56f-edb861ec4f32 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.107136 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb8f99-e6a0-4a17-b56f-edb861ec4f32 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:02.107653 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb8f99-e6a0-4a17-b56f-edb861ec4f32 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:02.109575 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb8f99-e6a0-4a17-b56f-edb861ec4f32 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:02.116111 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 418/826] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:02:02 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:02.123032 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba58118-bcfb-44bf-a9b7-4ee3cf2a51f1 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:02.133521 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba58118-bcfb-44bf-a9b7-4ee3cf2a51f1 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:02.138401 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c0a8a-c8fb-4fdc-a3e0-6a87e3492bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:02.139046 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c0a8a-c8fb-4fdc-a3e0-6a87e3492bee admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.139322 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c0a8a-c8fb-4fdc-a3e0-6a87e3492bee admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.139641 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c0a8a-c8fb-4fdc-a3e0-6a87e3492bee admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.140438 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c0a8a-c8fb-4fdc-a3e0-6a87e3492bee admin admin] RBAC: Adding query filter params (interface=public, service_id=0d1f24dffa654423ba968cafdd23b549, region_id=RegionOne) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:02.140739 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c0a8a-c8fb-4fdc-a3e0-6a87e3492bee admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:02.142475 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c0a8a-c8fb-4fdc-a3e0-6a87e3492bee admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:02.153196 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 409/827] 10.222.0.41 () {56 vars in 1272 bytes} [Fri Oct 29 16:02:02 2021] GET /identity/v3/endpoints?service_id=0d1f24dffa654423ba968cafdd23b549&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:02.154747 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb8f99-e6a0-4a17-b56f-edb861ec4f32 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:02.166879 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb8f99-e6a0-4a17-b56f-edb861ec4f32 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:02.171939 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582ea95-8371-4b16-b5e8-13fc50756fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:02.173524 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582ea95-8371-4b16-b5e8-13fc50756fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.174080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582ea95-8371-4b16-b5e8-13fc50756fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.174605 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582ea95-8371-4b16-b5e8-13fc50756fb7 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.175500 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582ea95-8371-4b16-b5e8-13fc50756fb7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:02.177497 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582ea95-8371-4b16-b5e8-13fc50756fb7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:02.184871 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 419/828] 10.222.0.41 () {56 vars in 1108 bytes} [Fri Oct 29 16:02:02 2021] GET /identity/v3/services => generated 1497 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:02:02.405642 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e934e-50fb-4b7d-ac0f-fe9ae953b51f None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.405940 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e934e-50fb-4b7d-ac0f-fe9ae953b51f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.406236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e934e-50fb-4b7d-ac0f-fe9ae953b51f None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.408593 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 410/829] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:02.415149 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd15de5-b790-4805-a77d-4c44e8bfc3dc None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.415432 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd15de5-b790-4805-a77d-4c44e8bfc3dc None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.415705 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd15de5-b790-4805-a77d-4c44e8bfc3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.433523 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-bbd15de5-b790-4805-a77d-4c44e8bfc3dc None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:02.434902 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-bbd15de5-b790-4805-a77d-4c44e8bfc3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:02.443030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 420/830] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:02 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:02:02.467200 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e934e-50fb-4b7d-ac0f-fe9ae953b51f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:02.480071 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e934e-50fb-4b7d-ac0f-fe9ae953b51f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:02.484518 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e50c4-483b-4a2f-8ea3-9606aef9b143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:02.485327 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e50c4-483b-4a2f-8ea3-9606aef9b143 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.485607 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e50c4-483b-4a2f-8ea3-9606aef9b143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.485880 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39e50c4-483b-4a2f-8ea3-9606aef9b143 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.486593 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e50c4-483b-4a2f-8ea3-9606aef9b143 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:02.488226 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39e50c4-483b-4a2f-8ea3-9606aef9b143 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:02.499565 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-d39e50c4-483b-4a2f-8ea3-9606aef9b143 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 16:02:02.501247 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 411/831] 10.222.0.41 () {56 vars in 1147 bytes} [Fri Oct 29 16:02:02 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:02.502937 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a35708-1c0a-46f6-b24c-344cb011740f None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.503224 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a35708-1c0a-46f6-b24c-344cb011740f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.503506 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a35708-1c0a-46f6-b24c-344cb011740f None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.505609 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 421/832] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:02.507995 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e50c4-483b-4a2f-8ea3-9606aef9b143 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:02.511622 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153cddd-d245-488e-8b89-1809230a4817 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.511905 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153cddd-d245-488e-8b89-1809230a4817 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.512180 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153cddd-d245-488e-8b89-1809230a4817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.522833 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39e50c4-483b-4a2f-8ea3-9606aef9b143 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:02.527558 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b24ce-5984-41c4-9c41-81ec8c1613d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:02.528393 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b24ce-5984-41c4-9c41-81ec8c1613d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.528838 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b24ce-5984-41c4-9c41-81ec8c1613d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.529271 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b24ce-5984-41c4-9c41-81ec8c1613d7 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.530173 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b24ce-5984-41c4-9c41-81ec8c1613d7 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:02.530634 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b24ce-5984-41c4-9c41-81ec8c1613d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:02.532942 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b24ce-5984-41c4-9c41-81ec8c1613d7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:02.534091 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-5153cddd-d245-488e-8b89-1809230a4817 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:02.535326 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-5153cddd-d245-488e-8b89-1809230a4817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:02.539270 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 412/833] 10.222.0.41 () {56 vars in 1143 bytes} [Fri Oct 29 16:02:02 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:02.546915 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 422/834] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:02 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:02.553022 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b24ce-5984-41c4-9c41-81ec8c1613d7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:02.566225 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b24ce-5984-41c4-9c41-81ec8c1613d7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:02.572210 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa385b-7712-4e0c-9ded-52e702661cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:02.573196 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa385b-7712-4e0c-9ded-52e702661cbd admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.573686 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa385b-7712-4e0c-9ded-52e702661cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.574274 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa385b-7712-4e0c-9ded-52e702661cbd admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.575208 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa385b-7712-4e0c-9ded-52e702661cbd admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:02.575371 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153cddd-d245-488e-8b89-1809230a4817 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:02.576154 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa385b-7712-4e0c-9ded-52e702661cbd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:02.577939 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa385b-7712-4e0c-9ded-52e702661cbd admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:02.585210 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 413/835] 10.222.0.41 () {56 vars in 1143 bytes} [Fri Oct 29 16:02:02 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:02.589993 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153cddd-d245-488e-8b89-1809230a4817 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:02.591835 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa385b-7712-4e0c-9ded-52e702661cbd admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:02.595192 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb9c53-a53c-4f26-afe6-3edf80e25414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:02.596247 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb9c53-a53c-4f26-afe6-3edf80e25414 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.596681 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb9c53-a53c-4f26-afe6-3edf80e25414 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.597110 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb9c53-a53c-4f26-afe6-3edf80e25414 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.603745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa385b-7712-4e0c-9ded-52e702661cbd admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:02.610415 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30b0df-85e1-4aa3-813a-0a3c42cf1a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:02.610917 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb9c53-a53c-4f26-afe6-3edf80e25414 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:02:02.611224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30b0df-85e1-4aa3-813a-0a3c42cf1a15 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.611603 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30b0df-85e1-4aa3-813a-0a3c42cf1a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.611978 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30b0df-85e1-4aa3-813a-0a3c42cf1a15 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.612863 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30b0df-85e1-4aa3-813a-0a3c42cf1a15 admin admin] RBAC: Adding query filter params (interface=public, service_id=077f10f670764c80a77f58713e045c53, region_id=RegionOne) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:02.613291 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30b0df-85e1-4aa3-813a-0a3c42cf1a15 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:02.615104 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30b0df-85e1-4aa3-813a-0a3c42cf1a15 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:02.620688 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-9ccb9c53-a53c-4f26-afe6-3edf80e25414 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 16:02:02.621340 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 414/836] 10.222.0.41 () {56 vars in 1272 bytes} [Fri Oct 29 16:02:02 2021] GET /identity/v3/endpoints?service_id=077f10f670764c80a77f58713e045c53&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:02.622610 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 423/837] 10.222.0.41 () {56 vars in 1141 bytes} [Fri Oct 29 16:02:02 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:02:02.628123 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30b0df-85e1-4aa3-813a-0a3c42cf1a15 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:02.629899 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb9c53-a53c-4f26-afe6-3edf80e25414 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:02.638939 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30b0df-85e1-4aa3-813a-0a3c42cf1a15 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:02.643802 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb9c53-a53c-4f26-afe6-3edf80e25414 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:02.644887 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee82f2-0c9b-4183-b4ee-38338adf11b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:02.645670 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee82f2-0c9b-4183-b4ee-38338adf11b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.646064 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee82f2-0c9b-4183-b4ee-38338adf11b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.646412 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee82f2-0c9b-4183-b4ee-38338adf11b7 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.647222 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee82f2-0c9b-4183-b4ee-38338adf11b7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:02.648979 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee82f2-0c9b-4183-b4ee-38338adf11b7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:02.649546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281dbf5-f62a-45d6-99f6-0add9f661faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:02.650616 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281dbf5-f62a-45d6-99f6-0add9f661faf admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.651384 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281dbf5-f62a-45d6-99f6-0add9f661faf admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.651815 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281dbf5-f62a-45d6-99f6-0add9f661faf admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.652995 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281dbf5-f62a-45d6-99f6-0add9f661faf admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:02.653456 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281dbf5-f62a-45d6-99f6-0add9f661faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:02.655246 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281dbf5-f62a-45d6-99f6-0add9f661faf admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:02.656352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 415/838] 10.222.0.41 () {56 vars in 1108 bytes} [Fri Oct 29 16:02:02 2021] GET /identity/v3/services => generated 1497 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:02:02.666764 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 424/839] 10.222.0.41 () {56 vars in 1136 bytes} [Fri Oct 29 16:02:02 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:02.675066 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee82f2-0c9b-4183-b4ee-38338adf11b7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:02.685002 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee82f2-0c9b-4183-b4ee-38338adf11b7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:02.690535 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b9a62-81cf-49b9-b825-506e01e37c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:02.691398 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b9a62-81cf-49b9-b825-506e01e37c67 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.691682 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b9a62-81cf-49b9-b825-506e01e37c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.691959 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390b9a62-81cf-49b9-b825-506e01e37c67 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.704804 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b9a62-81cf-49b9-b825-506e01e37c67 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:02.706788 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390b9a62-81cf-49b9-b825-506e01e37c67 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:02.724894 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-390b9a62-81cf-49b9-b825-506e01e37c67 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:02:02.726547 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 416/840] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:02.732747 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281dbf5-f62a-45d6-99f6-0add9f661faf admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:02.743546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281dbf5-f62a-45d6-99f6-0add9f661faf admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:02.748568 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c93b2-91ef-4f35-8a1e-f38f05138bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:02.749610 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c93b2-91ef-4f35-8a1e-f38f05138bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.750152 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c93b2-91ef-4f35-8a1e-f38f05138bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.751167 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c93b2-91ef-4f35-8a1e-f38f05138bf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.752148 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c93b2-91ef-4f35-8a1e-f38f05138bf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:02.752684 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c93b2-91ef-4f35-8a1e-f38f05138bf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:02.754584 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c93b2-91ef-4f35-8a1e-f38f05138bf5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:02.768774 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 425/841] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:02:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:02.775633 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b9a62-81cf-49b9-b825-506e01e37c67 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:02.788053 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390b9a62-81cf-49b9-b825-506e01e37c67 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:02.792727 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9586cb-94bf-440d-8def-abbecd35db6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:02.793553 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9586cb-94bf-440d-8def-abbecd35db6b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.793833 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9586cb-94bf-440d-8def-abbecd35db6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.794139 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9586cb-94bf-440d-8def-abbecd35db6b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.803408 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9586cb-94bf-440d-8def-abbecd35db6b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:02.805472 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9586cb-94bf-440d-8def-abbecd35db6b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:02.821020 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-da9586cb-94bf-440d-8def-abbecd35db6b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 29 16:02:02.822626 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 417/842] 10.222.0.41 () {56 vars in 1138 bytes} [Fri Oct 29 16:02:02 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:02.831347 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c93b2-91ef-4f35-8a1e-f38f05138bf5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:02.842182 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c93b2-91ef-4f35-8a1e-f38f05138bf5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:02.847726 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef4185-6c90-4973-8210-e348cc18517c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:02.848850 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef4185-6c90-4973-8210-e348cc18517c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.849477 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef4185-6c90-4973-8210-e348cc18517c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.850036 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef4185-6c90-4973-8210-e348cc18517c admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.851252 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef4185-6c90-4973-8210-e348cc18517c admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:02.851841 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef4185-6c90-4973-8210-e348cc18517c admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:02.854058 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef4185-6c90-4973-8210-e348cc18517c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:02.874920 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 426/843] 10.222.0.41 () {56 vars in 1170 bytes} [Fri Oct 29 16:02:02 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:02.882101 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9586cb-94bf-440d-8def-abbecd35db6b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:02.893158 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9586cb-94bf-440d-8def-abbecd35db6b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:02.898366 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09721f1-b8c4-40dc-a2ca-b2cdba83732d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:02.899300 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09721f1-b8c4-40dc-a2ca-b2cdba83732d admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.899741 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09721f1-b8c4-40dc-a2ca-b2cdba83732d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.900019 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09721f1-b8c4-40dc-a2ca-b2cdba83732d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.908543 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09721f1-b8c4-40dc-a2ca-b2cdba83732d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:02.910267 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09721f1-b8c4-40dc-a2ca-b2cdba83732d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:02.919478 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 418/844] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:02:02 2021] GET /identity/v3/auth/tokens => generated 2105 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:02:02.925845 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef4185-6c90-4973-8210-e348cc18517c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:02.936715 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef4185-6c90-4973-8210-e348cc18517c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:02.942215 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9a8b7-450b-4a00-98af-abc4e4e88a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:02.943342 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9a8b7-450b-4a00-98af-abc4e4e88a21 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.943859 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9a8b7-450b-4a00-98af-abc4e4e88a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.944316 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9a8b7-450b-4a00-98af-abc4e4e88a21 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.957972 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9a8b7-450b-4a00-98af-abc4e4e88a21 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:02.958281 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9a8b7-450b-4a00-98af-abc4e4e88a21 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:02.975563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-61b9a8b7-450b-4a00-98af-abc4e4e88a21 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:02:02.977068 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 427/845] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:02.983037 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09721f1-b8c4-40dc-a2ca-b2cdba83732d admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:02.992560 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09721f1-b8c4-40dc-a2ca-b2cdba83732d admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:02.997487 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6331d-94ce-42a5-b3c7-8a5f75127062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:02.998259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6331d-94ce-42a5-b3c7-8a5f75127062 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:02.998618 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6331d-94ce-42a5-b3c7-8a5f75127062 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:02.998965 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6331d-94ce-42a5-b3c7-8a5f75127062 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:02.999799 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6331d-94ce-42a5-b3c7-8a5f75127062 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:03.000179 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6331d-94ce-42a5-b3c7-8a5f75127062 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:03.002429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd6331d-94ce-42a5-b3c7-8a5f75127062 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:03.015446 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 419/846] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:02:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:03.022510 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9a8b7-450b-4a00-98af-abc4e4e88a21 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:03.032364 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9a8b7-450b-4a00-98af-abc4e4e88a21 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:03.037477 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc307b0-6d97-440f-a417-a116c6517fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:03.038222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc307b0-6d97-440f-a417-a116c6517fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:03.038726 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc307b0-6d97-440f-a417-a116c6517fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:03.039067 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc307b0-6d97-440f-a417-a116c6517fc2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:03.046433 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc307b0-6d97-440f-a417-a116c6517fc2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:03.048957 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc307b0-6d97-440f-a417-a116c6517fc2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:03.063687 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-5fc307b0-6d97-440f-a417-a116c6517fc2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:02:03.065217 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 428/847] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:02:03 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:03.071957 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6331d-94ce-42a5-b3c7-8a5f75127062 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:03.082559 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6331d-94ce-42a5-b3c7-8a5f75127062 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:03.087568 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39e885-6581-44c5-9fd0-f5b2123b39ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:03.088282 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39e885-6581-44c5-9fd0-f5b2123b39ab admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:03.088565 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39e885-6581-44c5-9fd0-f5b2123b39ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:03.088842 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39e885-6581-44c5-9fd0-f5b2123b39ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:03.089707 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39e885-6581-44c5-9fd0-f5b2123b39ab admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:03.090054 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39e885-6581-44c5-9fd0-f5b2123b39ab admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:03.092032 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd39e885-6581-44c5-9fd0-f5b2123b39ab admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:03.106722 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 420/848] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:02:03 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:03.113854 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc307b0-6d97-440f-a417-a116c6517fc2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:03.124796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc307b0-6d97-440f-a417-a116c6517fc2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:03.130197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499a96c8-24de-48d2-9651-80da33c9001c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:03.130844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a96c8-24de-48d2-9651-80da33c9001c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:03.131126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a96c8-24de-48d2-9651-80da33c9001c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:03.131404 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499a96c8-24de-48d2-9651-80da33c9001c admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:03.132277 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a96c8-24de-48d2-9651-80da33c9001c admin admin] RBAC: Adding query filter params (role.id=d76fb315cd8e43268d4d620325a554ef, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=10b4daa146fa4b638d90ea1e9a4878eb) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:03.132595 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a96c8-24de-48d2-9651-80da33c9001c admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:03.134558 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499a96c8-24de-48d2-9651-80da33c9001c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:03.141705 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 429/849] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:02:03 2021] GET /identity/v3/role_assignments?user.id=10b4daa146fa4b638d90ea1e9a4878eb&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=d76fb315cd8e43268d4d620325a554ef => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:04.255045 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0548b6b-b5ee-469a-8055-13bdcc25ca67 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:04.255584 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0548b6b-b5ee-469a-8055-13bdcc25ca67 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:04.255584 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0548b6b-b5ee-469a-8055-13bdcc25ca67 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:04.257593 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 421/850] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:04.263969 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724052f-6ffe-4fc2-aff5-26f53cbb32b6 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:04.264617 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724052f-6ffe-4fc2-aff5-26f53cbb32b6 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:04.264617 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724052f-6ffe-4fc2-aff5-26f53cbb32b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:04.284047 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-8724052f-6ffe-4fc2-aff5-26f53cbb32b6 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:04.285262 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-8724052f-6ffe-4fc2-aff5-26f53cbb32b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:04.293661 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 430/851] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:04 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:02:04.318214 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0548b6b-b5ee-469a-8055-13bdcc25ca67 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:04.334163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0548b6b-b5ee-469a-8055-13bdcc25ca67 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:04.340954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebd07f-abbf-4b1f-b439-b4abedf111c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:04.342249 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebd07f-abbf-4b1f-b439-b4abedf111c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:04.342628 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebd07f-abbf-4b1f-b439-b4abedf111c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:04.343050 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebd07f-abbf-4b1f-b439-b4abedf111c2 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:04.344141 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebd07f-abbf-4b1f-b439-b4abedf111c2 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:04.346742 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebd07f-abbf-4b1f-b439-b4abedf111c2 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:04.365155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-9cebd07f-abbf-4b1f-b439-b4abedf111c2 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 16:02:04.367373 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 422/852] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:02:04 2021] GET /identity/v3/services/compute => generated 88 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:04.378470 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724052f-6ffe-4fc2-aff5-26f53cbb32b6 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:04.393875 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724052f-6ffe-4fc2-aff5-26f53cbb32b6 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:04.401079 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb17d44-9150-40fb-9e9a-948ed5c55777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:04.402161 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb17d44-9150-40fb-9e9a-948ed5c55777 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:04.402602 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb17d44-9150-40fb-9e9a-948ed5c55777 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:04.403033 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb17d44-9150-40fb-9e9a-948ed5c55777 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:04.404210 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb17d44-9150-40fb-9e9a-948ed5c55777 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:04.404685 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb17d44-9150-40fb-9e9a-948ed5c55777 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:04.407594 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb17d44-9150-40fb-9e9a-948ed5c55777 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:04.415977 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 431/853] 10.222.0.41 () {56 vars in 1133 bytes} [Fri Oct 29 16:02:04 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:04.425873 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebd07f-abbf-4b1f-b439-b4abedf111c2 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:04.441146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebd07f-abbf-4b1f-b439-b4abedf111c2 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:04.448942 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee322e-f57d-4669-a5b0-5e36dad922b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:04.451986 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee322e-f57d-4669-a5b0-5e36dad922b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:04.451986 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee322e-f57d-4669-a5b0-5e36dad922b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:04.451986 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee322e-f57d-4669-a5b0-5e36dad922b4 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:04.451986 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee322e-f57d-4669-a5b0-5e36dad922b4 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:04.451986 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee322e-f57d-4669-a5b0-5e36dad922b4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:04.455117 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee322e-f57d-4669-a5b0-5e36dad922b4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:04.459717 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 423/854] 10.222.0.41 () {56 vars in 1133 bytes} [Fri Oct 29 16:02:04 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:04.653015 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b184299-4285-46e7-a181-28238bfdc416 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:04.653393 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b184299-4285-46e7-a181-28238bfdc416 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:04.653551 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b184299-4285-46e7-a181-28238bfdc416 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:04.655642 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 432/855] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:04.664502 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c102e64-3ade-4288-a37e-7e48ef70ecb6 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:04.664502 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c102e64-3ade-4288-a37e-7e48ef70ecb6 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:04.664502 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c102e64-3ade-4288-a37e-7e48ef70ecb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:04.689257 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-7c102e64-3ade-4288-a37e-7e48ef70ecb6 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:04.690849 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7c102e64-3ade-4288-a37e-7e48ef70ecb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:04.703372 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 424/856] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:04 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:04.731783 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b184299-4285-46e7-a181-28238bfdc416 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:04.752624 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b184299-4285-46e7-a181-28238bfdc416 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:04.759804 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcd4ce-5b99-450e-b28f-5ee8c2289561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:04.761038 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcd4ce-5b99-450e-b28f-5ee8c2289561 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:04.761577 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcd4ce-5b99-450e-b28f-5ee8c2289561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:04.762109 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcd4ce-5b99-450e-b28f-5ee8c2289561 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:04.763001 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcd4ce-5b99-450e-b28f-5ee8c2289561 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:04.764979 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcd4ce-5b99-450e-b28f-5ee8c2289561 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:04.780033 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-efdcd4ce-5b99-450e-b28f-5ee8c2289561 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 29 16:02:04.782545 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 433/857] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:02:04 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:04.790034 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c102e64-3ade-4288-a37e-7e48ef70ecb6 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:04.801091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c102e64-3ade-4288-a37e-7e48ef70ecb6 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:04.806747 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5257a-3789-4364-8742-ee670f845cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:04.807785 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5257a-3789-4364-8742-ee670f845cc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:04.808286 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5257a-3789-4364-8742-ee670f845cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:04.808844 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5257a-3789-4364-8742-ee670f845cc7 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:04.810072 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5257a-3789-4364-8742-ee670f845cc7 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:04.810783 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5257a-3789-4364-8742-ee670f845cc7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:04.813783 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5257a-3789-4364-8742-ee670f845cc7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:04.825171 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 425/858] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:02:04 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:04.827828 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcd4ce-5b99-450e-b28f-5ee8c2289561 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:04.842130 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcd4ce-5b99-450e-b28f-5ee8c2289561 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:04.848197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac5157-9bbf-4304-b8d7-de234a450d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:04.849200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac5157-9bbf-4304-b8d7-de234a450d93 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:04.849675 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac5157-9bbf-4304-b8d7-de234a450d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:04.850245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac5157-9bbf-4304-b8d7-de234a450d93 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:04.851195 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac5157-9bbf-4304-b8d7-de234a450d93 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:04.851743 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac5157-9bbf-4304-b8d7-de234a450d93 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:04.854190 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac5157-9bbf-4304-b8d7-de234a450d93 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:04.866038 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 434/859] 10.222.0.41 () {56 vars in 1135 bytes} [Fri Oct 29 16:02:04 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:04.870360 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5257a-3789-4364-8742-ee670f845cc7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:04.883931 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5257a-3789-4364-8742-ee670f845cc7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:04.889972 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea646b6-3ed1-4680-b9b0-2186aab621f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:04.890970 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea646b6-3ed1-4680-b9b0-2186aab621f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:04.891505 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea646b6-3ed1-4680-b9b0-2186aab621f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:04.892237 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea646b6-3ed1-4680-b9b0-2186aab621f9 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:04.894018 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea646b6-3ed1-4680-b9b0-2186aab621f9 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:04.897371 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea646b6-3ed1-4680-b9b0-2186aab621f9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:04.925007 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 426/860] 10.222.0.41 () {60 vars in 1165 bytes} [Fri Oct 29 16:02:04 2021] POST /identity/v3/endpoints => generated 346 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:02:05.093829 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c74cfa-ab85-4882-a37b-e92415692c17 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:05.094730 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c74cfa-ab85-4882-a37b-e92415692c17 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:05.095066 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c74cfa-ab85-4882-a37b-e92415692c17 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:05.097873 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 435/861] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:05.104300 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e4911-9d7f-43af-9c47-b113a1de1de7 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:05.104597 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e4911-9d7f-43af-9c47-b113a1de1de7 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:05.104893 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e4911-9d7f-43af-9c47-b113a1de1de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:05.134584 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-008e4911-9d7f-43af-9c47-b113a1de1de7 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:05.135808 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-008e4911-9d7f-43af-9c47-b113a1de1de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:05.157560 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 427/862] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:05 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:05.183567 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c74cfa-ab85-4882-a37b-e92415692c17 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:05.200420 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c74cfa-ab85-4882-a37b-e92415692c17 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:05.205773 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186d033-5da1-4d70-8adb-da1f5cdf817a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:05.206620 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186d033-5da1-4d70-8adb-da1f5cdf817a admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:05.206899 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186d033-5da1-4d70-8adb-da1f5cdf817a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:05.207173 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186d033-5da1-4d70-8adb-da1f5cdf817a admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:05.207845 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186d033-5da1-4d70-8adb-da1f5cdf817a admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:05.209459 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186d033-5da1-4d70-8adb-da1f5cdf817a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:05.223549 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-9186d033-5da1-4d70-8adb-da1f5cdf817a admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 16:02:05.225649 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 436/863] 10.222.0.41 () {56 vars in 1147 bytes} [Fri Oct 29 16:02:05 2021] GET /identity/v3/services/object-store => generated 93 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:05.237838 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e4911-9d7f-43af-9c47-b113a1de1de7 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:05.255208 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e4911-9d7f-43af-9c47-b113a1de1de7 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:05.265506 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2707e-0b59-4ee1-89d7-1f53bb8ede30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:05.265754 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2707e-0b59-4ee1-89d7-1f53bb8ede30 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:05.265888 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2707e-0b59-4ee1-89d7-1f53bb8ede30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:05.266781 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe2707e-0b59-4ee1-89d7-1f53bb8ede30 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:05.267416 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2707e-0b59-4ee1-89d7-1f53bb8ede30 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:05.267709 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2707e-0b59-4ee1-89d7-1f53bb8ede30 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:05.269359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe2707e-0b59-4ee1-89d7-1f53bb8ede30 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:05.276641 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 428/864] 10.222.0.41 () {56 vars in 1143 bytes} [Fri Oct 29 16:02:05 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:05.287040 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186d033-5da1-4d70-8adb-da1f5cdf817a admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:05.298495 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186d033-5da1-4d70-8adb-da1f5cdf817a admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:05.303717 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84483ff7-de99-4664-9427-d36190ecede3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:05.304543 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84483ff7-de99-4664-9427-d36190ecede3 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:05.305025 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84483ff7-de99-4664-9427-d36190ecede3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:05.305370 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84483ff7-de99-4664-9427-d36190ecede3 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:05.306236 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84483ff7-de99-4664-9427-d36190ecede3 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:05.306625 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84483ff7-de99-4664-9427-d36190ecede3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:05.308355 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84483ff7-de99-4664-9427-d36190ecede3 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:05.314649 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 437/865] 10.222.0.41 () {56 vars in 1143 bytes} [Fri Oct 29 16:02:05 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:05.322704 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2707e-0b59-4ee1-89d7-1f53bb8ede30 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:05.335935 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe2707e-0b59-4ee1-89d7-1f53bb8ede30 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:05.341478 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0018cca5-77ec-4a76-884c-a3e926622799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:05.342580 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018cca5-77ec-4a76-884c-a3e926622799 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:05.343041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018cca5-77ec-4a76-884c-a3e926622799 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:05.343507 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0018cca5-77ec-4a76-884c-a3e926622799 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:05.345400 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018cca5-77ec-4a76-884c-a3e926622799 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:05.348674 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0018cca5-77ec-4a76-884c-a3e926622799 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:05.386121 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 429/866] 10.222.0.41 () {60 vars in 1165 bytes} [Fri Oct 29 16:02:05 2021] POST /identity/v3/endpoints => generated 349 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:02:05.596863 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792273d-9dab-428d-8152-83fd35b7d29c None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:05.597545 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792273d-9dab-428d-8152-83fd35b7d29c None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:05.598132 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a792273d-9dab-428d-8152-83fd35b7d29c None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:05.603093 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 438/867] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:05 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:05.609297 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cac23a-bfbd-4278-8877-d8ce61ff1e18 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:05.609583 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cac23a-bfbd-4278-8877-d8ce61ff1e18 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:05.609898 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cac23a-bfbd-4278-8877-d8ce61ff1e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:05.638620 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-39cac23a-bfbd-4278-8877-d8ce61ff1e18 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:05.640114 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-39cac23a-bfbd-4278-8877-d8ce61ff1e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:05.658873 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 430/868] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:05 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:02:05.682933 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792273d-9dab-428d-8152-83fd35b7d29c None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:05.696006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a792273d-9dab-428d-8152-83fd35b7d29c None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:05.700511 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de31f7f-92f2-4f52-b617-f559024941d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:05.701584 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de31f7f-92f2-4f52-b617-f559024941d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:05.701841 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de31f7f-92f2-4f52-b617-f559024941d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:05.702157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de31f7f-92f2-4f52-b617-f559024941d0 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:05.702832 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de31f7f-92f2-4f52-b617-f559024941d0 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:05.705021 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de31f7f-92f2-4f52-b617-f559024941d0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:05.717060 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-5de31f7f-92f2-4f52-b617-f559024941d0 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 16:02:05.718925 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 439/869] 10.222.0.41 () {56 vars in 1126 bytes} [Fri Oct 29 16:02:05 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:05.725740 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cac23a-bfbd-4278-8877-d8ce61ff1e18 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:05.737692 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cac23a-bfbd-4278-8877-d8ce61ff1e18 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:05.742849 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4141b1f-1790-4e3a-8dbc-2b1bdd2d2e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:05.743575 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4141b1f-1790-4e3a-8dbc-2b1bdd2d2e22 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:05.743860 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4141b1f-1790-4e3a-8dbc-2b1bdd2d2e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:05.744217 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4141b1f-1790-4e3a-8dbc-2b1bdd2d2e22 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:05.745581 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4141b1f-1790-4e3a-8dbc-2b1bdd2d2e22 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:05.746151 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4141b1f-1790-4e3a-8dbc-2b1bdd2d2e22 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:05.748949 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4141b1f-1790-4e3a-8dbc-2b1bdd2d2e22 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:05.759041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 431/870] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:05 2021] GET /identity/v3/services?name=image => generated 122 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:05.767129 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de31f7f-92f2-4f52-b617-f559024941d0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:05.777356 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de31f7f-92f2-4f52-b617-f559024941d0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:05.782195 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab669f8-2a30-42d3-ba3c-b63d51e173e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:05.782864 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab669f8-2a30-42d3-ba3c-b63d51e173e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:05.783144 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab669f8-2a30-42d3-ba3c-b63d51e173e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:05.783417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab669f8-2a30-42d3-ba3c-b63d51e173e2 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:05.784147 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab669f8-2a30-42d3-ba3c-b63d51e173e2 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:05.784455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab669f8-2a30-42d3-ba3c-b63d51e173e2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:05.786471 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab669f8-2a30-42d3-ba3c-b63d51e173e2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:05.792986 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 440/871] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:05 2021] GET /identity/v3/services?type=image => generated 122 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:07.275558 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22666e-e9c0-4ffe-962f-f4719e76349b None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:07.276101 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22666e-e9c0-4ffe-962f-f4719e76349b None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:07.276101 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d22666e-e9c0-4ffe-962f-f4719e76349b None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:07.277871 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 432/872] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:07.284618 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c73c8-60d5-44bb-90cf-bc7098218392 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:07.285034 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c73c8-60d5-44bb-90cf-bc7098218392 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:07.285232 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585c73c8-60d5-44bb-90cf-bc7098218392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:07.311115 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-585c73c8-60d5-44bb-90cf-bc7098218392 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:07.312338 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-585c73c8-60d5-44bb-90cf-bc7098218392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:07.320668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 441/873] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:07 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:07.346258 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22666e-e9c0-4ffe-962f-f4719e76349b None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:07.359307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d22666e-e9c0-4ffe-962f-f4719e76349b None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:07.371591 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8648ce0-f72c-4780-8917-cc15537051d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:07.374012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8648ce0-f72c-4780-8917-cc15537051d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:07.374306 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8648ce0-f72c-4780-8917-cc15537051d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:07.374594 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8648ce0-f72c-4780-8917-cc15537051d4 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:07.376969 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8648ce0-f72c-4780-8917-cc15537051d4 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:07.378623 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8648ce0-f72c-4780-8917-cc15537051d4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:07.402802 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 433/874] 10.222.0.41 () {60 vars in 1162 bytes} [Fri Oct 29 16:02:07 2021] POST /identity/v3/services => generated 242 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:02:07.632413 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158992c6-ae7d-4f19-972b-ccb075f53dc7 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:07.632819 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158992c6-ae7d-4f19-972b-ccb075f53dc7 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:07.633029 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158992c6-ae7d-4f19-972b-ccb075f53dc7 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:07.635234 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 442/875] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:07.642370 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f8e59-b8d4-4d12-915d-9ddfec0a6fb7 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:07.642695 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f8e59-b8d4-4d12-915d-9ddfec0a6fb7 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:07.642937 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f8e59-b8d4-4d12-915d-9ddfec0a6fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:07.663309 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-769f8e59-b8d4-4d12-915d-9ddfec0a6fb7 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:07.664526 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-769f8e59-b8d4-4d12-915d-9ddfec0a6fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:07.685121 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 434/876] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:07 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:07.711886 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158992c6-ae7d-4f19-972b-ccb075f53dc7 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:07.725835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158992c6-ae7d-4f19-972b-ccb075f53dc7 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:07.730477 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e99cfa-cd0b-4ad1-b6ee-5a9db7e53c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:07.731141 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e99cfa-cd0b-4ad1-b6ee-5a9db7e53c83 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:07.731420 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e99cfa-cd0b-4ad1-b6ee-5a9db7e53c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:07.731695 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e99cfa-cd0b-4ad1-b6ee-5a9db7e53c83 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:07.732413 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e99cfa-cd0b-4ad1-b6ee-5a9db7e53c83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:07.734310 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e99cfa-cd0b-4ad1-b6ee-5a9db7e53c83 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:07.735690 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.common [None req-28e99cfa-cd0b-4ad1-b6ee-5a9db7e53c83 admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 29 16:02:07.753698 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.sql.core [None req-28e99cfa-cd0b-4ad1-b6ee-5a9db7e53c83 admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 29 16:02:07.753698 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 29 16:02:07.753698 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [parameters: {'id': '8c2505f8f7b44c9bbb68ae88a6611ec2', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 29 16:02:07.753698 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79609) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 29 16:02:07.769698 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-28e99cfa-cd0b-4ad1-b6ee-5a9db7e53c83 admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8c2505f8f7b44c9bbb68ae88a6611ec2.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8c2505f8f7b44c9bbb68ae88a6611ec2. Oct 29 16:02:07.771926 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 443/877] 10.222.0.41 () {60 vars in 1161 bytes} [Fri Oct 29 16:02:07 2021] POST /identity/v3/projects => generated 262 bytes in 61 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:07.778634 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f8e59-b8d4-4d12-915d-9ddfec0a6fb7 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:07.788692 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f8e59-b8d4-4d12-915d-9ddfec0a6fb7 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:07.793525 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a11e56-c6b4-4602-95d5-e97360b1fef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:07.794356 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a11e56-c6b4-4602-95d5-e97360b1fef3 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:07.794637 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a11e56-c6b4-4602-95d5-e97360b1fef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:07.794921 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a11e56-c6b4-4602-95d5-e97360b1fef3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:07.803019 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a11e56-c6b4-4602-95d5-e97360b1fef3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:07.805086 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a11e56-c6b4-4602-95d5-e97360b1fef3 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:07.818657 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-86a11e56-c6b4-4602-95d5-e97360b1fef3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:02:07.824358 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 435/878] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:02:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:07.827308 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e99cfa-cd0b-4ad1-b6ee-5a9db7e53c83 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:07.841693 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e99cfa-cd0b-4ad1-b6ee-5a9db7e53c83 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:07.847359 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c923a3-0534-4f3f-ae9f-3e46120c904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:07.848228 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c923a3-0534-4f3f-ae9f-3e46120c904b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:07.848866 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c923a3-0534-4f3f-ae9f-3e46120c904b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:07.849340 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c923a3-0534-4f3f-ae9f-3e46120c904b admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:07.850461 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c923a3-0534-4f3f-ae9f-3e46120c904b admin admin] RBAC: Adding query filter params (name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:07.850972 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c923a3-0534-4f3f-ae9f-3e46120c904b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:07.853345 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c923a3-0534-4f3f-ae9f-3e46120c904b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:07.880122 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 444/879] 10.222.0.41 () {56 vars in 1133 bytes} [Fri Oct 29 16:02:07 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:08.067663 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521fe50-bbed-4153-b93f-17784117d5fd None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:08.068241 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521fe50-bbed-4153-b93f-17784117d5fd None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:08.068789 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6521fe50-bbed-4153-b93f-17784117d5fd None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:08.071258 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 436/880] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:08 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:08.081094 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2586e9-44c5-4fcf-8d0d-f66ba8254641 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:08.081729 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2586e9-44c5-4fcf-8d0d-f66ba8254641 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:08.082321 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2586e9-44c5-4fcf-8d0d-f66ba8254641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:08.103434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-ba2586e9-44c5-4fcf-8d0d-f66ba8254641 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:08.105287 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ba2586e9-44c5-4fcf-8d0d-f66ba8254641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:08.118023 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 445/881] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:08 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:08.139944 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521fe50-bbed-4153-b93f-17784117d5fd None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:08.155192 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6521fe50-bbed-4153-b93f-17784117d5fd None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:08.160932 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a1d7b-14c8-4b03-a942-79209a991f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:08.162844 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a1d7b-14c8-4b03-a942-79209a991f86 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:08.163568 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a1d7b-14c8-4b03-a942-79209a991f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:08.164074 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a1d7b-14c8-4b03-a942-79209a991f86 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:08.165065 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a1d7b-14c8-4b03-a942-79209a991f86 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:08.166955 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a1d7b-14c8-4b03-a942-79209a991f86 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:08.180821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-c15a1d7b-14c8-4b03-a942-79209a991f86 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 16:02:08.188862 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 437/882] 10.222.0.41 () {56 vars in 1147 bytes} [Fri Oct 29 16:02:08 2021] GET /identity/v3/services/object-store => generated 93 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:02:08.190541 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2586e9-44c5-4fcf-8d0d-f66ba8254641 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:08.200552 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2586e9-44c5-4fcf-8d0d-f66ba8254641 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:08.207466 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eea36-50a7-4e71-9fb2-2144dfdd75a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:08.208719 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eea36-50a7-4e71-9fb2-2144dfdd75a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:08.209362 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eea36-50a7-4e71-9fb2-2144dfdd75a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:08.210072 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eea36-50a7-4e71-9fb2-2144dfdd75a9 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:08.211554 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eea36-50a7-4e71-9fb2-2144dfdd75a9 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:08.212236 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eea36-50a7-4e71-9fb2-2144dfdd75a9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:08.214674 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eea36-50a7-4e71-9fb2-2144dfdd75a9 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:08.226068 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 446/883] 10.222.0.41 () {56 vars in 1143 bytes} [Fri Oct 29 16:02:08 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:08.230196 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a1d7b-14c8-4b03-a942-79209a991f86 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:08.243149 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a1d7b-14c8-4b03-a942-79209a991f86 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:08.248426 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b26b92e-c3e3-43bb-9879-bd49c6226526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:08.249371 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26b92e-c3e3-43bb-9879-bd49c6226526 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:08.249857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26b92e-c3e3-43bb-9879-bd49c6226526 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:08.250950 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b26b92e-c3e3-43bb-9879-bd49c6226526 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:08.251895 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26b92e-c3e3-43bb-9879-bd49c6226526 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:08.252445 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26b92e-c3e3-43bb-9879-bd49c6226526 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:08.254359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b26b92e-c3e3-43bb-9879-bd49c6226526 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:08.265901 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 438/884] 10.222.0.41 () {56 vars in 1143 bytes} [Fri Oct 29 16:02:08 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:08.268129 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eea36-50a7-4e71-9fb2-2144dfdd75a9 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:08.278631 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eea36-50a7-4e71-9fb2-2144dfdd75a9 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:08.283916 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071ed68-25d0-4ddf-a2ce-d1da2ee4310e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:08.284879 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071ed68-25d0-4ddf-a2ce-d1da2ee4310e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:08.285790 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071ed68-25d0-4ddf-a2ce-d1da2ee4310e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:08.286311 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071ed68-25d0-4ddf-a2ce-d1da2ee4310e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:08.287523 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071ed68-25d0-4ddf-a2ce-d1da2ee4310e admin admin] RBAC: Adding query filter params (interface=admin, service_id=077f10f670764c80a77f58713e045c53, region_id=RegionOne) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:08.289375 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe88807-6618-4304-b118-fd97c141e50d None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:08.289796 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe88807-6618-4304-b118-fd97c141e50d None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:08.289997 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe88807-6618-4304-b118-fd97c141e50d None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:08.291854 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 439/885] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:08.293110 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071ed68-25d0-4ddf-a2ce-d1da2ee4310e admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:08.293892 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071ed68-25d0-4ddf-a2ce-d1da2ee4310e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:08.299118 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945c160-1f76-4f3c-b8ac-318c7235acd2 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:08.299657 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945c160-1f76-4f3c-b8ac-318c7235acd2 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:08.300133 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945c160-1f76-4f3c-b8ac-318c7235acd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:08.305665 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 447/886] 10.222.0.41 () {56 vars in 1270 bytes} [Fri Oct 29 16:02:08 2021] GET /identity/v3/endpoints?service_id=077f10f670764c80a77f58713e045c53&interface=admin®ion_id=RegionOne => generated 193 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:08.306849 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071ed68-25d0-4ddf-a2ce-d1da2ee4310e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:08.316916 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071ed68-25d0-4ddf-a2ce-d1da2ee4310e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:08.319511 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-9945c160-1f76-4f3c-b8ac-318c7235acd2 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:08.320921 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-9945c160-1f76-4f3c-b8ac-318c7235acd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:08.321722 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916f087-5e5a-444e-b7a7-3c3328c9db5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:08.322480 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916f087-5e5a-444e-b7a7-3c3328c9db5a admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:08.322769 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916f087-5e5a-444e-b7a7-3c3328c9db5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:08.323047 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b916f087-5e5a-444e-b7a7-3c3328c9db5a admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:08.323746 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916f087-5e5a-444e-b7a7-3c3328c9db5a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:08.325344 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b916f087-5e5a-444e-b7a7-3c3328c9db5a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:08.341950 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 448/888] 10.222.0.41 () {56 vars in 1108 bytes} [Fri Oct 29 16:02:08 2021] GET /identity/v3/services => generated 1727 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:02:08.342153 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 440/888] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:08 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:08.361782 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916f087-5e5a-444e-b7a7-3c3328c9db5a admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:08.372849 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b916f087-5e5a-444e-b7a7-3c3328c9db5a admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:08.378674 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05580b6d-b955-412b-b382-9c484983c72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:08.379413 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05580b6d-b955-412b-b382-9c484983c72b admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:08.379696 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05580b6d-b955-412b-b382-9c484983c72b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:08.379974 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05580b6d-b955-412b-b382-9c484983c72b admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:08.380784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05580b6d-b955-412b-b382-9c484983c72b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:08.382497 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05580b6d-b955-412b-b382-9c484983c72b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:08.406034 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 449/889] 10.222.0.41 () {60 vars in 1162 bytes} [Fri Oct 29 16:02:08 2021] POST /identity/v3/services => generated 242 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:02:09.837525 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45daa965-2e4f-474f-802a-640cbd50a06a None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:09.838058 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45daa965-2e4f-474f-802a-640cbd50a06a None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:09.838165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45daa965-2e4f-474f-802a-640cbd50a06a None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:09.840232 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 441/890] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:09.846271 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a07037-c54d-4ffd-bfbb-4d8ad3dc3878 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:09.846659 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a07037-c54d-4ffd-bfbb-4d8ad3dc3878 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:09.846945 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a07037-c54d-4ffd-bfbb-4d8ad3dc3878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:09.866417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-69a07037-c54d-4ffd-bfbb-4d8ad3dc3878 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:09.867610 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-69a07037-c54d-4ffd-bfbb-4d8ad3dc3878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:09.887439 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 450/891] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:09 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:09.910778 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45daa965-2e4f-474f-802a-640cbd50a06a None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:09.923612 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45daa965-2e4f-474f-802a-640cbd50a06a None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:09.928999 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ecc4e-36e9-4f89-ba28-647cae380f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:09.929772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ecc4e-36e9-4f89-ba28-647cae380f8a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:09.930960 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ecc4e-36e9-4f89-ba28-647cae380f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:09.932098 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ecc4e-36e9-4f89-ba28-647cae380f8a admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:09.932770 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ecc4e-36e9-4f89-ba28-647cae380f8a admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:09.934383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ecc4e-36e9-4f89-ba28-647cae380f8a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:09.946323 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-cc0ecc4e-36e9-4f89-ba28-647cae380f8a admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 16:02:09.947833 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 442/892] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:02:09 2021] GET /identity/v3/services/compute => generated 88 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:09.954638 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a07037-c54d-4ffd-bfbb-4d8ad3dc3878 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:09.963991 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a07037-c54d-4ffd-bfbb-4d8ad3dc3878 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:09.968574 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68554ac7-20bb-4383-b842-08e2f2e5a5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:09.969263 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68554ac7-20bb-4383-b842-08e2f2e5a5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:09.969545 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68554ac7-20bb-4383-b842-08e2f2e5a5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:09.969819 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68554ac7-20bb-4383-b842-08e2f2e5a5d4 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:09.970583 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68554ac7-20bb-4383-b842-08e2f2e5a5d4 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:09.970887 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68554ac7-20bb-4383-b842-08e2f2e5a5d4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:09.972500 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68554ac7-20bb-4383-b842-08e2f2e5a5d4 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:09.977617 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 451/893] 10.222.0.41 () {56 vars in 1133 bytes} [Fri Oct 29 16:02:09 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:09.983956 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ecc4e-36e9-4f89-ba28-647cae380f8a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:09.994752 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ecc4e-36e9-4f89-ba28-647cae380f8a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:09.999356 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d8b90-1cc8-419a-8fff-3c0bd49a71f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:10.000005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d8b90-1cc8-419a-8fff-3c0bd49a71f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.000988 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d8b90-1cc8-419a-8fff-3c0bd49a71f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.001268 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d8b90-1cc8-419a-8fff-3c0bd49a71f4 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.002016 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d8b90-1cc8-419a-8fff-3c0bd49a71f4 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:10.002324 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d8b90-1cc8-419a-8fff-3c0bd49a71f4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:10.003907 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d8b90-1cc8-419a-8fff-3c0bd49a71f4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:10.009611 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 443/894] 10.222.0.41 () {56 vars in 1133 bytes} [Fri Oct 29 16:02:09 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:10.016101 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68554ac7-20bb-4383-b842-08e2f2e5a5d4 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:10.026434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68554ac7-20bb-4383-b842-08e2f2e5a5d4 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:10.031047 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e02e238-c337-4584-8b80-6106a4926976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:10.031661 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02e238-c337-4584-8b80-6106a4926976 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.031941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02e238-c337-4584-8b80-6106a4926976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.032215 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e02e238-c337-4584-8b80-6106a4926976 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.033008 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02e238-c337-4584-8b80-6106a4926976 admin admin] RBAC: Adding query filter params (interface=public, service_id=f9daf7a9853744bfb810627c948bda5f, region_id=RegionOne) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:10.033317 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02e238-c337-4584-8b80-6106a4926976 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:10.034930 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e02e238-c337-4584-8b80-6106a4926976 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:10.040624 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 452/895] 10.222.0.41 () {56 vars in 1272 bytes} [Fri Oct 29 16:02:10 2021] GET /identity/v3/endpoints?service_id=f9daf7a9853744bfb810627c948bda5f&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:10.046711 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d8b90-1cc8-419a-8fff-3c0bd49a71f4 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:10.057012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d8b90-1cc8-419a-8fff-3c0bd49a71f4 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:10.061614 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee2319-9cc4-4ac8-99e5-6421897e2348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:10.062307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee2319-9cc4-4ac8-99e5-6421897e2348 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.062587 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee2319-9cc4-4ac8-99e5-6421897e2348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.063563 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee2319-9cc4-4ac8-99e5-6421897e2348 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.064300 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee2319-9cc4-4ac8-99e5-6421897e2348 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:10.065911 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee2319-9cc4-4ac8-99e5-6421897e2348 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:10.073154 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 444/896] 10.222.0.41 () {56 vars in 1108 bytes} [Fri Oct 29 16:02:10 2021] GET /identity/v3/services => generated 1957 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:02:10.290958 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5159a72-bce5-430e-98f2-64fb19e474ec None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.291303 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5159a72-bce5-430e-98f2-64fb19e474ec None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.291563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5159a72-bce5-430e-98f2-64fb19e474ec None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.293187 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 453/897] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:10.299816 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccbf94-1f43-45c5-a105-90c64b746f76 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.300105 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccbf94-1f43-45c5-a105-90c64b746f76 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.300385 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccbf94-1f43-45c5-a105-90c64b746f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.318242 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-09ccbf94-1f43-45c5-a105-90c64b746f76 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:10.319436 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-09ccbf94-1f43-45c5-a105-90c64b746f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:10.327816 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 445/898] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:10 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:10.354012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5159a72-bce5-430e-98f2-64fb19e474ec None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:10.367495 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5159a72-bce5-430e-98f2-64fb19e474ec None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:10.371960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f857639-9ea3-42a2-9e53-19853144a794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:10.372618 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f857639-9ea3-42a2-9e53-19853144a794 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.372944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f857639-9ea3-42a2-9e53-19853144a794 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.373220 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f857639-9ea3-42a2-9e53-19853144a794 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.373954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f857639-9ea3-42a2-9e53-19853144a794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:10.375838 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f857639-9ea3-42a2-9e53-19853144a794 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:10.390249 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.sql.core [None req-0f857639-9ea3-42a2-9e53-19853144a794 admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 29 16:02:10.390249 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 29 16:02:10.390249 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [parameters: {'user_id': 'f40eb83a6cbb42099f678b2b3e416925', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 29 16:02:10.390249 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79609) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 29 16:02:10.396270 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-0f857639-9ea3-42a2-9e53-19853144a794 admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 29 16:02:10.397836 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 454/899] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:02:10 2021] POST /identity/v3/users => generated 160 bytes in 44 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:10.408959 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccbf94-1f43-45c5-a105-90c64b746f76 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:10.414591 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ccbf94-1f43-45c5-a105-90c64b746f76 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:10.419489 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7eb78-d257-4d7b-886f-fbcf5bebf8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:10.420524 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7eb78-d257-4d7b-886f-fbcf5bebf8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.421021 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7eb78-d257-4d7b-886f-fbcf5bebf8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.421489 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7eb78-d257-4d7b-886f-fbcf5bebf8c3 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.430047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7eb78-d257-4d7b-886f-fbcf5bebf8c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:10.432391 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7eb78-d257-4d7b-886f-fbcf5bebf8c3 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:10.447545 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-beb7eb78-d257-4d7b-886f-fbcf5bebf8c3 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 29 16:02:10.449314 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 446/900] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:02:10 2021] GET /identity/v3/users/cinder => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:10.456366 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f857639-9ea3-42a2-9e53-19853144a794 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:10.467463 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f857639-9ea3-42a2-9e53-19853144a794 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:10.472910 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647e21da-893d-45a0-b37f-4bad1fa366e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:10.473817 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e21da-893d-45a0-b37f-4bad1fa366e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.474352 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e21da-893d-45a0-b37f-4bad1fa366e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.474824 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e21da-893d-45a0-b37f-4bad1fa366e9 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.475837 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e21da-893d-45a0-b37f-4bad1fa366e9 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:10.476339 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e21da-893d-45a0-b37f-4bad1fa366e9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:10.478672 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647e21da-893d-45a0-b37f-4bad1fa366e9 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:10.520964 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 455/901] 10.222.0.41 () {56 vars in 1122 bytes} [Fri Oct 29 16:02:10 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:10.748781 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856fdfe-2de0-48c4-908c-d3256006e4c6 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.749141 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856fdfe-2de0-48c4-908c-d3256006e4c6 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.749333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a856fdfe-2de0-48c4-908c-d3256006e4c6 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.751410 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 447/902] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:10 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:10.757761 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef1248-bbde-4004-af34-2bd5b273b4b0 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.758126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef1248-bbde-4004-af34-2bd5b273b4b0 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.758356 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef1248-bbde-4004-af34-2bd5b273b4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.767005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63359c9-6937-40f2-84d3-fb600ce53235 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.767285 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63359c9-6937-40f2-84d3-fb600ce53235 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.767561 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63359c9-6937-40f2-84d3-fb600ce53235 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.769593 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 448/903] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:02:10.775874 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b12e9-157f-43e7-9d93-5674befe9a17 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.776149 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b12e9-157f-43e7-9d93-5674befe9a17 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.776873 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b12e9-157f-43e7-9d93-5674befe9a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.785253 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-78ef1248-bbde-4004-af34-2bd5b273b4b0 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:10.787000 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-78ef1248-bbde-4004-af34-2bd5b273b4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:10.795344 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-422b12e9-157f-43e7-9d93-5674befe9a17 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:10.796035 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 456/904] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:10 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:10.797182 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-422b12e9-157f-43e7-9d93-5674befe9a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:10.810822 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 449/905] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:10 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:02:10.820264 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef1248-bbde-4004-af34-2bd5b273b4b0 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:10.830358 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef1248-bbde-4004-af34-2bd5b273b4b0 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:10.833711 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b12e9-157f-43e7-9d93-5674befe9a17 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:10.835740 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e6d05-67fa-4a10-aa28-22480e79ee32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:10.836550 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6d05-67fa-4a10-aa28-22480e79ee32 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.836825 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6d05-67fa-4a10-aa28-22480e79ee32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.837093 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669e6d05-67fa-4a10-aa28-22480e79ee32 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.837757 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e6d05-67fa-4a10-aa28-22480e79ee32 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:10.840278 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669e6d05-67fa-4a10-aa28-22480e79ee32 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:10.842993 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b12e9-157f-43e7-9d93-5674befe9a17 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:10.851339 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99b309-7c83-4fdf-a199-c18aadd62f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:10.852381 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99b309-7c83-4fdf-a199-c18aadd62f41 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.852639 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-669e6d05-67fa-4a10-aa28-22480e79ee32 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 29 16:02:10.853278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99b309-7c83-4fdf-a199-c18aadd62f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.853755 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99b309-7c83-4fdf-a199-c18aadd62f41 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.854148 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 457/906] 10.222.0.41 () {56 vars in 1147 bytes} [Fri Oct 29 16:02:10 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:10.854907 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99b309-7c83-4fdf-a199-c18aadd62f41 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:10.856753 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99b309-7c83-4fdf-a199-c18aadd62f41 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:10.860755 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e6d05-67fa-4a10-aa28-22480e79ee32 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:10.868152 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-ea99b309-7c83-4fdf-a199-c18aadd62f41 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 16:02:10.869505 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 450/907] 10.222.0.41 () {56 vars in 1126 bytes} [Fri Oct 29 16:02:10 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:02:10.870706 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669e6d05-67fa-4a10-aa28-22480e79ee32 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:10.875674 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63083e23-81cf-41bd-9b88-5f65aafbc1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:10.876321 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63083e23-81cf-41bd-9b88-5f65aafbc1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.876502 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99b309-7c83-4fdf-a199-c18aadd62f41 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:10.876604 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63083e23-81cf-41bd-9b88-5f65aafbc1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.876846 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63083e23-81cf-41bd-9b88-5f65aafbc1d6 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.877551 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63083e23-81cf-41bd-9b88-5f65aafbc1d6 admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:10.877848 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63083e23-81cf-41bd-9b88-5f65aafbc1d6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:10.879539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63083e23-81cf-41bd-9b88-5f65aafbc1d6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:10.886193 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99b309-7c83-4fdf-a199-c18aadd62f41 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:10.889166 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 458/908] 10.222.0.41 () {56 vars in 1143 bytes} [Fri Oct 29 16:02:10 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:10.891409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63083e23-81cf-41bd-9b88-5f65aafbc1d6 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:10.894057 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511943de-f3fe-4800-9060-bbf46a970dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:10.894695 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511943de-f3fe-4800-9060-bbf46a970dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.895109 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511943de-f3fe-4800-9060-bbf46a970dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.895294 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511943de-f3fe-4800-9060-bbf46a970dc7 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.896040 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511943de-f3fe-4800-9060-bbf46a970dc7 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:10.896276 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511943de-f3fe-4800-9060-bbf46a970dc7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:10.897854 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511943de-f3fe-4800-9060-bbf46a970dc7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:10.900532 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63083e23-81cf-41bd-9b88-5f65aafbc1d6 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:10.904936 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b45f17-ffe9-49a6-b298-e53e9c7a639d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:10.905571 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b45f17-ffe9-49a6-b298-e53e9c7a639d admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.905852 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b45f17-ffe9-49a6-b298-e53e9c7a639d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.906154 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b45f17-ffe9-49a6-b298-e53e9c7a639d admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.906888 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b45f17-ffe9-49a6-b298-e53e9c7a639d admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:10.907190 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b45f17-ffe9-49a6-b298-e53e9c7a639d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:10.908271 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 451/909] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:10 2021] GET /identity/v3/services?name=image => generated 122 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:10.908759 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b45f17-ffe9-49a6-b298-e53e9c7a639d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:10.909589 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511943de-f3fe-4800-9060-bbf46a970dc7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:10.913886 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 459/910] 10.222.0.41 () {56 vars in 1143 bytes} [Fri Oct 29 16:02:10 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:10.920090 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b45f17-ffe9-49a6-b298-e53e9c7a639d admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:10.924186 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511943de-f3fe-4800-9060-bbf46a970dc7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:10.928846 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f4dcc-3c24-49da-b35c-f348737cf4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:10.929370 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b45f17-ffe9-49a6-b298-e53e9c7a639d admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:10.929535 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f4dcc-3c24-49da-b35c-f348737cf4cd admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.929776 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f4dcc-3c24-49da-b35c-f348737cf4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.930082 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f4dcc-3c24-49da-b35c-f348737cf4cd admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.930802 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f4dcc-3c24-49da-b35c-f348737cf4cd admin admin] RBAC: Adding query filter params (type=image) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:10.931108 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f4dcc-3c24-49da-b35c-f348737cf4cd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:10.932677 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f4dcc-3c24-49da-b35c-f348737cf4cd admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:10.933731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142394e-5c6a-48ee-b84a-07eb238cbb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:10.934389 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142394e-5c6a-48ee-b84a-07eb238cbb48 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.934701 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142394e-5c6a-48ee-b84a-07eb238cbb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.934951 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b142394e-5c6a-48ee-b84a-07eb238cbb48 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.935696 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142394e-5c6a-48ee-b84a-07eb238cbb48 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:10.937253 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b142394e-5c6a-48ee-b84a-07eb238cbb48 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:10.938823 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 452/911] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:10 2021] GET /identity/v3/services?type=image => generated 350 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:10.946107 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f4dcc-3c24-49da-b35c-f348737cf4cd admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:10.954439 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 460/912] 10.222.0.41 () {60 vars in 1165 bytes} [Fri Oct 29 16:02:10 2021] POST /identity/v3/endpoints => generated 325 bytes in 35 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:02:10.961024 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f4dcc-3c24-49da-b35c-f348737cf4cd admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:10.977650 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99920905-02a5-41d6-b85b-ff8b652e8eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:10.978410 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99920905-02a5-41d6-b85b-ff8b652e8eed admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:10.978742 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99920905-02a5-41d6-b85b-ff8b652e8eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:10.978960 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99920905-02a5-41d6-b85b-ff8b652e8eed admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:10.979844 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99920905-02a5-41d6-b85b-ff8b652e8eed admin admin] RBAC: Adding query filter params (interface=public, service_id=1696a101dae74e08b7381f62b13072b4, region_id=RegionOne) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:10.980159 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99920905-02a5-41d6-b85b-ff8b652e8eed admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:10.982000 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99920905-02a5-41d6-b85b-ff8b652e8eed admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:10.993766 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 453/913] 10.222.0.41 () {56 vars in 1272 bytes} [Fri Oct 29 16:02:10 2021] GET /identity/v3/endpoints?service_id=1696a101dae74e08b7381f62b13072b4&interface=public®ion_id=RegionOne => generated 194 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:10.995102 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142394e-5c6a-48ee-b84a-07eb238cbb48 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:11.006872 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b142394e-5c6a-48ee-b84a-07eb238cbb48 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:11.011538 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4c22d-7800-4b90-98f5-6355a20715f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:11.012233 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4c22d-7800-4b90-98f5-6355a20715f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:11.012524 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4c22d-7800-4b90-98f5-6355a20715f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:11.012790 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4c22d-7800-4b90-98f5-6355a20715f1 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:11.013498 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4c22d-7800-4b90-98f5-6355a20715f1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:11.015259 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac4c22d-7800-4b90-98f5-6355a20715f1 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:11.030011 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 461/914] 10.222.0.41 () {56 vars in 1108 bytes} [Fri Oct 29 16:02:10 2021] GET /identity/v3/services => generated 1957 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:02:12.401888 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b3706-d8eb-4c9f-a9d1-61dd9ea36186 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:12.402444 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b3706-d8eb-4c9f-a9d1-61dd9ea36186 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:12.402444 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b3706-d8eb-4c9f-a9d1-61dd9ea36186 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:12.404211 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 454/915] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:12.410245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a4ab3-80ec-4828-895c-58d913eb151b None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:12.410888 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a4ab3-80ec-4828-895c-58d913eb151b None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:12.410888 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a4ab3-80ec-4828-895c-58d913eb151b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:12.428021 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-069a4ab3-80ec-4828-895c-58d913eb151b None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:12.429217 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-069a4ab3-80ec-4828-895c-58d913eb151b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:12.437017 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 462/916] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:12 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:12.461286 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b3706-d8eb-4c9f-a9d1-61dd9ea36186 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:12.473188 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b3706-d8eb-4c9f-a9d1-61dd9ea36186 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:12.477729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dfdcc-e3de-4a2f-8faf-e3e675ad91f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:12.478521 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dfdcc-e3de-4a2f-8faf-e3e675ad91f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:12.478804 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dfdcc-e3de-4a2f-8faf-e3e675ad91f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:12.479077 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7dfdcc-e3de-4a2f-8faf-e3e675ad91f2 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:12.479739 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7dfdcc-e3de-4a2f-8faf-e3e675ad91f2 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:12.481307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7dfdcc-e3de-4a2f-8faf-e3e675ad91f2 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:12.491948 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-cb7dfdcc-e3de-4a2f-8faf-e3e675ad91f2 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 29 16:02:12.493262 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 455/917] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:02:12 2021] GET /identity/v3/services/compute => generated 88 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:12.499485 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a4ab3-80ec-4828-895c-58d913eb151b None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:12.509291 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a4ab3-80ec-4828-895c-58d913eb151b None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:12.513858 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed8aa8-dfdc-41b2-86f3-ec11e3ddefb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:12.514617 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed8aa8-dfdc-41b2-86f3-ec11e3ddefb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:12.514975 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed8aa8-dfdc-41b2-86f3-ec11e3ddefb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:12.515325 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed8aa8-dfdc-41b2-86f3-ec11e3ddefb6 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:12.516693 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed8aa8-dfdc-41b2-86f3-ec11e3ddefb6 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:12.517080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed8aa8-dfdc-41b2-86f3-ec11e3ddefb6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:12.518744 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ed8aa8-dfdc-41b2-86f3-ec11e3ddefb6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:12.524452 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 463/918] 10.222.0.41 () {56 vars in 1133 bytes} [Fri Oct 29 16:02:12 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:12.530815 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dfdcc-e3de-4a2f-8faf-e3e675ad91f2 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:12.540464 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7dfdcc-e3de-4a2f-8faf-e3e675ad91f2 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:12.544993 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3718d4ee-90d9-460e-955a-a8487fa9f0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:12.545647 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718d4ee-90d9-460e-955a-a8487fa9f0aa admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:12.545945 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718d4ee-90d9-460e-955a-a8487fa9f0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:12.546220 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718d4ee-90d9-460e-955a-a8487fa9f0aa admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:12.546961 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718d4ee-90d9-460e-955a-a8487fa9f0aa admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:12.547269 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718d4ee-90d9-460e-955a-a8487fa9f0aa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:12.548850 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3718d4ee-90d9-460e-955a-a8487fa9f0aa admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:12.559171 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 456/919] 10.222.0.41 () {56 vars in 1133 bytes} [Fri Oct 29 16:02:12 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:12.560612 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed8aa8-dfdc-41b2-86f3-ec11e3ddefb6 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:12.570858 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed8aa8-dfdc-41b2-86f3-ec11e3ddefb6 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:12.575369 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e199d7-b6c8-4451-86d4-c25c6dffcea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:12.576274 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e199d7-b6c8-4451-86d4-c25c6dffcea6 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:12.576554 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e199d7-b6c8-4451-86d4-c25c6dffcea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:12.576829 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e199d7-b6c8-4451-86d4-c25c6dffcea6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:12.577584 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e199d7-b6c8-4451-86d4-c25c6dffcea6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:12.579812 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e199d7-b6c8-4451-86d4-c25c6dffcea6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:12.599764 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 464/920] 10.222.0.41 () {60 vars in 1165 bytes} [Fri Oct 29 16:02:12 2021] POST /identity/v3/endpoints => generated 334 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:02:13.256615 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30853dcd-a665-4358-990b-908c03d3d4e0 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:13.256987 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30853dcd-a665-4358-990b-908c03d3d4e0 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:13.257165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30853dcd-a665-4358-990b-908c03d3d4e0 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:13.259038 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 457/921] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:13.265083 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9539b88-e250-49a9-a3d0-7f4cef42b749 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:13.265377 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9539b88-e250-49a9-a3d0-7f4cef42b749 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:13.265683 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9539b88-e250-49a9-a3d0-7f4cef42b749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:13.283563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-b9539b88-e250-49a9-a3d0-7f4cef42b749 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:13.284745 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b9539b88-e250-49a9-a3d0-7f4cef42b749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:13.302581 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ffb12-f79c-4538-8142-e8fe2bb55fd7 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:13.302892 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ffb12-f79c-4538-8142-e8fe2bb55fd7 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:13.303132 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ffb12-f79c-4538-8142-e8fe2bb55fd7 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:13.305001 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 458/922] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:02:13.309306 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 465/923] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:13 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:13.310715 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d8eb4-4a49-467f-b41e-c68c0611ce00 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:13.311001 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d8eb4-4a49-467f-b41e-c68c0611ce00 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:13.311273 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d8eb4-4a49-467f-b41e-c68c0611ce00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:13.327447 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9539b88-e250-49a9-a3d0-7f4cef42b749 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:13.328634 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-ad1d8eb4-4a49-467f-b41e-c68c0611ce00 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:13.329815 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-ad1d8eb4-4a49-467f-b41e-c68c0611ce00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:13.336633 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9539b88-e250-49a9-a3d0-7f4cef42b749 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:13.338557 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 459/924] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:13 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:13.341094 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b374d72-a016-4417-8228-8ed0cda7d210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:13.341876 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b374d72-a016-4417-8228-8ed0cda7d210 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:13.342195 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b374d72-a016-4417-8228-8ed0cda7d210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:13.342473 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b374d72-a016-4417-8228-8ed0cda7d210 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:13.343652 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b374d72-a016-4417-8228-8ed0cda7d210 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:13.345986 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b374d72-a016-4417-8228-8ed0cda7d210 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:13.347661 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 466/925] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:13 2021] GET /identity/v3/domains/default => generated 199 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:13.353935 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d8eb4-4a49-467f-b41e-c68c0611ce00 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:13.362601 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b374d72-a016-4417-8228-8ed0cda7d210 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:13.364358 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d8eb4-4a49-467f-b41e-c68c0611ce00 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:13.368782 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b97b26-1d7c-4ce8-83d2-d834c4e89ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:13.369422 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b97b26-1d7c-4ce8-83d2-d834c4e89ace admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:13.369703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b97b26-1d7c-4ce8-83d2-d834c4e89ace admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:13.370027 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b97b26-1d7c-4ce8-83d2-d834c4e89ace admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:13.370733 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b97b26-1d7c-4ce8-83d2-d834c4e89ace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:13.372303 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b374d72-a016-4417-8228-8ed0cda7d210 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:13.372590 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b97b26-1d7c-4ce8-83d2-d834c4e89ace admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:13.376805 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897d31f-d935-4de1-88be-e09e9ee3c4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:13.377562 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897d31f-d935-4de1-88be-e09e9ee3c4bd admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:13.377846 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897d31f-d935-4de1-88be-e09e9ee3c4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:13.378156 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897d31f-d935-4de1-88be-e09e9ee3c4bd admin admin] PATH_INFO: `/v3/services/image` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:13.378815 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897d31f-d935-4de1-88be-e09e9ee3c4bd admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:13.380390 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6897d31f-d935-4de1-88be-e09e9ee3c4bd admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:13.391216 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-6897d31f-d935-4de1-88be-e09e9ee3c4bd admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 29 16:02:13.392539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 467/926] 10.222.0.41 () {56 vars in 1126 bytes} [Fri Oct 29 16:02:13 2021] GET /identity/v3/services/image => generated 86 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:02:13.405955 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 460/927] 10.222.0.41 () {60 vars in 1162 bytes} [Fri Oct 29 16:02:13 2021] POST /identity/v3/projects => generated 311 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:02:13.407046 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897d31f-d935-4de1-88be-e09e9ee3c4bd admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:13.409329 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6897d31f-d935-4de1-88be-e09e9ee3c4bd admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:13.471313 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcc3e6-a76d-44b2-8e05-c4b399efd378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:13.472102 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcc3e6-a76d-44b2-8e05-c4b399efd378 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:13.472269 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcc3e6-a76d-44b2-8e05-c4b399efd378 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:13.472542 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcc3e6-a76d-44b2-8e05-c4b399efd378 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:13.473271 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcc3e6-a76d-44b2-8e05-c4b399efd378 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:13.473580 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcc3e6-a76d-44b2-8e05-c4b399efd378 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:13.475260 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcc3e6-a76d-44b2-8e05-c4b399efd378 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:13.485181 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 468/928] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:13 2021] GET /identity/v3/services?name=image => generated 122 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:13.488217 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b97b26-1d7c-4ce8-83d2-d834c4e89ace admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:13.499126 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b97b26-1d7c-4ce8-83d2-d834c4e89ace admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:13.503772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4498839f-5bbf-43af-a7cc-62e7d0d177fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:13.504474 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498839f-5bbf-43af-a7cc-62e7d0d177fc admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:13.504755 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498839f-5bbf-43af-a7cc-62e7d0d177fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:13.505030 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4498839f-5bbf-43af-a7cc-62e7d0d177fc admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:13.505767 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498839f-5bbf-43af-a7cc-62e7d0d177fc admin admin] RBAC: Adding query filter params (type=image) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:13.506104 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498839f-5bbf-43af-a7cc-62e7d0d177fc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:13.507772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4498839f-5bbf-43af-a7cc-62e7d0d177fc admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:13.513341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 461/929] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:13 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:13.520728 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcc3e6-a76d-44b2-8e05-c4b399efd378 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:13.531103 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcc3e6-a76d-44b2-8e05-c4b399efd378 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:13.536514 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902dba3-367e-4d98-b6fd-d648be7de94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:13.537187 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902dba3-367e-4d98-b6fd-d648be7de94d admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:13.537470 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902dba3-367e-4d98-b6fd-d648be7de94d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:13.537743 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902dba3-367e-4d98-b6fd-d648be7de94d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:13.538546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902dba3-367e-4d98-b6fd-d648be7de94d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:13.540157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c902dba3-367e-4d98-b6fd-d648be7de94d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:13.561434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 469/930] 10.222.0.41 () {60 vars in 1165 bytes} [Fri Oct 29 16:02:13 2021] POST /identity/v3/endpoints => generated 327 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:02:14.980849 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375019a4-1470-4b2e-8884-c0486c3b7409 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:14.981388 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375019a4-1470-4b2e-8884-c0486c3b7409 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:14.981388 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375019a4-1470-4b2e-8884-c0486c3b7409 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:14.987967 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 462/931] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:14.990151 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caad21-ee22-4587-a720-003c75d77f5c None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:14.990567 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caad21-ee22-4587-a720-003c75d77f5c None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:14.990704 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3caad21-ee22-4587-a720-003c75d77f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.008084 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-a3caad21-ee22-4587-a720-003c75d77f5c None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:15.009261 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a3caad21-ee22-4587-a720-003c75d77f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:15.026211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 470/932] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:14 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:02:15.050494 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375019a4-1470-4b2e-8884-c0486c3b7409 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:15.062441 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375019a4-1470-4b2e-8884-c0486c3b7409 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:15.066902 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34128c-9851-4b15-8b4f-c5be04c39898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:15.067538 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34128c-9851-4b15-8b4f-c5be04c39898 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.067812 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34128c-9851-4b15-8b4f-c5be04c39898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.068083 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34128c-9851-4b15-8b4f-c5be04c39898 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.079056 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34128c-9851-4b15-8b4f-c5be04c39898 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:02:15.086215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-fb34128c-9851-4b15-8b4f-c5be04c39898 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 16:02:15.087552 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 463/933] 10.222.0.41 () {56 vars in 1141 bytes} [Fri Oct 29 16:02:15 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:15.094394 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3caad21-ee22-4587-a720-003c75d77f5c None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:15.103775 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3caad21-ee22-4587-a720-003c75d77f5c None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:15.108203 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6041dfe-43f8-4ffc-b23f-3f812183931e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:15.108857 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6041dfe-43f8-4ffc-b23f-3f812183931e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.109135 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6041dfe-43f8-4ffc-b23f-3f812183931e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.109432 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6041dfe-43f8-4ffc-b23f-3f812183931e admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.110222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6041dfe-43f8-4ffc-b23f-3f812183931e admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:15.110524 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6041dfe-43f8-4ffc-b23f-3f812183931e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:15.112176 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6041dfe-43f8-4ffc-b23f-3f812183931e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:15.121276 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 471/934] 10.222.0.41 () {56 vars in 1136 bytes} [Fri Oct 29 16:02:15 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:15.127378 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34128c-9851-4b15-8b4f-c5be04c39898 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:15.136915 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34128c-9851-4b15-8b4f-c5be04c39898 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:15.141886 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bb85d-8b32-4341-8128-cb0ee9a51b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:15.142675 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bb85d-8b32-4341-8128-cb0ee9a51b05 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.142948 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bb85d-8b32-4341-8128-cb0ee9a51b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.143213 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971bb85d-8b32-4341-8128-cb0ee9a51b05 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.153197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bb85d-8b32-4341-8128-cb0ee9a51b05 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:15.155037 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971bb85d-8b32-4341-8128-cb0ee9a51b05 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:15.173492 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-971bb85d-8b32-4341-8128-cb0ee9a51b05 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:02:15.180004 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 464/935] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:15.181490 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6041dfe-43f8-4ffc-b23f-3f812183931e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:15.191448 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6041dfe-43f8-4ffc-b23f-3f812183931e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:15.196465 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44507ca-4359-47c4-8289-b28f5d9da5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:15.197212 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44507ca-4359-47c4-8289-b28f5d9da5e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.197563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44507ca-4359-47c4-8289-b28f5d9da5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.197910 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44507ca-4359-47c4-8289-b28f5d9da5e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.198751 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44507ca-4359-47c4-8289-b28f5d9da5e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:15.199123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44507ca-4359-47c4-8289-b28f5d9da5e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:15.201045 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44507ca-4359-47c4-8289-b28f5d9da5e0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:15.213799 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 472/936] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:02:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:15.220598 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bb85d-8b32-4341-8128-cb0ee9a51b05 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:15.230255 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971bb85d-8b32-4341-8128-cb0ee9a51b05 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:15.235221 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740f8b2-a974-478e-9f65-b08d4a0f2a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:15.235896 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740f8b2-a974-478e-9f65-b08d4a0f2a34 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.236177 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740f8b2-a974-478e-9f65-b08d4a0f2a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.236450 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e740f8b2-a974-478e-9f65-b08d4a0f2a34 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.243984 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740f8b2-a974-478e-9f65-b08d4a0f2a34 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:15.246005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e740f8b2-a974-478e-9f65-b08d4a0f2a34 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:15.259274 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-e740f8b2-a974-478e-9f65-b08d4a0f2a34 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 16:02:15.260623 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 465/937] 10.222.0.41 () {56 vars in 1114 bytes} [Fri Oct 29 16:02:15 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:15.267294 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44507ca-4359-47c4-8289-b28f5d9da5e0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:15.277197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44507ca-4359-47c4-8289-b28f5d9da5e0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:15.282517 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7fe4a-e303-4aed-adc9-0342b98c9bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:15.283202 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7fe4a-e303-4aed-adc9-0342b98c9bda admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.283482 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7fe4a-e303-4aed-adc9-0342b98c9bda admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.283758 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7fe4a-e303-4aed-adc9-0342b98c9bda admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.284593 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7fe4a-e303-4aed-adc9-0342b98c9bda admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:15.284896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7fe4a-e303-4aed-adc9-0342b98c9bda admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:15.286753 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7fe4a-e303-4aed-adc9-0342b98c9bda admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:15.304586 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 473/938] 10.222.0.41 () {56 vars in 1154 bytes} [Fri Oct 29 16:02:15 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:15.310703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740f8b2-a974-478e-9f65-b08d4a0f2a34 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:15.320645 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e740f8b2-a974-478e-9f65-b08d4a0f2a34 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:15.325062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5d929-c6c9-4ac5-a58b-ddf8b22e929c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:15.325979 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5d929-c6c9-4ac5-a58b-ddf8b22e929c admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.326258 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5d929-c6c9-4ac5-a58b-ddf8b22e929c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.326528 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5d929-c6c9-4ac5-a58b-ddf8b22e929c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.334920 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5d929-c6c9-4ac5-a58b-ddf8b22e929c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:15.336646 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5d929-c6c9-4ac5-a58b-ddf8b22e929c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:15.346040 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 466/939] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:02:15 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:02:15.352789 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7fe4a-e303-4aed-adc9-0342b98c9bda admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:15.362686 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7fe4a-e303-4aed-adc9-0342b98c9bda admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:15.367568 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b943b3-e4e0-41d0-a269-14981e81cb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:15.368434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b943b3-e4e0-41d0-a269-14981e81cb37 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.368788 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b943b3-e4e0-41d0-a269-14981e81cb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.369133 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b943b3-e4e0-41d0-a269-14981e81cb37 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.379918 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b943b3-e4e0-41d0-a269-14981e81cb37 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:15.381785 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b943b3-e4e0-41d0-a269-14981e81cb37 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:15.399271 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-16b943b3-e4e0-41d0-a269-14981e81cb37 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:02:15.400664 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 474/940] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:15 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:15.406994 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5d929-c6c9-4ac5-a58b-ddf8b22e929c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:15.415806 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5d929-c6c9-4ac5-a58b-ddf8b22e929c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:15.420385 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250918f-7789-4b9f-add8-361a63ef9387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:15.421094 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250918f-7789-4b9f-add8-361a63ef9387 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.421439 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250918f-7789-4b9f-add8-361a63ef9387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.421780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250918f-7789-4b9f-add8-361a63ef9387 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.422603 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250918f-7789-4b9f-add8-361a63ef9387 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:15.422988 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250918f-7789-4b9f-add8-361a63ef9387 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:15.424615 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250918f-7789-4b9f-add8-361a63ef9387 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:15.438030 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 467/941] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:02:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:15.443480 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b943b3-e4e0-41d0-a269-14981e81cb37 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:15.454002 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b943b3-e4e0-41d0-a269-14981e81cb37 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:15.458980 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe939561-a972-4605-baeb-9842744d98a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:15.459781 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe939561-a972-4605-baeb-9842744d98a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.460065 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe939561-a972-4605-baeb-9842744d98a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.460340 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe939561-a972-4605-baeb-9842744d98a2 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.467455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe939561-a972-4605-baeb-9842744d98a2 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:15.469461 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe939561-a972-4605-baeb-9842744d98a2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:15.482164 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-fe939561-a972-4605-baeb-9842744d98a2 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:02:15.483477 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 475/942] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:02:15 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:15.490176 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250918f-7789-4b9f-add8-361a63ef9387 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:15.499820 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250918f-7789-4b9f-add8-361a63ef9387 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:15.505048 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eadc50-c0ca-48d5-84ec-b470da7f66cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:15.505626 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eadc50-c0ca-48d5-84ec-b470da7f66cd admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.506023 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eadc50-c0ca-48d5-84ec-b470da7f66cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.506389 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eadc50-c0ca-48d5-84ec-b470da7f66cd admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.507233 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eadc50-c0ca-48d5-84ec-b470da7f66cd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:15.507605 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eadc50-c0ca-48d5-84ec-b470da7f66cd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:15.509491 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eadc50-c0ca-48d5-84ec-b470da7f66cd admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:15.523062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 468/943] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:02:15 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:15.530099 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe939561-a972-4605-baeb-9842744d98a2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:15.540612 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe939561-a972-4605-baeb-9842744d98a2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:15.545083 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f1efd-b720-4d69-af51-344e3dcc678d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:15.545732 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f1efd-b720-4d69-af51-344e3dcc678d admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.546044 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f1efd-b720-4d69-af51-344e3dcc678d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.546323 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f1efd-b720-4d69-af51-344e3dcc678d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.547190 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f1efd-b720-4d69-af51-344e3dcc678d admin admin] RBAC: Adding query filter params (role.id=d76fb315cd8e43268d4d620325a554ef, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=4f13d0e9f79a433c81759ecd819a6dfa) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:15.547500 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f1efd-b720-4d69-af51-344e3dcc678d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:15.549336 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f1efd-b720-4d69-af51-344e3dcc678d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:15.555061 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 476/944] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:02:15 2021] GET /identity/v3/role_assignments?user.id=4f13d0e9f79a433c81759ecd819a6dfa&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=d76fb315cd8e43268d4d620325a554ef => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:15.732012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d183878-deb6-4efb-a7b0-80c85af6147e None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.732294 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d183878-deb6-4efb-a7b0-80c85af6147e None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.732576 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d183878-deb6-4efb-a7b0-80c85af6147e None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.734554 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 469/945] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:15.741385 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c813718-c863-46f3-8f49-3db72a5c89d5 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.741831 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c813718-c863-46f3-8f49-3db72a5c89d5 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.742253 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c813718-c863-46f3-8f49-3db72a5c89d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.766230 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-5c813718-c863-46f3-8f49-3db72a5c89d5 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:15.768027 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-5c813718-c863-46f3-8f49-3db72a5c89d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:15.778575 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 477/946] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:15 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:15.804416 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d183878-deb6-4efb-a7b0-80c85af6147e None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:15.817155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d183878-deb6-4efb-a7b0-80c85af6147e None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:15.821561 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753594b0-f726-4ced-80d5-0c7d920740c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:15.822380 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753594b0-f726-4ced-80d5-0c7d920740c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.822658 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753594b0-f726-4ced-80d5-0c7d920740c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.822927 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753594b0-f726-4ced-80d5-0c7d920740c9 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.824101 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753594b0-f726-4ced-80d5-0c7d920740c9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:15.826090 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753594b0-f726-4ced-80d5-0c7d920740c9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:15.827840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 470/947] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:15.834318 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c813718-c863-46f3-8f49-3db72a5c89d5 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:15.843423 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c813718-c863-46f3-8f49-3db72a5c89d5 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:15.847972 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115563d-f93e-4f17-8550-6920b15e2a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:15.848637 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115563d-f93e-4f17-8550-6920b15e2a98 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.848921 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115563d-f93e-4f17-8550-6920b15e2a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.849199 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3115563d-f93e-4f17-8550-6920b15e2a98 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.849948 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115563d-f93e-4f17-8550-6920b15e2a98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:15.851865 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3115563d-f93e-4f17-8550-6920b15e2a98 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:15.871161 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78ce12-590c-48ce-bd12-a40b8a61475b None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.871452 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78ce12-590c-48ce-bd12-a40b8a61475b None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.871724 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee78ce12-590c-48ce-bd12-a40b8a61475b None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.873683 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 471/948] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:15 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:02:15.882025 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 478/949] 10.222.0.41 () {60 vars in 1153 bytes} [Fri Oct 29 16:02:15 2021] POST /identity/v3/users => generated 285 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:02:15.882212 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab13bd-2bc3-4a23-8fc7-da3584787695 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.882212 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab13bd-2bc3-4a23-8fc7-da3584787695 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.882212 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab13bd-2bc3-4a23-8fc7-da3584787695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.900118 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-bfab13bd-2bc3-4a23-8fc7-da3584787695 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:15.901345 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-bfab13bd-2bc3-4a23-8fc7-da3584787695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:15.910944 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 472/950] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:15 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:15.934193 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115563d-f93e-4f17-8550-6920b15e2a98 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:15.944991 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3115563d-f93e-4f17-8550-6920b15e2a98 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:15.949653 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fd0a19-b7bd-431f-8632-1ea76075a8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:15.950353 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd0a19-b7bd-431f-8632-1ea76075a8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.950895 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd0a19-b7bd-431f-8632-1ea76075a8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.951169 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fd0a19-b7bd-431f-8632-1ea76075a8a8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.960645 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd0a19-b7bd-431f-8632-1ea76075a8a8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:15.962475 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fd0a19-b7bd-431f-8632-1ea76075a8a8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:15.972627 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 479/951] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:02:15 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:02:15.980100 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab13bd-2bc3-4a23-8fc7-da3584787695 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:15.990502 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab13bd-2bc3-4a23-8fc7-da3584787695 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:15.995398 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d74c6-a5bb-44ec-9085-958ab7dafc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:15.996351 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d74c6-a5bb-44ec-9085-958ab7dafc30 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:15.996727 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d74c6-a5bb-44ec-9085-958ab7dafc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:15.997094 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d74c6-a5bb-44ec-9085-958ab7dafc30 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:15.998453 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d74c6-a5bb-44ec-9085-958ab7dafc30 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:16.000906 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d74c6-a5bb-44ec-9085-958ab7dafc30 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:16.002783 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 473/952] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:17.819145 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91068ec0-ef64-46b7-b13a-205682cd6ddf None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:17.819650 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91068ec0-ef64-46b7-b13a-205682cd6ddf None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:17.819737 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91068ec0-ef64-46b7-b13a-205682cd6ddf None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:17.821502 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 480/953] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:02:17.827842 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311cf33-6b57-4bd1-9049-f4dc7faad255 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:17.828251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311cf33-6b57-4bd1-9049-f4dc7faad255 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:17.828382 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3311cf33-6b57-4bd1-9049-f4dc7faad255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:17.845790 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-3311cf33-6b57-4bd1-9049-f4dc7faad255 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:17.846976 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3311cf33-6b57-4bd1-9049-f4dc7faad255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:17.854708 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 474/954] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:17 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:02:17.878752 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91068ec0-ef64-46b7-b13a-205682cd6ddf None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:17.891094 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91068ec0-ef64-46b7-b13a-205682cd6ddf None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:17.895572 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204a06b-f39e-46be-a9a2-05fa7bfa9d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:17.896360 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204a06b-f39e-46be-a9a2-05fa7bfa9d55 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:17.896635 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204a06b-f39e-46be-a9a2-05fa7bfa9d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:17.896903 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204a06b-f39e-46be-a9a2-05fa7bfa9d55 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:17.907386 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f204a06b-f39e-46be-a9a2-05fa7bfa9d55 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:02:17.914487 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-f204a06b-f39e-46be-a9a2-05fa7bfa9d55 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 16:02:17.915784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 481/955] 10.222.0.41 () {56 vars in 1141 bytes} [Fri Oct 29 16:02:17 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:17.922890 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311cf33-6b57-4bd1-9049-f4dc7faad255 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:17.932277 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3311cf33-6b57-4bd1-9049-f4dc7faad255 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:17.936691 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1092130-b20b-4383-a3ce-f3cca704bdb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:17.937343 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1092130-b20b-4383-a3ce-f3cca704bdb9 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:17.937619 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1092130-b20b-4383-a3ce-f3cca704bdb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:17.937888 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1092130-b20b-4383-a3ce-f3cca704bdb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:17.938666 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1092130-b20b-4383-a3ce-f3cca704bdb9 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:17.938966 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1092130-b20b-4383-a3ce-f3cca704bdb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:17.940523 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1092130-b20b-4383-a3ce-f3cca704bdb9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:17.949091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 475/956] 10.222.0.41 () {56 vars in 1136 bytes} [Fri Oct 29 16:02:17 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:17.955757 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204a06b-f39e-46be-a9a2-05fa7bfa9d55 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:17.965836 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204a06b-f39e-46be-a9a2-05fa7bfa9d55 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:17.970888 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97364b-b512-468b-8000-1a4e7562416e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:17.971653 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97364b-b512-468b-8000-1a4e7562416e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:17.971936 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97364b-b512-468b-8000-1a4e7562416e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:17.972209 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea97364b-b512-468b-8000-1a4e7562416e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:17.982030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97364b-b512-468b-8000-1a4e7562416e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:17.983866 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea97364b-b512-468b-8000-1a4e7562416e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:18.001558 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-ea97364b-b512-468b-8000-1a4e7562416e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:02:18.002785 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 482/957] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:17 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:18.009103 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1092130-b20b-4383-a3ce-f3cca704bdb9 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:18.019096 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1092130-b20b-4383-a3ce-f3cca704bdb9 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:18.024778 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2ebf1-6df4-4db6-b062-9fb3d4dce854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:18.025424 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2ebf1-6df4-4db6-b062-9fb3d4dce854 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:18.025709 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2ebf1-6df4-4db6-b062-9fb3d4dce854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:18.026014 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb2ebf1-6df4-4db6-b062-9fb3d4dce854 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:18.026750 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2ebf1-6df4-4db6-b062-9fb3d4dce854 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:18.027056 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2ebf1-6df4-4db6-b062-9fb3d4dce854 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:18.028701 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb2ebf1-6df4-4db6-b062-9fb3d4dce854 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:18.040935 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 476/958] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:02:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:18.046984 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97364b-b512-468b-8000-1a4e7562416e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:18.057259 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea97364b-b512-468b-8000-1a4e7562416e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:18.061979 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d2502-4418-49da-8279-9b4f60031bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:18.062847 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d2502-4418-49da-8279-9b4f60031bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:18.063127 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d2502-4418-49da-8279-9b4f60031bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:18.063402 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d2502-4418-49da-8279-9b4f60031bd5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:18.072214 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d2502-4418-49da-8279-9b4f60031bd5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:18.074343 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d2502-4418-49da-8279-9b4f60031bd5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:18.090108 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-ac5d2502-4418-49da-8279-9b4f60031bd5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 16:02:18.091352 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 483/959] 10.222.0.41 () {56 vars in 1114 bytes} [Fri Oct 29 16:02:18 2021] GET /identity/v3/users/nova => generated 82 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:18.098517 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2ebf1-6df4-4db6-b062-9fb3d4dce854 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:18.108199 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb2ebf1-6df4-4db6-b062-9fb3d4dce854 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:18.112742 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e75206-35b4-41b2-a064-2b5f579eb0b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:18.113484 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e75206-35b4-41b2-a064-2b5f579eb0b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:18.113835 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e75206-35b4-41b2-a064-2b5f579eb0b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:18.114205 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e75206-35b4-41b2-a064-2b5f579eb0b3 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:18.115119 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e75206-35b4-41b2-a064-2b5f579eb0b3 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:18.115541 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e75206-35b4-41b2-a064-2b5f579eb0b3 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:18.117465 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e75206-35b4-41b2-a064-2b5f579eb0b3 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:18.134394 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 477/960] 10.222.0.41 () {56 vars in 1154 bytes} [Fri Oct 29 16:02:18 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:18.141375 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d2502-4418-49da-8279-9b4f60031bd5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:18.150994 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d2502-4418-49da-8279-9b4f60031bd5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:18.155491 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207e97f7-1748-420b-8924-72a08dbcb579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:18.156833 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e97f7-1748-420b-8924-72a08dbcb579 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:18.157117 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e97f7-1748-420b-8924-72a08dbcb579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:18.157387 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207e97f7-1748-420b-8924-72a08dbcb579 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:18.167430 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e97f7-1748-420b-8924-72a08dbcb579 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:18.169295 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207e97f7-1748-420b-8924-72a08dbcb579 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:18.185942 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-207e97f7-1748-420b-8924-72a08dbcb579 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:02:18.187125 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 484/961] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:18 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:18.193887 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e75206-35b4-41b2-a064-2b5f579eb0b3 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:18.203923 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252b216-87b1-4e92-b22f-dab540f5b879 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:18.204207 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252b216-87b1-4e92-b22f-dab540f5b879 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:18.204392 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e75206-35b4-41b2-a064-2b5f579eb0b3 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:18.204486 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d252b216-87b1-4e92-b22f-dab540f5b879 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:18.206236 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 485/962] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:02:18.209139 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2becdf8-ff6f-49cf-8258-10a0f5648d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:18.209783 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2becdf8-ff6f-49cf-8258-10a0f5648d71 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:18.210107 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2becdf8-ff6f-49cf-8258-10a0f5648d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:18.210691 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2becdf8-ff6f-49cf-8258-10a0f5648d71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:18.211437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2becdf8-ff6f-49cf-8258-10a0f5648d71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:18.211743 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949b62d-d772-46b6-baae-cbf9b681bdbd None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:18.211833 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2becdf8-ff6f-49cf-8258-10a0f5648d71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:18.212031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949b62d-d772-46b6-baae-cbf9b681bdbd None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:18.212303 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4949b62d-d772-46b6-baae-cbf9b681bdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:18.213337 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2becdf8-ff6f-49cf-8258-10a0f5648d71 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:18.230545 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 478/963] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:02:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:18.230732 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-4949b62d-d772-46b6-baae-cbf9b681bdbd None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:18.231359 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4949b62d-d772-46b6-baae-cbf9b681bdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:18.231521 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2becdf8-ff6f-49cf-8258-10a0f5648d71 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:18.239002 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 486/964] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:18 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:02:18.241338 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2becdf8-ff6f-49cf-8258-10a0f5648d71 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:18.245832 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc3e6d-9870-446e-a630-da488d7af79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:18.246625 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc3e6d-9870-446e-a630-da488d7af79a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:18.246907 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc3e6d-9870-446e-a630-da488d7af79a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:18.247183 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc3e6d-9870-446e-a630-da488d7af79a admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:18.253942 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc3e6d-9870-446e-a630-da488d7af79a admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:18.255908 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc3e6d-9870-446e-a630-da488d7af79a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:18.263280 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949b62d-d772-46b6-baae-cbf9b681bdbd None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:18.270895 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-80fc3e6d-9870-446e-a630-da488d7af79a admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:02:18.272073 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 479/965] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:02:18 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:02:18.272384 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4949b62d-d772-46b6-baae-cbf9b681bdbd None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:18.276812 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0844d26-57ad-4c7e-ab3b-8919f0acfd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:18.277586 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0844d26-57ad-4c7e-ab3b-8919f0acfd3b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:18.277866 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0844d26-57ad-4c7e-ab3b-8919f0acfd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:18.278430 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0844d26-57ad-4c7e-ab3b-8919f0acfd3b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:18.278590 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc3e6d-9870-446e-a630-da488d7af79a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:18.288296 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc3e6d-9870-446e-a630-da488d7af79a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:18.288933 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0844d26-57ad-4c7e-ab3b-8919f0acfd3b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:02:18.293300 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768fe30-2b74-4f42-9a73-d2891fd68636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:18.293930 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768fe30-2b74-4f42-9a73-d2891fd68636 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:18.294225 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768fe30-2b74-4f42-9a73-d2891fd68636 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:18.294501 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8768fe30-2b74-4f42-9a73-d2891fd68636 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:18.295296 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768fe30-2b74-4f42-9a73-d2891fd68636 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:18.295603 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768fe30-2b74-4f42-9a73-d2891fd68636 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:18.295694 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-a0844d26-57ad-4c7e-ab3b-8919f0acfd3b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:02:18.296868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 487/966] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:02:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:02:18.297465 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8768fe30-2b74-4f42-9a73-d2891fd68636 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:18.303399 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0844d26-57ad-4c7e-ab3b-8919f0acfd3b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:18.314934 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 480/967] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:02:18 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:18.315070 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0844d26-57ad-4c7e-ab3b-8919f0acfd3b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:18.315614 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768fe30-2b74-4f42-9a73-d2891fd68636 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:18.318255 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278b0e1-d42e-47e9-8e3a-283237228f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:18.318899 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278b0e1-d42e-47e9-8e3a-283237228f7a admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:18.319180 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278b0e1-d42e-47e9-8e3a-283237228f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:18.319455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c278b0e1-d42e-47e9-8e3a-283237228f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:18.320326 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278b0e1-d42e-47e9-8e3a-283237228f7a admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:18.320503 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278b0e1-d42e-47e9-8e3a-283237228f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:18.322120 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c278b0e1-d42e-47e9-8e3a-283237228f7a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:18.324812 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8768fe30-2b74-4f42-9a73-d2891fd68636 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:18.330193 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2af20a-75e2-4a49-97a3-3d5a8ec608b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:18.331133 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 488/968] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:02:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:18.331244 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2af20a-75e2-4a49-97a3-3d5a8ec608b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:18.331379 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2af20a-75e2-4a49-97a3-3d5a8ec608b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:18.331661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2af20a-75e2-4a49-97a3-3d5a8ec608b4 admin admin] PATH_INFO: `/v3/projects/4939afba2b604181b67577f309c9550a/users/4f13d0e9f79a433c81759ecd819a6dfa/roles/d76fb315cd8e43268d4d620325a554ef` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:18.334089 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2af20a-75e2-4a49-97a3-3d5a8ec608b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4939afba2b604181b67577f309c9550a, user_id=4f13d0e9f79a433c81759ecd819a6dfa, role_id=d76fb315cd8e43268d4d620325a554ef)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:18.336794 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2af20a-75e2-4a49-97a3-3d5a8ec608b4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:18.337142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278b0e1-d42e-47e9-8e3a-283237228f7a admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:18.347191 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c278b0e1-d42e-47e9-8e3a-283237228f7a admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:18.350423 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 481/969] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:02:18 2021] PUT /identity/v3/projects/4939afba2b604181b67577f309c9550a/users/4f13d0e9f79a433c81759ecd819a6dfa/roles/d76fb315cd8e43268d4d620325a554ef => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:02:18.405094 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4c360-0869-44cb-91bf-3097b361a9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:18.406022 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4c360-0869-44cb-91bf-3097b361a9bf admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:18.406344 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4c360-0869-44cb-91bf-3097b361a9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:18.406621 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4c360-0869-44cb-91bf-3097b361a9bf admin admin] PATH_INFO: `/v3/users/066d46fd3ea540a5afab903d46f73ccb` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:18.421227 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4c360-0869-44cb-91bf-3097b361a9bf admin admin] RBAC: Authorizing `identity:get_user(user_id=066d46fd3ea540a5afab903d46f73ccb)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:18.423493 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d4c360-0869-44cb-91bf-3097b361a9bf admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:18.425295 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 489/970] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:02:18 2021] GET /identity/v3/users/066d46fd3ea540a5afab903d46f73ccb => generated 285 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:18.432134 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2af20a-75e2-4a49-97a3-3d5a8ec608b4 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:18.442856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2af20a-75e2-4a49-97a3-3d5a8ec608b4 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:18.447493 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55689ec9-8b78-463f-8809-2b14f0e430b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:18.448144 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55689ec9-8b78-463f-8809-2b14f0e430b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:18.448425 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55689ec9-8b78-463f-8809-2b14f0e430b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:18.448698 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55689ec9-8b78-463f-8809-2b14f0e430b4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:18.458239 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55689ec9-8b78-463f-8809-2b14f0e430b4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:18.459999 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55689ec9-8b78-463f-8809-2b14f0e430b4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:18.470084 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 482/971] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:02:18 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:02:18.477566 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4c360-0869-44cb-91bf-3097b361a9bf admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:18.487676 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4c360-0869-44cb-91bf-3097b361a9bf admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:18.492693 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f9884-64b6-4170-b8e3-b685528531b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:18.493605 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f9884-64b6-4170-b8e3-b685528531b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:18.493909 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f9884-64b6-4170-b8e3-b685528531b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:18.494231 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f9884-64b6-4170-b8e3-b685528531b3 admin admin] PATH_INFO: `/v3/projects/42d8c8692f4449f38699eb596233e6a8` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:18.495511 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f9884-64b6-4170-b8e3-b685528531b3 admin admin] RBAC: Authorizing `identity:get_project(project_id=42d8c8692f4449f38699eb596233e6a8)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:18.497610 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f9884-64b6-4170-b8e3-b685528531b3 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:18.499447 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 490/972] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:02:18 2021] GET /identity/v3/projects/42d8c8692f4449f38699eb596233e6a8 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:18.507341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55689ec9-8b78-463f-8809-2b14f0e430b4 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:18.517220 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55689ec9-8b78-463f-8809-2b14f0e430b4 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:18.521875 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b35181-668f-43de-b7d4-d30f8371acec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:18.522600 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b35181-668f-43de-b7d4-d30f8371acec admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:18.522884 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b35181-668f-43de-b7d4-d30f8371acec admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:18.523160 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b35181-668f-43de-b7d4-d30f8371acec admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:18.524012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b35181-668f-43de-b7d4-d30f8371acec admin admin] RBAC: Adding query filter params (role.id=f28d3f93a0524078a592a15459808378, scope.project.id=42d8c8692f4449f38699eb596233e6a8, user.id=066d46fd3ea540a5afab903d46f73ccb) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:18.524326 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b35181-668f-43de-b7d4-d30f8371acec admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:18.526197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b35181-668f-43de-b7d4-d30f8371acec admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:18.532280 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 483/973] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:02:18 2021] GET /identity/v3/role_assignments?user.id=066d46fd3ea540a5afab903d46f73ccb&scope.project.id=42d8c8692f4449f38699eb596233e6a8&role.id=f28d3f93a0524078a592a15459808378 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:20.582607 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f44573-be13-4300-b06f-73cf7c234954 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:20.583231 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f44573-be13-4300-b06f-73cf7c234954 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:20.583231 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f44573-be13-4300-b06f-73cf7c234954 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:20.584932 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 491/974] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:20.590817 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437694a2-5926-44f6-b0b4-57f6b938f57e None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:20.591251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437694a2-5926-44f6-b0b4-57f6b938f57e None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:20.591370 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437694a2-5926-44f6-b0b4-57f6b938f57e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:20.610048 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-437694a2-5926-44f6-b0b4-57f6b938f57e None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:20.611282 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-437694a2-5926-44f6-b0b4-57f6b938f57e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:20.619236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 484/975] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:20 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:20.645068 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f44573-be13-4300-b06f-73cf7c234954 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:20.657088 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f44573-be13-4300-b06f-73cf7c234954 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:20.661373 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7f4a6-0d66-4c5c-b416-78b4882115c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:20.662204 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7f4a6-0d66-4c5c-b416-78b4882115c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:20.662483 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7f4a6-0d66-4c5c-b416-78b4882115c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:20.662758 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7f4a6-0d66-4c5c-b416-78b4882115c1 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:20.672584 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7f4a6-0d66-4c5c-b416-78b4882115c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:02:20.679748 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-eac7f4a6-0d66-4c5c-b416-78b4882115c1 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 29 16:02:20.680917 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 492/976] 10.222.0.41 () {56 vars in 1141 bytes} [Fri Oct 29 16:02:20 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:20.688035 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437694a2-5926-44f6-b0b4-57f6b938f57e None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:20.696863 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437694a2-5926-44f6-b0b4-57f6b938f57e None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:20.701751 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef873f17-8da3-4df1-898a-091b92271ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:20.702421 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef873f17-8da3-4df1-898a-091b92271ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:20.702702 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef873f17-8da3-4df1-898a-091b92271ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:20.703057 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef873f17-8da3-4df1-898a-091b92271ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:20.704446 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef873f17-8da3-4df1-898a-091b92271ca8 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:20.704770 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef873f17-8da3-4df1-898a-091b92271ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:20.706421 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef873f17-8da3-4df1-898a-091b92271ca8 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:20.714751 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 485/977] 10.222.0.41 () {56 vars in 1136 bytes} [Fri Oct 29 16:02:20 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:20.721078 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7f4a6-0d66-4c5c-b416-78b4882115c1 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:20.731107 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7f4a6-0d66-4c5c-b416-78b4882115c1 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:20.735579 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74685d5-361b-4f19-bc06-7ab9b3c0b0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:20.736343 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74685d5-361b-4f19-bc06-7ab9b3c0b0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:20.736625 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74685d5-361b-4f19-bc06-7ab9b3c0b0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:20.736899 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74685d5-361b-4f19-bc06-7ab9b3c0b0c0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:20.746818 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74685d5-361b-4f19-bc06-7ab9b3c0b0c0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:20.748706 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74685d5-361b-4f19-bc06-7ab9b3c0b0c0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:20.757028 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731a04f-87e0-40e1-96d5-eccb85fe2463 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:20.757318 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731a04f-87e0-40e1-96d5-eccb85fe2463 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:20.757587 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731a04f-87e0-40e1-96d5-eccb85fe2463 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:20.759382 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 486/978] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:02:20.765383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee562a24-44cf-4d33-8aad-96d012e9a55e None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:20.766265 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee562a24-44cf-4d33-8aad-96d012e9a55e None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:20.766544 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee562a24-44cf-4d33-8aad-96d012e9a55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:20.766987 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-a74685d5-361b-4f19-bc06-7ab9b3c0b0c0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:02:20.768384 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 493/979] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:02:20.781451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74685d5-361b-4f19-bc06-7ab9b3c0b0c0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:20.785020 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-ee562a24-44cf-4d33-8aad-96d012e9a55e None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:20.786260 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-ee562a24-44cf-4d33-8aad-96d012e9a55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:20.791123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74685d5-361b-4f19-bc06-7ab9b3c0b0c0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:20.794154 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 487/980] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:20 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:02:20.795723 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf9d12-9e21-4437-a3aa-34da9f605bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:20.796372 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf9d12-9e21-4437-a3aa-34da9f605bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:20.796654 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf9d12-9e21-4437-a3aa-34da9f605bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:20.796946 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaf9d12-9e21-4437-a3aa-34da9f605bf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:20.797763 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf9d12-9e21-4437-a3aa-34da9f605bf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:20.798108 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf9d12-9e21-4437-a3aa-34da9f605bf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:20.799698 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaf9d12-9e21-4437-a3aa-34da9f605bf2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:20.817185 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 494/981] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:02:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:20.818205 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee562a24-44cf-4d33-8aad-96d012e9a55e None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:20.818455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf9d12-9e21-4437-a3aa-34da9f605bf2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:20.827180 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee562a24-44cf-4d33-8aad-96d012e9a55e None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:20.827661 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaf9d12-9e21-4437-a3aa-34da9f605bf2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:20.832232 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230d5fd-0223-4ba3-a374-cd52a4fc9e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:20.832962 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eebee-93c0-4b68-bef0-1631e14d75d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:20.833111 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230d5fd-0223-4ba3-a374-cd52a4fc9e47 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:20.833250 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230d5fd-0223-4ba3-a374-cd52a4fc9e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:20.833517 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230d5fd-0223-4ba3-a374-cd52a4fc9e47 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:20.833667 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eebee-93c0-4b68-bef0-1631e14d75d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:20.833967 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eebee-93c0-4b68-bef0-1631e14d75d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:20.834239 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eebee-93c0-4b68-bef0-1631e14d75d2 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:20.841854 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73eebee-93c0-4b68-bef0-1631e14d75d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:20.843397 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e230d5fd-0223-4ba3-a374-cd52a4fc9e47 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:02:20.843883 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73eebee-93c0-4b68-bef0-1631e14d75d2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:20.850082 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-e230d5fd-0223-4ba3-a374-cd52a4fc9e47 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:02:20.851248 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 488/982] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:02:20 2021] GET /identity/v3/roles/admin => generated 83 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:20.856704 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-c73eebee-93c0-4b68-bef0-1631e14d75d2 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 29 16:02:20.857989 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 495/983] 10.222.0.41 () {56 vars in 1114 bytes} [Fri Oct 29 16:02:20 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:02:20.858103 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230d5fd-0223-4ba3-a374-cd52a4fc9e47 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:20.863953 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eebee-93c0-4b68-bef0-1631e14d75d2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:20.868057 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230d5fd-0223-4ba3-a374-cd52a4fc9e47 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:20.872482 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188451e-e20c-4bc0-945d-0dbb0d3155c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:20.873087 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eebee-93c0-4b68-bef0-1631e14d75d2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:20.873183 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188451e-e20c-4bc0-945d-0dbb0d3155c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:20.873365 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188451e-e20c-4bc0-945d-0dbb0d3155c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:20.873640 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b188451e-e20c-4bc0-945d-0dbb0d3155c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:20.874418 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188451e-e20c-4bc0-945d-0dbb0d3155c1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:20.874715 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188451e-e20c-4bc0-945d-0dbb0d3155c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:20.876778 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b188451e-e20c-4bc0-945d-0dbb0d3155c1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:20.878008 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb437dc-63e6-479e-a1c2-0f8c1174069e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:20.878638 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb437dc-63e6-479e-a1c2-0f8c1174069e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:20.878917 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb437dc-63e6-479e-a1c2-0f8c1174069e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:20.879190 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb437dc-63e6-479e-a1c2-0f8c1174069e admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:20.880023 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb437dc-63e6-479e-a1c2-0f8c1174069e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:20.880322 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb437dc-63e6-479e-a1c2-0f8c1174069e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:20.882166 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb437dc-63e6-479e-a1c2-0f8c1174069e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:20.884849 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 489/984] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:02:20 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:20.891684 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188451e-e20c-4bc0-945d-0dbb0d3155c1 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:20.906098 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 496/985] 10.222.0.41 () {56 vars in 1154 bytes} [Fri Oct 29 16:02:20 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:20.906293 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b188451e-e20c-4bc0-945d-0dbb0d3155c1 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:20.906293 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc5dc6-0f6c-480f-9f35-9d63a34915ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:20.906293 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc5dc6-0f6c-480f-9f35-9d63a34915ff admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:20.906549 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc5dc6-0f6c-480f-9f35-9d63a34915ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:20.906777 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cc5dc6-0f6c-480f-9f35-9d63a34915ff admin admin] PATH_INFO: `/v3/users/066d46fd3ea540a5afab903d46f73ccb` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:20.907115 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb437dc-63e6-479e-a1c2-0f8c1174069e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:20.907971 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc5dc6-0f6c-480f-9f35-9d63a34915ff admin admin] RBAC: Authorizing `identity:get_user(user_id=066d46fd3ea540a5afab903d46f73ccb)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:20.910087 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cc5dc6-0f6c-480f-9f35-9d63a34915ff admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:20.911798 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 490/986] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:02:20 2021] GET /identity/v3/users/066d46fd3ea540a5afab903d46f73ccb => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:20.916231 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb437dc-63e6-479e-a1c2-0f8c1174069e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:20.917775 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc5dc6-0f6c-480f-9f35-9d63a34915ff admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:20.920788 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00582d-6b1c-473a-bd05-bbc97c58a057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:20.921400 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00582d-6b1c-473a-bd05-bbc97c58a057 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:20.921700 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00582d-6b1c-473a-bd05-bbc97c58a057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:20.922000 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf00582d-6b1c-473a-bd05-bbc97c58a057 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:20.926925 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cc5dc6-0f6c-480f-9f35-9d63a34915ff admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:20.929570 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00582d-6b1c-473a-bd05-bbc97c58a057 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:20.931322 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf00582d-6b1c-473a-bd05-bbc97c58a057 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:20.931423 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5db83e-efc6-438d-b333-5b1e35d0eadc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:20.932172 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5db83e-efc6-438d-b333-5b1e35d0eadc admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:20.932453 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5db83e-efc6-438d-b333-5b1e35d0eadc admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:20.932725 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5db83e-efc6-438d-b333-5b1e35d0eadc admin admin] PATH_INFO: `/v3/projects/42d8c8692f4449f38699eb596233e6a8` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:20.933893 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5db83e-efc6-438d-b333-5b1e35d0eadc admin admin] RBAC: Authorizing `identity:get_project(project_id=42d8c8692f4449f38699eb596233e6a8)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:20.935921 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5db83e-efc6-438d-b333-5b1e35d0eadc admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:20.938257 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 491/987] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:02:20 2021] GET /identity/v3/projects/42d8c8692f4449f38699eb596233e6a8 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:20.945397 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 497/988] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:02:20 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:02:20.945546 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5db83e-efc6-438d-b333-5b1e35d0eadc admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:20.946741 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00582d-6b1c-473a-bd05-bbc97c58a057 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:20.954830 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5db83e-efc6-438d-b333-5b1e35d0eadc admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:20.955754 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf00582d-6b1c-473a-bd05-bbc97c58a057 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:20.959344 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d16c6f-607d-412c-b528-defcb9ef2ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:20.960185 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d16c6f-607d-412c-b528-defcb9ef2ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:20.960286 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abbb85-1b46-4fbc-bae4-d73b2a32b069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:20.960469 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d16c6f-607d-412c-b528-defcb9ef2ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:20.960747 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d16c6f-607d-412c-b528-defcb9ef2ce0 admin admin] PATH_INFO: `/v3/projects/42d8c8692f4449f38699eb596233e6a8/users/066d46fd3ea540a5afab903d46f73ccb/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:20.960954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abbb85-1b46-4fbc-bae4-d73b2a32b069 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:20.961235 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abbb85-1b46-4fbc-bae4-d73b2a32b069 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:20.961508 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9abbb85-1b46-4fbc-bae4-d73b2a32b069 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:20.962718 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d16c6f-607d-412c-b528-defcb9ef2ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d8c8692f4449f38699eb596233e6a8, user_id=066d46fd3ea540a5afab903d46f73ccb, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:20.965343 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d16c6f-607d-412c-b528-defcb9ef2ce0 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:20.971578 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abbb85-1b46-4fbc-bae4-d73b2a32b069 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:20.974109 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9abbb85-1b46-4fbc-bae4-d73b2a32b069 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:20.978825 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 492/989] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:02:20 2021] PUT /identity/v3/projects/42d8c8692f4449f38699eb596233e6a8/users/066d46fd3ea540a5afab903d46f73ccb/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:02:20.991905 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-b9abbb85-1b46-4fbc-bae4-d73b2a32b069 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:02:20.993178 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 498/990] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:20 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:02:21.000703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d16c6f-607d-412c-b528-defcb9ef2ce0 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:21.063963 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d16c6f-607d-412c-b528-defcb9ef2ce0 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:21.068728 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d499b8-5aca-4972-ba37-d70f99b0f172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:21.069410 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d499b8-5aca-4972-ba37-d70f99b0f172 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:21.069693 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d499b8-5aca-4972-ba37-d70f99b0f172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:21.069996 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d499b8-5aca-4972-ba37-d70f99b0f172 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:21.070783 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d499b8-5aca-4972-ba37-d70f99b0f172 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:21.071309 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d499b8-5aca-4972-ba37-d70f99b0f172 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:21.072697 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d499b8-5aca-4972-ba37-d70f99b0f172 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:21.085276 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 493/991] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:02:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:21.091689 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abbb85-1b46-4fbc-bae4-d73b2a32b069 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:21.102569 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9abbb85-1b46-4fbc-bae4-d73b2a32b069 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:21.107361 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d20f95-c565-4143-9066-00b647547485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:21.108281 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d20f95-c565-4143-9066-00b647547485 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:21.108628 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d20f95-c565-4143-9066-00b647547485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:21.108964 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d20f95-c565-4143-9066-00b647547485 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:21.117014 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d20f95-c565-4143-9066-00b647547485 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:21.119143 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d20f95-c565-4143-9066-00b647547485 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:21.133602 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-20d20f95-c565-4143-9066-00b647547485 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:02:21.135110 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 499/992] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:02:21 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:02:21.141836 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d499b8-5aca-4972-ba37-d70f99b0f172 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:21.151883 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d499b8-5aca-4972-ba37-d70f99b0f172 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:21.156594 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64385ef-edbb-4218-98a1-5721f7a388b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:21.157336 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64385ef-edbb-4218-98a1-5721f7a388b1 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:21.157622 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64385ef-edbb-4218-98a1-5721f7a388b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:21.157895 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64385ef-edbb-4218-98a1-5721f7a388b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:21.158736 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64385ef-edbb-4218-98a1-5721f7a388b1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:21.159045 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64385ef-edbb-4218-98a1-5721f7a388b1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:21.160926 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64385ef-edbb-4218-98a1-5721f7a388b1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:21.175223 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 494/993] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:02:21 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:21.181866 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d20f95-c565-4143-9066-00b647547485 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:21.194547 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d20f95-c565-4143-9066-00b647547485 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:21.199051 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ca46c-444c-4a29-b181-c5f7c42be79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:21.199683 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ca46c-444c-4a29-b181-c5f7c42be79b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:21.199960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ca46c-444c-4a29-b181-c5f7c42be79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:21.200229 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ca46c-444c-4a29-b181-c5f7c42be79b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:21.201325 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ca46c-444c-4a29-b181-c5f7c42be79b admin admin] RBAC: Adding query filter params (role.id=d76fb315cd8e43268d4d620325a554ef, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=4f13d0e9f79a433c81759ecd819a6dfa) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:21.201625 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ca46c-444c-4a29-b181-c5f7c42be79b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:21.203500 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ca46c-444c-4a29-b181-c5f7c42be79b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:21.209567 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 500/994] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:02:21 2021] GET /identity/v3/role_assignments?user.id=4f13d0e9f79a433c81759ecd819a6dfa&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=d76fb315cd8e43268d4d620325a554ef => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:23.206346 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d949ca-dc31-408d-b8e0-5e98ddc2b9c7 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:23.206975 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d949ca-dc31-408d-b8e0-5e98ddc2b9c7 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:23.206975 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d949ca-dc31-408d-b8e0-5e98ddc2b9c7 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:23.208649 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 495/995] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:23.214515 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465899c2-aaad-4ed5-910e-53d17353f82b None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:23.214897 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465899c2-aaad-4ed5-910e-53d17353f82b None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:23.215064 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465899c2-aaad-4ed5-910e-53d17353f82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:23.232976 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-465899c2-aaad-4ed5-910e-53d17353f82b None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:23.234781 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-465899c2-aaad-4ed5-910e-53d17353f82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:23.242305 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 501/996] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:23 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:23.266612 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d949ca-dc31-408d-b8e0-5e98ddc2b9c7 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:23.278413 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d949ca-dc31-408d-b8e0-5e98ddc2b9c7 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:23.283287 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255483e-1c17-48b5-a5e7-2260be1393ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:23.284041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255483e-1c17-48b5-a5e7-2260be1393ee admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:23.284322 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255483e-1c17-48b5-a5e7-2260be1393ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:23.284598 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255483e-1c17-48b5-a5e7-2260be1393ee admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:23.294454 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255483e-1c17-48b5-a5e7-2260be1393ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:02:23.301190 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-f255483e-1c17-48b5-a5e7-2260be1393ee admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:02:23.302354 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 496/997] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:02:23 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:23.308955 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465899c2-aaad-4ed5-910e-53d17353f82b None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:23.317799 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465899c2-aaad-4ed5-910e-53d17353f82b None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:23.322312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d1b92-c8e0-43a5-8c8e-249688b4e910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:23.322962 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d1b92-c8e0-43a5-8c8e-249688b4e910 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:23.323247 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d1b92-c8e0-43a5-8c8e-249688b4e910 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:23.323523 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d1b92-c8e0-43a5-8c8e-249688b4e910 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:23.324285 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d1b92-c8e0-43a5-8c8e-249688b4e910 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:23.324593 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d1b92-c8e0-43a5-8c8e-249688b4e910 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:23.326492 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d1b92-c8e0-43a5-8c8e-249688b4e910 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:23.335409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 502/998] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:02:23 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:23.341519 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255483e-1c17-48b5-a5e7-2260be1393ee admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:23.352108 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255483e-1c17-48b5-a5e7-2260be1393ee admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:23.356533 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecfd74-ec18-4b8a-8407-01992ef23210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:23.357352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecfd74-ec18-4b8a-8407-01992ef23210 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:23.357633 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecfd74-ec18-4b8a-8407-01992ef23210 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:23.357899 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdecfd74-ec18-4b8a-8407-01992ef23210 admin admin] PATH_INFO: `/v3/users/066d46fd3ea540a5afab903d46f73ccb` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:23.359162 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdecfd74-ec18-4b8a-8407-01992ef23210 admin admin] RBAC: Authorizing `identity:get_user(user_id=066d46fd3ea540a5afab903d46f73ccb)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:23.361264 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdecfd74-ec18-4b8a-8407-01992ef23210 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:23.362833 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 497/999] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:02:23 2021] GET /identity/v3/users/066d46fd3ea540a5afab903d46f73ccb => generated 285 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:23.368985 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d1b92-c8e0-43a5-8c8e-249688b4e910 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:23.378294 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d1b92-c8e0-43a5-8c8e-249688b4e910 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:23.382749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5381b4f-38d9-4035-a4c3-90c8250621fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:23.383370 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5381b4f-38d9-4035-a4c3-90c8250621fc admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:23.383653 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5381b4f-38d9-4035-a4c3-90c8250621fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:23.383927 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5381b4f-38d9-4035-a4c3-90c8250621fc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:23.392260 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5381b4f-38d9-4035-a4c3-90c8250621fc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:23.393889 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5381b4f-38d9-4035-a4c3-90c8250621fc admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:23.402856 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 503/1000] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:02:23 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:02:23.410151 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecfd74-ec18-4b8a-8407-01992ef23210 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:23.419439 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdecfd74-ec18-4b8a-8407-01992ef23210 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:23.423796 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67c0760-a0ff-4c19-842b-2136141548ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:23.424604 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c0760-a0ff-4c19-842b-2136141548ca admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:23.424879 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c0760-a0ff-4c19-842b-2136141548ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:23.425148 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67c0760-a0ff-4c19-842b-2136141548ca admin admin] PATH_INFO: `/v3/projects/42d8c8692f4449f38699eb596233e6a8` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:23.426338 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c0760-a0ff-4c19-842b-2136141548ca admin admin] RBAC: Authorizing `identity:get_project(project_id=42d8c8692f4449f38699eb596233e6a8)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:23.428328 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67c0760-a0ff-4c19-842b-2136141548ca admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:23.429930 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 498/1001] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:02:23 2021] GET /identity/v3/projects/42d8c8692f4449f38699eb596233e6a8 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:23.436160 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5381b4f-38d9-4035-a4c3-90c8250621fc admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:23.444634 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5381b4f-38d9-4035-a4c3-90c8250621fc admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:23.449126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b574350-eea0-4fc9-96d8-87dfeade8e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:23.449745 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b574350-eea0-4fc9-96d8-87dfeade8e17 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:23.450062 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b574350-eea0-4fc9-96d8-87dfeade8e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:23.450335 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b574350-eea0-4fc9-96d8-87dfeade8e17 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:23.451421 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b574350-eea0-4fc9-96d8-87dfeade8e17 admin admin] RBAC: Adding query filter params (role.id=f28d3f93a0524078a592a15459808378, scope.project.id=42d8c8692f4449f38699eb596233e6a8, user.id=066d46fd3ea540a5afab903d46f73ccb) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:23.451725 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b574350-eea0-4fc9-96d8-87dfeade8e17 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:23.454047 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b574350-eea0-4fc9-96d8-87dfeade8e17 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:23.459605 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 504/1002] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:02:23 2021] GET /identity/v3/role_assignments?user.id=066d46fd3ea540a5afab903d46f73ccb&scope.project.id=42d8c8692f4449f38699eb596233e6a8&role.id=f28d3f93a0524078a592a15459808378 => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:25.705073 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a03c4-cddf-4769-a82f-2593b523f1fc None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:25.705647 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a03c4-cddf-4769-a82f-2593b523f1fc None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:25.705647 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a03c4-cddf-4769-a82f-2593b523f1fc None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:25.707435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 499/1003] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:25.714195 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36365c-852f-4911-93a2-4421f9b28317 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:25.714680 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36365c-852f-4911-93a2-4421f9b28317 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:25.714876 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36365c-852f-4911-93a2-4421f9b28317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:25.733037 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-aa36365c-852f-4911-93a2-4421f9b28317 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:25.734785 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-aa36365c-852f-4911-93a2-4421f9b28317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:25.742781 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 505/1004] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:25 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:25.768819 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a03c4-cddf-4769-a82f-2593b523f1fc None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:25.781262 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a03c4-cddf-4769-a82f-2593b523f1fc None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:25.787512 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41efffc-322f-4343-abe8-ae285f8a60c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:25.788315 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41efffc-322f-4343-abe8-ae285f8a60c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:25.788595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41efffc-322f-4343-abe8-ae285f8a60c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:25.788868 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41efffc-322f-4343-abe8-ae285f8a60c6 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:25.790087 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41efffc-322f-4343-abe8-ae285f8a60c6 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:25.791765 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41efffc-322f-4343-abe8-ae285f8a60c6 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:25.793341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 500/1005] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:25 2021] GET /identity/v3/domains/default => generated 199 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:25.800312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36365c-852f-4911-93a2-4421f9b28317 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:25.809599 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36365c-852f-4911-93a2-4421f9b28317 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:25.814727 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc4c90-eb7a-4bc3-a451-636b26eac01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:25.815393 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc4c90-eb7a-4bc3-a451-636b26eac01a admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:25.815673 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc4c90-eb7a-4bc3-a451-636b26eac01a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:25.815954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc4c90-eb7a-4bc3-a451-636b26eac01a admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:25.816686 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc4c90-eb7a-4bc3-a451-636b26eac01a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:25.818639 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc4c90-eb7a-4bc3-a451-636b26eac01a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:25.838954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 506/1006] 10.222.0.41 () {60 vars in 1153 bytes} [Fri Oct 29 16:02:25 2021] POST /identity/v3/users => generated 286 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:02:28.189357 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd4e3b-4936-48f4-8522-bce2400c1601 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:28.189891 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd4e3b-4936-48f4-8522-bce2400c1601 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:28.189891 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd4e3b-4936-48f4-8522-bce2400c1601 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:28.191699 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 501/1007] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:28.197845 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450121f4-4a2c-4c04-b123-cd1b0d06cc60 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:28.198331 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450121f4-4a2c-4c04-b123-cd1b0d06cc60 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:28.198427 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450121f4-4a2c-4c04-b123-cd1b0d06cc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:28.217110 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-450121f4-4a2c-4c04-b123-cd1b0d06cc60 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:28.218337 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-450121f4-4a2c-4c04-b123-cd1b0d06cc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:28.225899 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 507/1008] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:28 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:02:28.250738 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd4e3b-4936-48f4-8522-bce2400c1601 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:28.263198 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd4e3b-4936-48f4-8522-bce2400c1601 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:28.268198 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f8223-1736-4442-8144-f6f648f19d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:28.269036 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f8223-1736-4442-8144-f6f648f19d84 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:28.269316 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f8223-1736-4442-8144-f6f648f19d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:28.269587 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f8223-1736-4442-8144-f6f648f19d84 admin admin] PATH_INFO: `/v3/roles/8eba80d4381a47ffb74df6e1f9dda34a` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:28.271126 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f8223-1736-4442-8144-f6f648f19d84 admin admin] RBAC: Authorizing `identity:get_role(role_id=8eba80d4381a47ffb74df6e1f9dda34a)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:28.272126 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING py.warnings [None req-ac2f8223-1736-4442-8144-f6f648f19d84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:02:28.272126 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: warnings.warn(msg) Oct 29 16:02:28.272126 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: Oct 29 16:02:28.273007 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f8223-1736-4442-8144-f6f648f19d84 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:28.274423 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 502/1009] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:02:28 2021] GET /identity/v3/roles/8eba80d4381a47ffb74df6e1f9dda34a => generated 223 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:28.280994 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450121f4-4a2c-4c04-b123-cd1b0d06cc60 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:28.289902 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450121f4-4a2c-4c04-b123-cd1b0d06cc60 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:28.294357 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d72ec-2543-4f34-a84a-66c485235108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:28.295211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d72ec-2543-4f34-a84a-66c485235108 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:28.295486 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d72ec-2543-4f34-a84a-66c485235108 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:28.295756 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105d72ec-2543-4f34-a84a-66c485235108 admin admin] PATH_INFO: `/v3/users/243e54fa940a4a2bbec212da98f05f19` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:28.309745 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d72ec-2543-4f34-a84a-66c485235108 admin admin] RBAC: Authorizing `identity:get_user(user_id=243e54fa940a4a2bbec212da98f05f19)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:28.311946 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105d72ec-2543-4f34-a84a-66c485235108 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:28.314241 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 508/1010] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:02:28 2021] GET /identity/v3/users/243e54fa940a4a2bbec212da98f05f19 => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:28.320780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f8223-1736-4442-8144-f6f648f19d84 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:28.331480 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f8223-1736-4442-8144-f6f648f19d84 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:28.336068 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804cfa0-975b-4b7c-ac78-5f4f7daacea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:28.336716 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804cfa0-975b-4b7c-ac78-5f4f7daacea4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:28.336994 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804cfa0-975b-4b7c-ac78-5f4f7daacea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:28.337269 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4804cfa0-975b-4b7c-ac78-5f4f7daacea4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:28.345857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804cfa0-975b-4b7c-ac78-5f4f7daacea4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:28.347636 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4804cfa0-975b-4b7c-ac78-5f4f7daacea4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:28.356484 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 503/1011] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:02:28 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:02:28.363411 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d72ec-2543-4f34-a84a-66c485235108 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:28.373259 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105d72ec-2543-4f34-a84a-66c485235108 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:28.378420 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76644bfe-76af-47e5-b3ac-713751f684c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:28.379274 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76644bfe-76af-47e5-b3ac-713751f684c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:28.379559 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76644bfe-76af-47e5-b3ac-713751f684c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:28.379839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76644bfe-76af-47e5-b3ac-713751f684c8 admin admin] PATH_INFO: `/v3/projects/42d8c8692f4449f38699eb596233e6a8` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:28.381015 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76644bfe-76af-47e5-b3ac-713751f684c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=42d8c8692f4449f38699eb596233e6a8)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:28.383133 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76644bfe-76af-47e5-b3ac-713751f684c8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:28.384812 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 509/1012] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:02:28 2021] GET /identity/v3/projects/42d8c8692f4449f38699eb596233e6a8 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:28.392292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804cfa0-975b-4b7c-ac78-5f4f7daacea4 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:28.401150 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4804cfa0-975b-4b7c-ac78-5f4f7daacea4 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:28.405655 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1567ad-2d1b-4368-8cdf-1a872bc9ee29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:28.406382 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1567ad-2d1b-4368-8cdf-1a872bc9ee29 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:28.406664 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1567ad-2d1b-4368-8cdf-1a872bc9ee29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:28.406937 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1567ad-2d1b-4368-8cdf-1a872bc9ee29 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:28.407774 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1567ad-2d1b-4368-8cdf-1a872bc9ee29 admin admin] RBAC: Adding query filter params (role.id=8eba80d4381a47ffb74df6e1f9dda34a, scope.project.id=42d8c8692f4449f38699eb596233e6a8, user.id=243e54fa940a4a2bbec212da98f05f19) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:28.408082 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1567ad-2d1b-4368-8cdf-1a872bc9ee29 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:28.410001 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1567ad-2d1b-4368-8cdf-1a872bc9ee29 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:28.415735 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 504/1013] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:02:28 2021] GET /identity/v3/role_assignments?user.id=243e54fa940a4a2bbec212da98f05f19&scope.project.id=42d8c8692f4449f38699eb596233e6a8&role.id=8eba80d4381a47ffb74df6e1f9dda34a => generated 259 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:30.678343 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c51fbe-4355-4238-a5c0-5619dc383699 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:30.678879 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c51fbe-4355-4238-a5c0-5619dc383699 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:30.678879 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c51fbe-4355-4238-a5c0-5619dc383699 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:30.680643 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 510/1014] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:30.686719 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed29c7-4aa9-401a-b7dd-1e1050ec78f9 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:30.687174 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed29c7-4aa9-401a-b7dd-1e1050ec78f9 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:30.687265 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed29c7-4aa9-401a-b7dd-1e1050ec78f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:30.704716 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-57ed29c7-4aa9-401a-b7dd-1e1050ec78f9 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:30.705897 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-57ed29c7-4aa9-401a-b7dd-1e1050ec78f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:30.713483 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 505/1015] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:30 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:02:30.738979 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c51fbe-4355-4238-a5c0-5619dc383699 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:30.751165 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c51fbe-4355-4238-a5c0-5619dc383699 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:30.755946 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2545d-56a3-4bf5-9c4a-a52e2a23b4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:30.756773 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2545d-56a3-4bf5-9c4a-a52e2a23b4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:30.757055 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2545d-56a3-4bf5-9c4a-a52e2a23b4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:30.757330 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2545d-56a3-4bf5-9c4a-a52e2a23b4e5 admin admin] PATH_INFO: `/v3/roles/8eba80d4381a47ffb74df6e1f9dda34a` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:30.758809 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2545d-56a3-4bf5-9c4a-a52e2a23b4e5 admin admin] RBAC: Authorizing `identity:get_role(role_id=8eba80d4381a47ffb74df6e1f9dda34a)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:30.759827 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING py.warnings [None req-40a2545d-56a3-4bf5-9c4a-a52e2a23b4e5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:02:30.759827 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: warnings.warn(msg) Oct 29 16:02:30.759827 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: Oct 29 16:02:30.760715 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a2545d-56a3-4bf5-9c4a-a52e2a23b4e5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:30.762201 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 511/1016] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:02:30 2021] GET /identity/v3/roles/8eba80d4381a47ffb74df6e1f9dda34a => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:30.769202 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed29c7-4aa9-401a-b7dd-1e1050ec78f9 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:30.778188 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed29c7-4aa9-401a-b7dd-1e1050ec78f9 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:30.783390 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b635ca-4cc7-4f38-8a21-88c1d843dc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:30.784232 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b635ca-4cc7-4f38-8a21-88c1d843dc36 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:30.784511 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b635ca-4cc7-4f38-8a21-88c1d843dc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:30.784784 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b635ca-4cc7-4f38-8a21-88c1d843dc36 admin admin] PATH_INFO: `/v3/users/243e54fa940a4a2bbec212da98f05f19` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:30.786008 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b635ca-4cc7-4f38-8a21-88c1d843dc36 admin admin] RBAC: Authorizing `identity:get_user(user_id=243e54fa940a4a2bbec212da98f05f19)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:30.788128 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b635ca-4cc7-4f38-8a21-88c1d843dc36 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:30.789705 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 506/1017] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:02:30 2021] GET /identity/v3/users/243e54fa940a4a2bbec212da98f05f19 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:30.796027 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2545d-56a3-4bf5-9c4a-a52e2a23b4e5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:30.806402 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a2545d-56a3-4bf5-9c4a-a52e2a23b4e5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:30.810789 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12a72b-112c-4201-9a1c-8598ab84a7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:30.811620 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12a72b-112c-4201-9a1c-8598ab84a7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:30.811921 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12a72b-112c-4201-9a1c-8598ab84a7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:30.812172 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12a72b-112c-4201-9a1c-8598ab84a7b7 admin admin] PATH_INFO: `/v3/projects/42d8c8692f4449f38699eb596233e6a8` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:30.813359 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12a72b-112c-4201-9a1c-8598ab84a7b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=42d8c8692f4449f38699eb596233e6a8)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:30.815405 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12a72b-112c-4201-9a1c-8598ab84a7b7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:30.817193 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 512/1018] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:02:30 2021] GET /identity/v3/projects/42d8c8692f4449f38699eb596233e6a8 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:30.823593 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b635ca-4cc7-4f38-8a21-88c1d843dc36 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:30.833807 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b635ca-4cc7-4f38-8a21-88c1d843dc36 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:30.838330 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90e354-0441-4a26-a57a-c196c2b99315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:30.839183 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90e354-0441-4a26-a57a-c196c2b99315 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:30.839463 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90e354-0441-4a26-a57a-c196c2b99315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:30.839741 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90e354-0441-4a26-a57a-c196c2b99315 admin admin] PATH_INFO: `/v3/projects/42d8c8692f4449f38699eb596233e6a8/users/243e54fa940a4a2bbec212da98f05f19/roles/8eba80d4381a47ffb74df6e1f9dda34a` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:30.842102 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90e354-0441-4a26-a57a-c196c2b99315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d8c8692f4449f38699eb596233e6a8, user_id=243e54fa940a4a2bbec212da98f05f19, role_id=8eba80d4381a47ffb74df6e1f9dda34a)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:30.845319 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90e354-0441-4a26-a57a-c196c2b99315 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:30.857730 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 507/1019] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:02:30 2021] PUT /identity/v3/projects/42d8c8692f4449f38699eb596233e6a8/users/243e54fa940a4a2bbec212da98f05f19/roles/8eba80d4381a47ffb74df6e1f9dda34a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:02:33.090039 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0e0e4-c13e-40ba-aae0-af7580e5b872 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:33.090619 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0e0e4-c13e-40ba-aae0-af7580e5b872 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:33.090619 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c0e0e4-c13e-40ba-aae0-af7580e5b872 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:33.092378 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 513/1020] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:33.098457 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0688fe-fedc-4f0d-b110-2f81f5acda53 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:33.098963 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0688fe-fedc-4f0d-b110-2f81f5acda53 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:33.099061 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0688fe-fedc-4f0d-b110-2f81f5acda53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:33.116905 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-8b0688fe-fedc-4f0d-b110-2f81f5acda53 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:33.118144 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8b0688fe-fedc-4f0d-b110-2f81f5acda53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:33.176515 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 508/1021] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:33 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:02:33.202540 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0e0e4-c13e-40ba-aae0-af7580e5b872 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:33.214879 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c0e0e4-c13e-40ba-aae0-af7580e5b872 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:33.219507 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c450340-f32d-4cb6-ab3e-fd2e51b9bada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:33.220349 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c450340-f32d-4cb6-ab3e-fd2e51b9bada admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:33.220629 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c450340-f32d-4cb6-ab3e-fd2e51b9bada admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:33.220902 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c450340-f32d-4cb6-ab3e-fd2e51b9bada admin admin] PATH_INFO: `/v3/roles/8eba80d4381a47ffb74df6e1f9dda34a` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:33.222470 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c450340-f32d-4cb6-ab3e-fd2e51b9bada admin admin] RBAC: Authorizing `identity:get_role(role_id=8eba80d4381a47ffb74df6e1f9dda34a)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:33.224072 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c450340-f32d-4cb6-ab3e-fd2e51b9bada admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:33.225446 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 514/1022] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:02:33 2021] GET /identity/v3/roles/8eba80d4381a47ffb74df6e1f9dda34a => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:33.232345 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0688fe-fedc-4f0d-b110-2f81f5acda53 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:33.242725 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0688fe-fedc-4f0d-b110-2f81f5acda53 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:33.247259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0446eb6-c397-40ad-ad09-bcbfa60d60c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:33.248111 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0446eb6-c397-40ad-ad09-bcbfa60d60c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:33.248382 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0446eb6-c397-40ad-ad09-bcbfa60d60c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:33.248652 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0446eb6-c397-40ad-ad09-bcbfa60d60c7 admin admin] PATH_INFO: `/v3/users/243e54fa940a4a2bbec212da98f05f19` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:33.250516 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0446eb6-c397-40ad-ad09-bcbfa60d60c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=243e54fa940a4a2bbec212da98f05f19)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:33.252622 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0446eb6-c397-40ad-ad09-bcbfa60d60c7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:33.254261 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 509/1023] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:02:33 2021] GET /identity/v3/users/243e54fa940a4a2bbec212da98f05f19 => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:33.260609 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c450340-f32d-4cb6-ab3e-fd2e51b9bada admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:33.270553 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c450340-f32d-4cb6-ab3e-fd2e51b9bada admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:33.275098 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee21a46-772d-45db-87f9-8a5523c04027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:33.275745 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee21a46-772d-45db-87f9-8a5523c04027 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:33.276024 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee21a46-772d-45db-87f9-8a5523c04027 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:33.276298 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee21a46-772d-45db-87f9-8a5523c04027 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:33.284749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee21a46-772d-45db-87f9-8a5523c04027 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:33.286548 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee21a46-772d-45db-87f9-8a5523c04027 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:33.295718 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 515/1024] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:02:33 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:02:33.302971 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0446eb6-c397-40ad-ad09-bcbfa60d60c7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:33.313871 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0446eb6-c397-40ad-ad09-bcbfa60d60c7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:33.318466 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ce8d9-48be-4288-824a-97eeb2be8d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:33.319296 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ce8d9-48be-4288-824a-97eeb2be8d7b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:33.319567 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ce8d9-48be-4288-824a-97eeb2be8d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:33.319840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ce8d9-48be-4288-824a-97eeb2be8d7b admin admin] PATH_INFO: `/v3/projects/42d8c8692f4449f38699eb596233e6a8` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:33.321081 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ce8d9-48be-4288-824a-97eeb2be8d7b admin admin] RBAC: Authorizing `identity:get_project(project_id=42d8c8692f4449f38699eb596233e6a8)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:33.323114 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ce8d9-48be-4288-824a-97eeb2be8d7b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:33.324745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 510/1025] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:02:33 2021] GET /identity/v3/projects/42d8c8692f4449f38699eb596233e6a8 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:33.331770 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee21a46-772d-45db-87f9-8a5523c04027 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:33.340670 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee21a46-772d-45db-87f9-8a5523c04027 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:33.345231 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a98b20-7e04-4231-9e63-c340e3cb53e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:33.345863 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a98b20-7e04-4231-9e63-c340e3cb53e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:33.346180 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a98b20-7e04-4231-9e63-c340e3cb53e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:33.346455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a98b20-7e04-4231-9e63-c340e3cb53e6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:33.347294 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a98b20-7e04-4231-9e63-c340e3cb53e6 admin admin] RBAC: Adding query filter params (role.id=8eba80d4381a47ffb74df6e1f9dda34a, scope.project.id=42d8c8692f4449f38699eb596233e6a8, user.id=243e54fa940a4a2bbec212da98f05f19) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:33.347605 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a98b20-7e04-4231-9e63-c340e3cb53e6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:33.349451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a98b20-7e04-4231-9e63-c340e3cb53e6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:33.355585 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 516/1026] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:02:33 2021] GET /identity/v3/role_assignments?user.id=243e54fa940a4a2bbec212da98f05f19&scope.project.id=42d8c8692f4449f38699eb596233e6a8&role.id=8eba80d4381a47ffb74df6e1f9dda34a => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:35.631198 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd463bc-c93f-4889-b58c-14513d18fc60 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:35.631744 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd463bc-c93f-4889-b58c-14513d18fc60 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:35.631744 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd463bc-c93f-4889-b58c-14513d18fc60 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:35.633506 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 511/1027] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:35.639462 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dafe1a-8f57-43bb-8d9a-c8f2788678a1 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:35.639868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dafe1a-8f57-43bb-8d9a-c8f2788678a1 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:35.640093 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dafe1a-8f57-43bb-8d9a-c8f2788678a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:35.658437 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-16dafe1a-8f57-43bb-8d9a-c8f2788678a1 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:35.659612 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-16dafe1a-8f57-43bb-8d9a-c8f2788678a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:35.667150 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 517/1028] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:35 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:02:35.692147 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd463bc-c93f-4889-b58c-14513d18fc60 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:35.704375 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd463bc-c93f-4889-b58c-14513d18fc60 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:35.709186 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b5def-8906-49e8-b12a-48bfa0af607a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:35.709971 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b5def-8906-49e8-b12a-48bfa0af607a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:35.710260 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b5def-8906-49e8-b12a-48bfa0af607a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:35.710539 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b5def-8906-49e8-b12a-48bfa0af607a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:35.711716 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b5def-8906-49e8-b12a-48bfa0af607a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:35.713391 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b5def-8906-49e8-b12a-48bfa0af607a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:35.714990 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 512/1029] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:35 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:35.721761 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dafe1a-8f57-43bb-8d9a-c8f2788678a1 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:35.730485 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dafe1a-8f57-43bb-8d9a-c8f2788678a1 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:35.735530 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490b0b4-2ef6-4d13-addc-16a4bc7f26a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:35.736166 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490b0b4-2ef6-4d13-addc-16a4bc7f26a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:35.736445 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490b0b4-2ef6-4d13-addc-16a4bc7f26a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:35.736712 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490b0b4-2ef6-4d13-addc-16a4bc7f26a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:35.737422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490b0b4-2ef6-4d13-addc-16a4bc7f26a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:35.739314 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3490b0b4-2ef6-4d13-addc-16a4bc7f26a1 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:35.763678 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 518/1030] 10.222.0.41 () {60 vars in 1162 bytes} [Fri Oct 29 16:02:35 2021] POST /identity/v3/projects => generated 311 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:02:38.030071 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010fb68-efa2-4833-8e3e-65ffac20d154 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:38.030585 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010fb68-efa2-4833-8e3e-65ffac20d154 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:38.030585 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f010fb68-efa2-4833-8e3e-65ffac20d154 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:38.032354 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 513/1031] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:38.038286 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f788520-f4e7-42c9-bbca-92af0342f2b1 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:38.038716 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f788520-f4e7-42c9-bbca-92af0342f2b1 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:38.038817 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f788520-f4e7-42c9-bbca-92af0342f2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:38.055838 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-9f788520-f4e7-42c9-bbca-92af0342f2b1 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:38.057000 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-9f788520-f4e7-42c9-bbca-92af0342f2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:38.111482 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 519/1032] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:38 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:38.137045 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010fb68-efa2-4833-8e3e-65ffac20d154 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:38.149481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f010fb68-efa2-4833-8e3e-65ffac20d154 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:38.153754 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def21a9-fe77-4593-a2e8-5a55bb2ae3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:38.154627 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def21a9-fe77-4593-a2e8-5a55bb2ae3bb admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:38.155995 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def21a9-fe77-4593-a2e8-5a55bb2ae3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:38.155995 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def21a9-fe77-4593-a2e8-5a55bb2ae3bb admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:38.156267 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def21a9-fe77-4593-a2e8-5a55bb2ae3bb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:38.157938 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def21a9-fe77-4593-a2e8-5a55bb2ae3bb admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:38.159500 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 514/1033] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:02:38 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:38.165821 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f788520-f4e7-42c9-bbca-92af0342f2b1 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:38.175016 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f788520-f4e7-42c9-bbca-92af0342f2b1 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:38.180326 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a0bb2-4274-4b0a-96a5-c7cc3d8cb59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:38.180978 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a0bb2-4274-4b0a-96a5-c7cc3d8cb59c admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:38.181253 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a0bb2-4274-4b0a-96a5-c7cc3d8cb59c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:38.181558 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a0bb2-4274-4b0a-96a5-c7cc3d8cb59c admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:38.182310 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a0bb2-4274-4b0a-96a5-c7cc3d8cb59c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:38.184205 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a0bb2-4274-4b0a-96a5-c7cc3d8cb59c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:38.205408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 520/1034] 10.222.0.41 () {60 vars in 1153 bytes} [Fri Oct 29 16:02:38 2021] POST /identity/v3/users => generated 286 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:02:40.557153 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996f7c4-5d6e-4217-ac06-9eff91dfaceb None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:40.557743 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996f7c4-5d6e-4217-ac06-9eff91dfaceb None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:40.557743 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996f7c4-5d6e-4217-ac06-9eff91dfaceb None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:40.559529 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 515/1035] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:40.566211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b7c05-0b88-4dd6-a838-631cb9413018 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:40.566647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b7c05-0b88-4dd6-a838-631cb9413018 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:40.566750 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b7c05-0b88-4dd6-a838-631cb9413018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:40.584196 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-5c6b7c05-0b88-4dd6-a838-631cb9413018 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:40.585384 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-5c6b7c05-0b88-4dd6-a838-631cb9413018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:40.593000 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 521/1036] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:40 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:40.617835 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996f7c4-5d6e-4217-ac06-9eff91dfaceb None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:40.630431 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7996f7c4-5d6e-4217-ac06-9eff91dfaceb None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:40.634698 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8387a-e236-46cd-bd62-aadae154b064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:40.635460 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8387a-e236-46cd-bd62-aadae154b064 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:40.635737 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8387a-e236-46cd-bd62-aadae154b064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:40.636010 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a8387a-e236-46cd-bd62-aadae154b064 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:40.646198 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a8387a-e236-46cd-bd62-aadae154b064 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:02:40.652793 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-e4a8387a-e236-46cd-bd62-aadae154b064 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:02:40.653955 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 516/1037] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:02:40 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:40.660839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b7c05-0b88-4dd6-a838-631cb9413018 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:40.669803 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b7c05-0b88-4dd6-a838-631cb9413018 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:40.674830 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e0e51-238e-4ae6-b426-6636c9d66f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:40.675492 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e0e51-238e-4ae6-b426-6636c9d66f59 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:40.675769 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e0e51-238e-4ae6-b426-6636c9d66f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:40.676044 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e0e51-238e-4ae6-b426-6636c9d66f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:40.676810 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e0e51-238e-4ae6-b426-6636c9d66f59 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:40.677115 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e0e51-238e-4ae6-b426-6636c9d66f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:40.678754 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9e0e51-238e-4ae6-b426-6636c9d66f59 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:40.687024 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 522/1038] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:02:40 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:40.694005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8387a-e236-46cd-bd62-aadae154b064 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:40.704481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a8387a-e236-46cd-bd62-aadae154b064 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:40.708978 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db67dc-b363-4f0d-bc7d-b562785e40af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:40.709815 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db67dc-b363-4f0d-bc7d-b562785e40af admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:40.710289 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db67dc-b363-4f0d-bc7d-b562785e40af admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:40.710560 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db67dc-b363-4f0d-bc7d-b562785e40af admin admin] PATH_INFO: `/v3/users/df609d4027da453f9aa0f582237535fc` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:40.723708 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db67dc-b363-4f0d-bc7d-b562785e40af admin admin] RBAC: Authorizing `identity:get_user(user_id=df609d4027da453f9aa0f582237535fc)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:40.725821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db67dc-b363-4f0d-bc7d-b562785e40af admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:40.727481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 517/1039] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:02:40 2021] GET /identity/v3/users/df609d4027da453f9aa0f582237535fc => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:40.734571 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e0e51-238e-4ae6-b426-6636c9d66f59 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:40.744102 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9e0e51-238e-4ae6-b426-6636c9d66f59 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:40.748591 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4a3c4-6ed0-49bf-996f-828ce5ba24dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:40.749834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4a3c4-6ed0-49bf-996f-828ce5ba24dc admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:40.750151 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4a3c4-6ed0-49bf-996f-828ce5ba24dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:40.750432 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4a3c4-6ed0-49bf-996f-828ce5ba24dc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:40.758390 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4a3c4-6ed0-49bf-996f-828ce5ba24dc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:40.760152 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4a3c4-6ed0-49bf-996f-828ce5ba24dc admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:40.769328 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 523/1040] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:02:40 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:02:40.776075 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db67dc-b363-4f0d-bc7d-b562785e40af admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:40.786311 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db67dc-b363-4f0d-bc7d-b562785e40af admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:40.790709 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50c1ad-4e0c-4430-9899-a5a3ad12da32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:40.791536 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50c1ad-4e0c-4430-9899-a5a3ad12da32 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:40.791813 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50c1ad-4e0c-4430-9899-a5a3ad12da32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:40.792082 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50c1ad-4e0c-4430-9899-a5a3ad12da32 admin admin] PATH_INFO: `/v3/projects/5eef9a6532ef47b784e55118202657c3` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:40.793251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50c1ad-4e0c-4430-9899-a5a3ad12da32 admin admin] RBAC: Authorizing `identity:get_project(project_id=5eef9a6532ef47b784e55118202657c3)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:40.795309 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50c1ad-4e0c-4430-9899-a5a3ad12da32 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:40.797488 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 518/1041] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:02:40 2021] GET /identity/v3/projects/5eef9a6532ef47b784e55118202657c3 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:40.804270 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4a3c4-6ed0-49bf-996f-828ce5ba24dc admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:40.813787 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4a3c4-6ed0-49bf-996f-828ce5ba24dc admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:40.818361 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90313645-7dac-4849-bac2-5432e8b7c3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:40.819006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90313645-7dac-4849-bac2-5432e8b7c3da admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:40.819286 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90313645-7dac-4849-bac2-5432e8b7c3da admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:40.819563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90313645-7dac-4849-bac2-5432e8b7c3da admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:40.820400 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90313645-7dac-4849-bac2-5432e8b7c3da admin admin] RBAC: Adding query filter params (role.id=f28d3f93a0524078a592a15459808378, scope.project.id=5eef9a6532ef47b784e55118202657c3, user.id=df609d4027da453f9aa0f582237535fc) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:40.820711 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90313645-7dac-4849-bac2-5432e8b7c3da admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:40.822616 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90313645-7dac-4849-bac2-5432e8b7c3da admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:40.828348 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 524/1042] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:02:40 2021] GET /identity/v3/role_assignments?user.id=df609d4027da453f9aa0f582237535fc&scope.project.id=5eef9a6532ef47b784e55118202657c3&role.id=f28d3f93a0524078a592a15459808378 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:43.074401 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf048c-1b45-4d00-9571-8585901d8616 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:43.075081 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf048c-1b45-4d00-9571-8585901d8616 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:43.075081 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddf048c-1b45-4d00-9571-8585901d8616 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:43.076971 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 519/1043] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:43.083780 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4c5e2-bce9-47ac-b10d-e922d5f93edf None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:43.084308 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4c5e2-bce9-47ac-b10d-e922d5f93edf None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:43.084308 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4c5e2-bce9-47ac-b10d-e922d5f93edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:43.102369 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-44a4c5e2-bce9-47ac-b10d-e922d5f93edf None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:43.103581 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-44a4c5e2-bce9-47ac-b10d-e922d5f93edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:43.112346 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 525/1044] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:43 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:43.136808 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf048c-1b45-4d00-9571-8585901d8616 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:43.150389 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddf048c-1b45-4d00-9571-8585901d8616 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:43.154700 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5beda2-5ef2-4c04-ba73-f59b050f268a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:43.155992 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5beda2-5ef2-4c04-ba73-f59b050f268a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:43.156270 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5beda2-5ef2-4c04-ba73-f59b050f268a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:43.156540 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5beda2-5ef2-4c04-ba73-f59b050f268a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:43.167984 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5beda2-5ef2-4c04-ba73-f59b050f268a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:02:43.175647 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-5b5beda2-5ef2-4c04-ba73-f59b050f268a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:02:43.177044 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 520/1045] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:02:43 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:43.184347 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4c5e2-bce9-47ac-b10d-e922d5f93edf None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:43.193795 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4c5e2-bce9-47ac-b10d-e922d5f93edf None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:43.198395 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe26e3-8a3c-4072-ae45-69127b2eee49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:43.199076 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe26e3-8a3c-4072-ae45-69127b2eee49 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:43.199354 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe26e3-8a3c-4072-ae45-69127b2eee49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:43.199624 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe26e3-8a3c-4072-ae45-69127b2eee49 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:43.200385 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe26e3-8a3c-4072-ae45-69127b2eee49 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:43.200949 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe26e3-8a3c-4072-ae45-69127b2eee49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:43.202601 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe26e3-8a3c-4072-ae45-69127b2eee49 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:43.211427 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 526/1046] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:02:43 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:43.218661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5beda2-5ef2-4c04-ba73-f59b050f268a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:43.229214 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5beda2-5ef2-4c04-ba73-f59b050f268a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:43.234470 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c22920-dea5-40cd-bfbb-b9428c143955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:43.235332 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c22920-dea5-40cd-bfbb-b9428c143955 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:43.235615 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c22920-dea5-40cd-bfbb-b9428c143955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:43.235893 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c22920-dea5-40cd-bfbb-b9428c143955 admin admin] PATH_INFO: `/v3/users/df609d4027da453f9aa0f582237535fc` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:43.237125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c22920-dea5-40cd-bfbb-b9428c143955 admin admin] RBAC: Authorizing `identity:get_user(user_id=df609d4027da453f9aa0f582237535fc)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:43.239345 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c22920-dea5-40cd-bfbb-b9428c143955 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:43.241010 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 521/1047] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:02:43 2021] GET /identity/v3/users/df609d4027da453f9aa0f582237535fc => generated 286 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:43.247838 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe26e3-8a3c-4072-ae45-69127b2eee49 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:43.257798 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe26e3-8a3c-4072-ae45-69127b2eee49 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:43.262366 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a4c09-3836-4c92-9307-4ecc9f2b8bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:43.263226 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a4c09-3836-4c92-9307-4ecc9f2b8bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:43.263507 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a4c09-3836-4c92-9307-4ecc9f2b8bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:43.263782 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a4c09-3836-4c92-9307-4ecc9f2b8bc9 admin admin] PATH_INFO: `/v3/projects/5eef9a6532ef47b784e55118202657c3` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:43.265004 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a4c09-3836-4c92-9307-4ecc9f2b8bc9 admin admin] RBAC: Authorizing `identity:get_project(project_id=5eef9a6532ef47b784e55118202657c3)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:43.267104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a4c09-3836-4c92-9307-4ecc9f2b8bc9 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:43.268829 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 527/1048] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:02:43 2021] GET /identity/v3/projects/5eef9a6532ef47b784e55118202657c3 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:43.275768 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c22920-dea5-40cd-bfbb-b9428c143955 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:43.286160 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c22920-dea5-40cd-bfbb-b9428c143955 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:43.290783 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9d844-973f-473c-84a3-b28383e67d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:43.291677 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9d844-973f-473c-84a3-b28383e67d0a admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:43.291956 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9d844-973f-473c-84a3-b28383e67d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:43.292234 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9d844-973f-473c-84a3-b28383e67d0a admin admin] PATH_INFO: `/v3/projects/5eef9a6532ef47b784e55118202657c3/users/df609d4027da453f9aa0f582237535fc/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:43.294262 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9d844-973f-473c-84a3-b28383e67d0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eef9a6532ef47b784e55118202657c3, user_id=df609d4027da453f9aa0f582237535fc, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:43.297540 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9d844-973f-473c-84a3-b28383e67d0a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:43.313063 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 522/1049] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:02:43 2021] PUT /identity/v3/projects/5eef9a6532ef47b784e55118202657c3/users/df609d4027da453f9aa0f582237535fc/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:02:45.613897 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a482b4d-25ef-45a6-8036-ae6c9011be90 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:45.614455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a482b4d-25ef-45a6-8036-ae6c9011be90 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:45.614455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a482b4d-25ef-45a6-8036-ae6c9011be90 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:45.616262 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 528/1050] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:45 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:45.622371 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8d817-e77d-4a07-a7ae-a73dbe500f55 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:45.622809 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8d817-e77d-4a07-a7ae-a73dbe500f55 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:45.622907 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8d817-e77d-4a07-a7ae-a73dbe500f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:45.640648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-94b8d817-e77d-4a07-a7ae-a73dbe500f55 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:45.641821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-94b8d817-e77d-4a07-a7ae-a73dbe500f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:45.697472 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 523/1051] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:45 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:45.722571 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a482b4d-25ef-45a6-8036-ae6c9011be90 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:45.735005 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a482b4d-25ef-45a6-8036-ae6c9011be90 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:45.739402 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9740a-4a7e-40e0-9afd-0facfef0cfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:45.740248 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9740a-4a7e-40e0-9afd-0facfef0cfe4 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:45.740606 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9740a-4a7e-40e0-9afd-0facfef0cfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:45.740884 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9740a-4a7e-40e0-9afd-0facfef0cfe4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:45.751038 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9740a-4a7e-40e0-9afd-0facfef0cfe4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:02:45.757741 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-f6a9740a-4a7e-40e0-9afd-0facfef0cfe4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:02:45.758929 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 529/1052] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:02:45 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:45.766357 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8d817-e77d-4a07-a7ae-a73dbe500f55 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:45.775550 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b8d817-e77d-4a07-a7ae-a73dbe500f55 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:45.780810 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69f93d-dbc5-4df3-8681-1e4b28a527ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:45.781482 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69f93d-dbc5-4df3-8681-1e4b28a527ba admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:45.781772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69f93d-dbc5-4df3-8681-1e4b28a527ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:45.782084 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69f93d-dbc5-4df3-8681-1e4b28a527ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:45.782857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69f93d-dbc5-4df3-8681-1e4b28a527ba admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:45.783618 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69f93d-dbc5-4df3-8681-1e4b28a527ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:45.785212 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69f93d-dbc5-4df3-8681-1e4b28a527ba admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:45.793682 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 524/1053] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:02:45 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:45.800308 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9740a-4a7e-40e0-9afd-0facfef0cfe4 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:45.810493 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9740a-4a7e-40e0-9afd-0facfef0cfe4 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:45.814920 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6caee-939e-4995-b358-e00f24360730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:45.815771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6caee-939e-4995-b358-e00f24360730 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:45.816050 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6caee-939e-4995-b358-e00f24360730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:45.816320 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6caee-939e-4995-b358-e00f24360730 admin admin] PATH_INFO: `/v3/users/df609d4027da453f9aa0f582237535fc` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:45.817513 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6caee-939e-4995-b358-e00f24360730 admin admin] RBAC: Authorizing `identity:get_user(user_id=df609d4027da453f9aa0f582237535fc)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:45.819692 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6caee-939e-4995-b358-e00f24360730 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:45.821262 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 530/1054] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:02:45 2021] GET /identity/v3/users/df609d4027da453f9aa0f582237535fc => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:45.828555 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69f93d-dbc5-4df3-8681-1e4b28a527ba admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:45.838607 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69f93d-dbc5-4df3-8681-1e4b28a527ba admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:45.843849 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310cbfe-5b63-47c4-aa7e-8132ca6c2435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:45.844485 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310cbfe-5b63-47c4-aa7e-8132ca6c2435 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:45.844770 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310cbfe-5b63-47c4-aa7e-8132ca6c2435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:45.845046 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310cbfe-5b63-47c4-aa7e-8132ca6c2435 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:45.853490 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310cbfe-5b63-47c4-aa7e-8132ca6c2435 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:45.855299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310cbfe-5b63-47c4-aa7e-8132ca6c2435 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:45.864447 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 525/1055] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:02:45 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:02:45.876458 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6caee-939e-4995-b358-e00f24360730 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:45.892598 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6caee-939e-4995-b358-e00f24360730 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:45.899289 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693faae8-9489-4175-95e2-182e060f1eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:45.900171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693faae8-9489-4175-95e2-182e060f1eed admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:45.900411 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693faae8-9489-4175-95e2-182e060f1eed admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:45.900679 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693faae8-9489-4175-95e2-182e060f1eed admin admin] PATH_INFO: `/v3/projects/5eef9a6532ef47b784e55118202657c3` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:45.901842 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693faae8-9489-4175-95e2-182e060f1eed admin admin] RBAC: Authorizing `identity:get_project(project_id=5eef9a6532ef47b784e55118202657c3)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:45.903905 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693faae8-9489-4175-95e2-182e060f1eed admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:45.906207 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 531/1056] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:02:45 2021] GET /identity/v3/projects/5eef9a6532ef47b784e55118202657c3 => generated 311 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:45.913219 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310cbfe-5b63-47c4-aa7e-8132ca6c2435 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:45.922176 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310cbfe-5b63-47c4-aa7e-8132ca6c2435 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:45.927093 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0ffac2-5e1b-4921-afa2-10316de68974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:45.927730 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ffac2-5e1b-4921-afa2-10316de68974 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:45.928005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ffac2-5e1b-4921-afa2-10316de68974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:45.928274 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0ffac2-5e1b-4921-afa2-10316de68974 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:45.929108 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ffac2-5e1b-4921-afa2-10316de68974 admin admin] RBAC: Adding query filter params (role.id=f28d3f93a0524078a592a15459808378, scope.project.id=5eef9a6532ef47b784e55118202657c3, user.id=df609d4027da453f9aa0f582237535fc) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:45.929414 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ffac2-5e1b-4921-afa2-10316de68974 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:45.931260 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0ffac2-5e1b-4921-afa2-10316de68974 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:45.937471 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 526/1057] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:02:45 2021] GET /identity/v3/role_assignments?user.id=df609d4027da453f9aa0f582237535fc&scope.project.id=5eef9a6532ef47b784e55118202657c3&role.id=f28d3f93a0524078a592a15459808378 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:48.264864 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cd5f2-cdab-441c-a0c2-b7ea66251aa4 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:48.265653 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cd5f2-cdab-441c-a0c2-b7ea66251aa4 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:48.265832 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cd5f2-cdab-441c-a0c2-b7ea66251aa4 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:48.268458 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 532/1058] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:48 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:48.278651 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afc95d-6fa3-40e1-a022-68b3073ba5ea None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:48.279456 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afc95d-6fa3-40e1-a022-68b3073ba5ea None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:48.279456 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00afc95d-6fa3-40e1-a022-68b3073ba5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:48.298193 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-00afc95d-6fa3-40e1-a022-68b3073ba5ea None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:48.299382 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-00afc95d-6fa3-40e1-a022-68b3073ba5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:48.314323 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 527/1059] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:48 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:48.339907 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6cd5f2-cdab-441c-a0c2-b7ea66251aa4 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:48.353743 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6cd5f2-cdab-441c-a0c2-b7ea66251aa4 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:48.358114 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffa9c5-7a56-4b61-8eff-a08c0b9ca534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:48.359280 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffa9c5-7a56-4b61-8eff-a08c0b9ca534 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:48.359553 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffa9c5-7a56-4b61-8eff-a08c0b9ca534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:48.359816 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffa9c5-7a56-4b61-8eff-a08c0b9ca534 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:48.377174 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffa9c5-7a56-4b61-8eff-a08c0b9ca534 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:48.378968 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffa9c5-7a56-4b61-8eff-a08c0b9ca534 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:48.387922 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 533/1060] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:02:48 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:02:48.394843 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afc95d-6fa3-40e1-a022-68b3073ba5ea None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:48.403693 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00afc95d-6fa3-40e1-a022-68b3073ba5ea None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:48.408843 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f4f08-2f28-44b3-9bed-f32a94825b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:48.409623 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f4f08-2f28-44b3-9bed-f32a94825b3b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:48.409908 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f4f08-2f28-44b3-9bed-f32a94825b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:48.410215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f4f08-2f28-44b3-9bed-f32a94825b3b admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:48.417029 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f4f08-2f28-44b3-9bed-f32a94825b3b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:48.418891 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f4f08-2f28-44b3-9bed-f32a94825b3b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:48.433612 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-583f4f08-2f28-44b3-9bed-f32a94825b3b admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 29 16:02:48.434782 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 528/1061] 10.222.0.41 () {56 vars in 1138 bytes} [Fri Oct 29 16:02:48 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:48.441466 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffa9c5-7a56-4b61-8eff-a08c0b9ca534 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:48.450155 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffa9c5-7a56-4b61-8eff-a08c0b9ca534 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:48.455039 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d492040b-3c06-4848-9c83-df7fb4c4ec33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:48.455673 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492040b-3c06-4848-9c83-df7fb4c4ec33 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:48.455949 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492040b-3c06-4848-9c83-df7fb4c4ec33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:48.456219 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d492040b-3c06-4848-9c83-df7fb4c4ec33 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:48.456934 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492040b-3c06-4848-9c83-df7fb4c4ec33 admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:48.457232 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492040b-3c06-4848-9c83-df7fb4c4ec33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:48.458820 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d492040b-3c06-4848-9c83-df7fb4c4ec33 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:48.465750 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 534/1062] 10.222.0.41 () {56 vars in 1136 bytes} [Fri Oct 29 16:02:48 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:50.748311 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe05dd3-1186-4b35-bdf7-def073d93bb6 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:50.748887 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe05dd3-1186-4b35-bdf7-def073d93bb6 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:50.749015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe05dd3-1186-4b35-bdf7-def073d93bb6 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:50.751593 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 529/1063] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:50 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:50.757735 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f7491-7fad-4c4b-854d-363a06b2072c None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:50.758211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f7491-7fad-4c4b-854d-363a06b2072c None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:50.758330 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f7491-7fad-4c4b-854d-363a06b2072c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:50.776924 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-6b1f7491-7fad-4c4b-854d-363a06b2072c None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:50.778145 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-6b1f7491-7fad-4c4b-854d-363a06b2072c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:50.786447 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 535/1064] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:50 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:50.811325 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe05dd3-1186-4b35-bdf7-def073d93bb6 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:50.828679 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe05dd3-1186-4b35-bdf7-def073d93bb6 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:50.833313 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134c828-7508-4a60-86b1-2cb21e1cf58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:50.833999 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134c828-7508-4a60-86b1-2cb21e1cf58e admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:50.834285 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134c828-7508-4a60-86b1-2cb21e1cf58e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:50.834563 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134c828-7508-4a60-86b1-2cb21e1cf58e admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:50.835333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134c828-7508-4a60-86b1-2cb21e1cf58e admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:50.836333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING py.warnings [None req-f134c828-7508-4a60-86b1-2cb21e1cf58e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:02:50.836333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: warnings.warn(msg) Oct 29 16:02:50.836333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: Oct 29 16:02:50.837231 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134c828-7508-4a60-86b1-2cb21e1cf58e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:50.851907 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 530/1065] 10.222.0.41 () {60 vars in 1159 bytes} [Fri Oct 29 16:02:50 2021] POST /identity/v3/domains => generated 267 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:02:53.156919 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d53782-bc7f-4514-9e3a-d6fac145dca4 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:53.157474 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d53782-bc7f-4514-9e3a-d6fac145dca4 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:53.157474 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d53782-bc7f-4514-9e3a-d6fac145dca4 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:53.159286 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 536/1066] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:53 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:53.165352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a59e02-ffe4-41cc-ad9f-bafd6a5851bf None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:53.165794 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a59e02-ffe4-41cc-ad9f-bafd6a5851bf None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:53.165934 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a59e02-ffe4-41cc-ad9f-bafd6a5851bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:53.183607 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-47a59e02-ffe4-41cc-ad9f-bafd6a5851bf None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:53.184809 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-47a59e02-ffe4-41cc-ad9f-bafd6a5851bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:53.242322 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 531/1067] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:53 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:53.268007 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d53782-bc7f-4514-9e3a-d6fac145dca4 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:53.279842 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d53782-bc7f-4514-9e3a-d6fac145dca4 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:53.284277 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd38f4-9ab2-4867-9aaa-f201df3a6855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:53.285120 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd38f4-9ab2-4867-9aaa-f201df3a6855 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:53.285397 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd38f4-9ab2-4867-9aaa-f201df3a6855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:53.285688 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd38f4-9ab2-4867-9aaa-f201df3a6855 admin admin] PATH_INFO: `/v3/domains/82c9281a6b2f4ce1bb2b207afd2fb150` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:53.296506 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd38f4-9ab2-4867-9aaa-f201df3a6855 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=82c9281a6b2f4ce1bb2b207afd2fb150)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:53.298511 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cd38f4-9ab2-4867-9aaa-f201df3a6855 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:53.300134 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 537/1068] 10.222.0.41 () {56 vars in 1204 bytes} [Fri Oct 29 16:02:53 2021] GET /identity/v3/domains/82c9281a6b2f4ce1bb2b207afd2fb150 => generated 267 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:53.306768 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a59e02-ffe4-41cc-ad9f-bafd6a5851bf None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:53.317746 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a59e02-ffe4-41cc-ad9f-bafd6a5851bf None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:53.323918 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bb4c9-2a25-4d5f-bd38-650f1d01be0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:53.324583 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bb4c9-2a25-4d5f-bd38-650f1d01be0f admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:53.324863 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bb4c9-2a25-4d5f-bd38-650f1d01be0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:53.325134 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bb4c9-2a25-4d5f-bd38-650f1d01be0f admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:53.326162 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bb4c9-2a25-4d5f-bd38-650f1d01be0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:53.328254 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bb4c9-2a25-4d5f-bd38-650f1d01be0f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:53.354471 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 532/1069] 10.222.0.41 () {60 vars in 1162 bytes} [Fri Oct 29 16:02:53 2021] POST /identity/v3/projects => generated 361 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:02:55.647985 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb20fc-72a8-4ec7-ad72-68423dade823 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:55.648514 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb20fc-72a8-4ec7-ad72-68423dade823 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:55.648634 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eb20fc-72a8-4ec7-ad72-68423dade823 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:55.650366 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 538/1070] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:55.656416 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22315ef-21fc-4574-bd84-2d066d4b7b7e None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:55.656806 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22315ef-21fc-4574-bd84-2d066d4b7b7e None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:55.656960 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22315ef-21fc-4574-bd84-2d066d4b7b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:55.674578 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-c22315ef-21fc-4574-bd84-2d066d4b7b7e None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:55.675738 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-c22315ef-21fc-4574-bd84-2d066d4b7b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:55.729903 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 533/1071] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:55 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:02:55.756074 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb20fc-72a8-4ec7-ad72-68423dade823 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:55.767942 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eb20fc-72a8-4ec7-ad72-68423dade823 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:55.773174 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d3bde-4161-4819-9594-da5188c565bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:55.774045 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d3bde-4161-4819-9594-da5188c565bf admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:55.774326 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d3bde-4161-4819-9594-da5188c565bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:55.774598 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d3bde-4161-4819-9594-da5188c565bf admin admin] PATH_INFO: `/v3/domains/82c9281a6b2f4ce1bb2b207afd2fb150` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:55.775780 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d3bde-4161-4819-9594-da5188c565bf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=82c9281a6b2f4ce1bb2b207afd2fb150)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:55.777850 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d3bde-4161-4819-9594-da5188c565bf admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:55.779467 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 539/1072] 10.222.0.41 () {56 vars in 1204 bytes} [Fri Oct 29 16:02:55 2021] GET /identity/v3/domains/82c9281a6b2f4ce1bb2b207afd2fb150 => generated 267 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:55.787732 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22315ef-21fc-4574-bd84-2d066d4b7b7e None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:55.797210 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22315ef-21fc-4574-bd84-2d066d4b7b7e None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:55.801811 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ebfe0-e511-48ee-9b81-e2989a1ef35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:55.802489 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ebfe0-e511-48ee-9b81-e2989a1ef35b admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:55.802770 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ebfe0-e511-48ee-9b81-e2989a1ef35b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:55.803044 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ebfe0-e511-48ee-9b81-e2989a1ef35b admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:55.803774 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ebfe0-e511-48ee-9b81-e2989a1ef35b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:55.805681 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ebfe0-e511-48ee-9b81-e2989a1ef35b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:55.825113 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 534/1073] 10.222.0.41 () {60 vars in 1153 bytes} [Fri Oct 29 16:02:55 2021] POST /identity/v3/users => generated 311 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:02:58.096204 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209e713-512b-444e-b147-c0de9842f6ce None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:58.096742 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209e713-512b-444e-b147-c0de9842f6ce None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:58.096742 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209e713-512b-444e-b147-c0de9842f6ce None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:58.098573 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 540/1074] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:02:58 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:02:58.104534 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e7cb5-0310-451e-8e1e-3cb1d1f88f5b None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:58.104931 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e7cb5-0310-451e-8e1e-3cb1d1f88f5b None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:58.105087 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e7cb5-0310-451e-8e1e-3cb1d1f88f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:58.122301 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-492e7cb5-0310-451e-8e1e-3cb1d1f88f5b None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:02:58.124006 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-492e7cb5-0310-451e-8e1e-3cb1d1f88f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:02:58.131680 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 535/1075] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:02:58 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:02:58.156248 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209e713-512b-444e-b147-c0de9842f6ce None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:58.168421 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b209e713-512b-444e-b147-c0de9842f6ce None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:58.172756 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49721166-fe32-4cc3-8c98-8b7399243bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:58.173519 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49721166-fe32-4cc3-8c98-8b7399243bcf admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:58.173800 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49721166-fe32-4cc3-8c98-8b7399243bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:58.174109 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49721166-fe32-4cc3-8c98-8b7399243bcf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:58.184291 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49721166-fe32-4cc3-8c98-8b7399243bcf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:02:58.191619 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-49721166-fe32-4cc3-8c98-8b7399243bcf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:02:58.192743 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 541/1076] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:02:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:02:58.199108 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e7cb5-0310-451e-8e1e-3cb1d1f88f5b None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:58.209894 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e7cb5-0310-451e-8e1e-3cb1d1f88f5b None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:58.214368 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fef98-ddab-4d90-a774-22d4f96dfe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:58.215014 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fef98-ddab-4d90-a774-22d4f96dfe27 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:58.215297 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fef98-ddab-4d90-a774-22d4f96dfe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:58.215573 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fef98-ddab-4d90-a774-22d4f96dfe27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:58.216331 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8fef98-ddab-4d90-a774-22d4f96dfe27 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:58.216636 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8fef98-ddab-4d90-a774-22d4f96dfe27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:58.218286 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8fef98-ddab-4d90-a774-22d4f96dfe27 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:58.226335 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 536/1077] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:02:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:58.232527 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49721166-fe32-4cc3-8c98-8b7399243bcf admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:58.242315 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49721166-fe32-4cc3-8c98-8b7399243bcf admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:58.246831 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9500d-64c4-45c4-98ce-14e57dc38eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:58.247667 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9500d-64c4-45c4-98ce-14e57dc38eef admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:58.247947 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9500d-64c4-45c4-98ce-14e57dc38eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:58.248219 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9500d-64c4-45c4-98ce-14e57dc38eef admin admin] PATH_INFO: `/v3/users/7a075070de4d462b9d9fb24a37064ca8` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:58.261701 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9500d-64c4-45c4-98ce-14e57dc38eef admin admin] RBAC: Authorizing `identity:get_user(user_id=7a075070de4d462b9d9fb24a37064ca8)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:58.263873 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9500d-64c4-45c4-98ce-14e57dc38eef admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:58.266173 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 542/1078] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:02:58 2021] GET /identity/v3/users/7a075070de4d462b9d9fb24a37064ca8 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:02:58.272570 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fef98-ddab-4d90-a774-22d4f96dfe27 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:58.281943 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fef98-ddab-4d90-a774-22d4f96dfe27 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:58.286574 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b32f3-e8cf-4b34-9ebd-762000929146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:58.287197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b32f3-e8cf-4b34-9ebd-762000929146 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:58.287481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b32f3-e8cf-4b34-9ebd-762000929146 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:58.287759 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b32f3-e8cf-4b34-9ebd-762000929146 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:58.295371 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b32f3-e8cf-4b34-9ebd-762000929146 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:58.297104 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b32f3-e8cf-4b34-9ebd-762000929146 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:58.305672 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 537/1079] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:02:58 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:02:58.312724 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9500d-64c4-45c4-98ce-14e57dc38eef admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:58.323644 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9500d-64c4-45c4-98ce-14e57dc38eef admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:58.328972 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c6b46-e309-4892-be12-7cc33f07db9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:58.329798 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c6b46-e309-4892-be12-7cc33f07db9d admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:58.330111 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c6b46-e309-4892-be12-7cc33f07db9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:58.330383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c6b46-e309-4892-be12-7cc33f07db9d admin admin] PATH_INFO: `/v3/projects/36a0d7a42b6f44718fa076e51c1cbca8` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:58.331727 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c6b46-e309-4892-be12-7cc33f07db9d admin admin] RBAC: Authorizing `identity:get_project(project_id=36a0d7a42b6f44718fa076e51c1cbca8)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:58.333738 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37c6b46-e309-4892-be12-7cc33f07db9d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:58.335383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 543/1080] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:02:58 2021] GET /identity/v3/projects/36a0d7a42b6f44718fa076e51c1cbca8 => generated 361 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:02:58.341912 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b32f3-e8cf-4b34-9ebd-762000929146 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:02:58.350601 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b32f3-e8cf-4b34-9ebd-762000929146 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:02:58.355051 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb9d53-e523-4a2a-bf02-e4422bf4e21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:02:58.355677 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb9d53-e523-4a2a-bf02-e4422bf4e21e admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:02:58.355962 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb9d53-e523-4a2a-bf02-e4422bf4e21e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:02:58.356240 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb9d53-e523-4a2a-bf02-e4422bf4e21e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:02:58.357078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb9d53-e523-4a2a-bf02-e4422bf4e21e admin admin] RBAC: Adding query filter params (role.id=f28d3f93a0524078a592a15459808378, scope.project.id=36a0d7a42b6f44718fa076e51c1cbca8, user.id=7a075070de4d462b9d9fb24a37064ca8) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:02:58.357389 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb9d53-e523-4a2a-bf02-e4422bf4e21e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:02:58.359250 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb9d53-e523-4a2a-bf02-e4422bf4e21e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:02:58.364640 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 538/1081] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:02:58 2021] GET /identity/v3/role_assignments?user.id=7a075070de4d462b9d9fb24a37064ca8&scope.project.id=36a0d7a42b6f44718fa076e51c1cbca8&role.id=f28d3f93a0524078a592a15459808378 => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:03:00.541287 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c1685-83da-440c-90d5-68aec5da6de1 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:00.541838 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c1685-83da-440c-90d5-68aec5da6de1 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:00.541838 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8c1685-83da-440c-90d5-68aec5da6de1 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:00.543626 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 544/1082] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:03:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:03:00.549512 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa52ef1-6243-4f99-a9a0-72f3711a8eec None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:00.549888 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa52ef1-6243-4f99-a9a0-72f3711a8eec None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:00.550096 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa52ef1-6243-4f99-a9a0-72f3711a8eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:00.567725 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-7fa52ef1-6243-4f99-a9a0-72f3711a8eec None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:03:00.568902 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7fa52ef1-6243-4f99-a9a0-72f3711a8eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:03:00.577259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 539/1083] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:03:00 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:03:00.599971 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c1685-83da-440c-90d5-68aec5da6de1 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:03:00.611653 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8c1685-83da-440c-90d5-68aec5da6de1 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:03:00.615898 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e1b34-e859-4bce-965d-bd7f359bd7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:03:00.616654 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e1b34-e859-4bce-965d-bd7f359bd7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:00.616930 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e1b34-e859-4bce-965d-bd7f359bd7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:00.617200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e1b34-e859-4bce-965d-bd7f359bd7c4 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:00.627479 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e1b34-e859-4bce-965d-bd7f359bd7c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:03:00.634126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-752e1b34-e859-4bce-965d-bd7f359bd7c4 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:03:00.635252 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 545/1084] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:03:00 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:03:00.642474 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa52ef1-6243-4f99-a9a0-72f3711a8eec None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:03:00.651208 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa52ef1-6243-4f99-a9a0-72f3711a8eec None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:03:00.655656 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787d05d-39f4-4012-bb89-d9fc73c93c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:03:00.656297 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787d05d-39f4-4012-bb89-d9fc73c93c95 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:00.656579 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787d05d-39f4-4012-bb89-d9fc73c93c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:00.656859 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787d05d-39f4-4012-bb89-d9fc73c93c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:00.657616 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787d05d-39f4-4012-bb89-d9fc73c93c95 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:03:00.657934 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787d05d-39f4-4012-bb89-d9fc73c93c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:03:00.659548 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787d05d-39f4-4012-bb89-d9fc73c93c95 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:03:00.668044 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 540/1085] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:03:00 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:03:00.674280 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e1b34-e859-4bce-965d-bd7f359bd7c4 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:03:00.684209 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e1b34-e859-4bce-965d-bd7f359bd7c4 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:03:00.689211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041a3dc-ac5b-4511-b959-e782e5330b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:03:00.690083 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041a3dc-ac5b-4511-b959-e782e5330b39 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:00.690370 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041a3dc-ac5b-4511-b959-e782e5330b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:00.690647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041a3dc-ac5b-4511-b959-e782e5330b39 admin admin] PATH_INFO: `/v3/users/7a075070de4d462b9d9fb24a37064ca8` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:00.691822 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041a3dc-ac5b-4511-b959-e782e5330b39 admin admin] RBAC: Authorizing `identity:get_user(user_id=7a075070de4d462b9d9fb24a37064ca8)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:03:00.693946 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041a3dc-ac5b-4511-b959-e782e5330b39 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:03:00.695508 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 546/1086] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:03:00 2021] GET /identity/v3/users/7a075070de4d462b9d9fb24a37064ca8 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:03:00.702780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787d05d-39f4-4012-bb89-d9fc73c93c95 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:03:00.712225 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787d05d-39f4-4012-bb89-d9fc73c93c95 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:03:00.716634 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a13c27-c1fa-4de5-a8f1-00172a1039f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:03:00.717454 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a13c27-c1fa-4de5-a8f1-00172a1039f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:00.717735 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a13c27-c1fa-4de5-a8f1-00172a1039f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:00.718036 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a13c27-c1fa-4de5-a8f1-00172a1039f9 admin admin] PATH_INFO: `/v3/projects/36a0d7a42b6f44718fa076e51c1cbca8` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:00.719204 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a13c27-c1fa-4de5-a8f1-00172a1039f9 admin admin] RBAC: Authorizing `identity:get_project(project_id=36a0d7a42b6f44718fa076e51c1cbca8)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:03:00.721223 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a13c27-c1fa-4de5-a8f1-00172a1039f9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:03:00.722856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 541/1087] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:03:00 2021] GET /identity/v3/projects/36a0d7a42b6f44718fa076e51c1cbca8 => generated 361 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:03:00.728997 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041a3dc-ac5b-4511-b959-e782e5330b39 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:03:00.738282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041a3dc-ac5b-4511-b959-e782e5330b39 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:03:00.742734 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c7fa7-2477-4022-9f88-ca7b07deee13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:03:00.743576 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c7fa7-2477-4022-9f88-ca7b07deee13 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:00.743860 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c7fa7-2477-4022-9f88-ca7b07deee13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:00.744137 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c7fa7-2477-4022-9f88-ca7b07deee13 admin admin] PATH_INFO: `/v3/projects/36a0d7a42b6f44718fa076e51c1cbca8/users/7a075070de4d462b9d9fb24a37064ca8/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:00.746209 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c7fa7-2477-4022-9f88-ca7b07deee13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36a0d7a42b6f44718fa076e51c1cbca8, user_id=7a075070de4d462b9d9fb24a37064ca8, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:03:00.749316 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c7fa7-2477-4022-9f88-ca7b07deee13 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:03:00.762230 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 547/1088] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:03:00 2021] PUT /identity/v3/projects/36a0d7a42b6f44718fa076e51c1cbca8/users/7a075070de4d462b9d9fb24a37064ca8/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:03:02.970237 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb8f57-8c9e-4f1f-912f-e41b9dabaf05 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:02.970772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb8f57-8c9e-4f1f-912f-e41b9dabaf05 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:02.970772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb8f57-8c9e-4f1f-912f-e41b9dabaf05 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:02.972535 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 542/1089] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:03:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:03:02.978401 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e8e6d-d60f-403e-81cd-d2c5901100d5 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:02.978815 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e8e6d-d60f-403e-81cd-d2c5901100d5 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:02.978959 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e8e6d-d60f-403e-81cd-d2c5901100d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:02.996091 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-dc2e8e6d-d60f-403e-81cd-d2c5901100d5 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:03:02.997273 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-dc2e8e6d-d60f-403e-81cd-d2c5901100d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:03:03.051968 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 548/1090] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:03:02 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:03:03.076837 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb8f57-8c9e-4f1f-912f-e41b9dabaf05 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:03:03.088475 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb8f57-8c9e-4f1f-912f-e41b9dabaf05 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:03:03.092674 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129e17e-7740-4031-b10a-57f389dbc916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:03:03.093428 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129e17e-7740-4031-b10a-57f389dbc916 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:03.093704 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129e17e-7740-4031-b10a-57f389dbc916 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:03.094005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8129e17e-7740-4031-b10a-57f389dbc916 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:03.103949 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8129e17e-7740-4031-b10a-57f389dbc916 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:03:03.111126 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-8129e17e-7740-4031-b10a-57f389dbc916 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:03:03.112281 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 543/1091] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:03:03 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:03:03.118927 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e8e6d-d60f-403e-81cd-d2c5901100d5 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:03:03.128384 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e8e6d-d60f-403e-81cd-d2c5901100d5 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:03:03.132887 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37330ac-7f63-4f3c-acff-34947dea7877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:03:03.133536 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37330ac-7f63-4f3c-acff-34947dea7877 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:03.133821 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37330ac-7f63-4f3c-acff-34947dea7877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:03.134123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37330ac-7f63-4f3c-acff-34947dea7877 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:03.134878 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37330ac-7f63-4f3c-acff-34947dea7877 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:03:03.135184 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37330ac-7f63-4f3c-acff-34947dea7877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:03:03.136771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37330ac-7f63-4f3c-acff-34947dea7877 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:03:03.144846 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 549/1092] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:03:03 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:03:03.150942 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129e17e-7740-4031-b10a-57f389dbc916 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:03:03.160919 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8129e17e-7740-4031-b10a-57f389dbc916 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:03:03.165439 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e92a11-3940-4d25-97ee-701561f1ef3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:03:03.166307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e92a11-3940-4d25-97ee-701561f1ef3a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:03.166587 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e92a11-3940-4d25-97ee-701561f1ef3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:03.166857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e92a11-3940-4d25-97ee-701561f1ef3a admin admin] PATH_INFO: `/v3/users/7a075070de4d462b9d9fb24a37064ca8` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:03.168041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e92a11-3940-4d25-97ee-701561f1ef3a admin admin] RBAC: Authorizing `identity:get_user(user_id=7a075070de4d462b9d9fb24a37064ca8)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:03:03.170684 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e92a11-3940-4d25-97ee-701561f1ef3a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:03:03.172229 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 544/1093] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:03:03 2021] GET /identity/v3/users/7a075070de4d462b9d9fb24a37064ca8 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:03:03.178418 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37330ac-7f63-4f3c-acff-34947dea7877 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:03:03.188383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37330ac-7f63-4f3c-acff-34947dea7877 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:03:03.192843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403437d-1fad-46c0-9cd9-e326c12e688c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:03:03.193467 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403437d-1fad-46c0-9cd9-e326c12e688c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:03.193750 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403437d-1fad-46c0-9cd9-e326c12e688c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:03.194062 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403437d-1fad-46c0-9cd9-e326c12e688c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:03.201837 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403437d-1fad-46c0-9cd9-e326c12e688c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:03:03.203598 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403437d-1fad-46c0-9cd9-e326c12e688c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:03:03.212316 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 550/1094] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:03:03 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:03:03.218733 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e92a11-3940-4d25-97ee-701561f1ef3a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:03:03.228093 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e92a11-3940-4d25-97ee-701561f1ef3a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:03:03.232551 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2ec16-5bd6-4d73-9c7e-ce9e9632bd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:03:03.233871 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2ec16-5bd6-4d73-9c7e-ce9e9632bd0a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:03.234179 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2ec16-5bd6-4d73-9c7e-ce9e9632bd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:03.234450 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2ec16-5bd6-4d73-9c7e-ce9e9632bd0a admin admin] PATH_INFO: `/v3/projects/36a0d7a42b6f44718fa076e51c1cbca8` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:03.235622 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2ec16-5bd6-4d73-9c7e-ce9e9632bd0a admin admin] RBAC: Authorizing `identity:get_project(project_id=36a0d7a42b6f44718fa076e51c1cbca8)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:03:03.237634 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a2ec16-5bd6-4d73-9c7e-ce9e9632bd0a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:03:03.239282 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 545/1095] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:03:03 2021] GET /identity/v3/projects/36a0d7a42b6f44718fa076e51c1cbca8 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:03:03.245565 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403437d-1fad-46c0-9cd9-e326c12e688c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:03:03.255085 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403437d-1fad-46c0-9cd9-e326c12e688c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:03:03.259943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd5bdf-7adc-49cc-aaf2-a3d6e4f87e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:03:03.260574 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd5bdf-7adc-49cc-aaf2-a3d6e4f87e5b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:03.260856 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd5bdf-7adc-49cc-aaf2-a3d6e4f87e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:03.261133 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd5bdf-7adc-49cc-aaf2-a3d6e4f87e5b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:03.261996 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd5bdf-7adc-49cc-aaf2-a3d6e4f87e5b admin admin] RBAC: Adding query filter params (role.id=f28d3f93a0524078a592a15459808378, scope.project.id=36a0d7a42b6f44718fa076e51c1cbca8, user.id=7a075070de4d462b9d9fb24a37064ca8) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:03:03.262290 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd5bdf-7adc-49cc-aaf2-a3d6e4f87e5b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:03:03.264629 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdd5bdf-7adc-49cc-aaf2-a3d6e4f87e5b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:03:03.270498 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 551/1096] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:03:03 2021] GET /identity/v3/role_assignments?user.id=7a075070de4d462b9d9fb24a37064ca8&scope.project.id=36a0d7a42b6f44718fa076e51c1cbca8&role.id=f28d3f93a0524078a592a15459808378 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:03:58.619395 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea820677-d88e-4633-98d8-5699007d4979 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:58.620069 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea820677-d88e-4633-98d8-5699007d4979 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:58.620069 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea820677-d88e-4633-98d8-5699007d4979 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:58.622148 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 546/1097] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:03:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:03:58.628446 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee3074-2692-4001-986a-7ba49a4bd10a None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:58.629102 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee3074-2692-4001-986a-7ba49a4bd10a None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:58.629102 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee3074-2692-4001-986a-7ba49a4bd10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:58.648405 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-b8ee3074-2692-4001-986a-7ba49a4bd10a None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:03:58.649598 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b8ee3074-2692-4001-986a-7ba49a4bd10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:03:58.658718 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 552/1098] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:03:58 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:03:58.684144 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea820677-d88e-4633-98d8-5699007d4979 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:03:58.697745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea820677-d88e-4633-98d8-5699007d4979 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:03:58.703803 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46d910-31ed-4c79-addd-34a619d6547b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:03:58.704745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46d910-31ed-4c79-addd-34a619d6547b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:58.705031 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46d910-31ed-4c79-addd-34a619d6547b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:58.705310 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e46d910-31ed-4c79-addd-34a619d6547b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:58.717380 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46d910-31ed-4c79-addd-34a619d6547b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:03:58.719359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e46d910-31ed-4c79-addd-34a619d6547b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:03:58.738245 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-6e46d910-31ed-4c79-addd-34a619d6547b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:03:58.739808 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 547/1099] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:03:58 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:03:58.746725 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee3074-2692-4001-986a-7ba49a4bd10a None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:03:58.757272 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee3074-2692-4001-986a-7ba49a4bd10a None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:03:58.769298 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dbc8d-c25a-461b-ae25-5d92872a4f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:03:58.770125 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dbc8d-c25a-461b-ae25-5d92872a4f92 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:58.770673 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dbc8d-c25a-461b-ae25-5d92872a4f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:58.772606 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dbc8d-c25a-461b-ae25-5d92872a4f92 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:58.772606 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56dbc8d-c25a-461b-ae25-5d92872a4f92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:03:58.772606 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56dbc8d-c25a-461b-ae25-5d92872a4f92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:03:58.778019 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56dbc8d-c25a-461b-ae25-5d92872a4f92 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:03:58.790120 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 553/1100] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:03:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:03:58.801041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46d910-31ed-4c79-addd-34a619d6547b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:03:58.818031 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e46d910-31ed-4c79-addd-34a619d6547b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:03:58.826655 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a25bb4-ecd8-4c4b-b795-69218de4a40d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:03:58.827448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a25bb4-ecd8-4c4b-b795-69218de4a40d admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:03:58.827845 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a25bb4-ecd8-4c4b-b795-69218de4a40d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:03:58.828237 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a25bb4-ecd8-4c4b-b795-69218de4a40d admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:03:58.829287 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a25bb4-ecd8-4c4b-b795-69218de4a40d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:03:58.831600 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a25bb4-ecd8-4c4b-b795-69218de4a40d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:03:58.865205 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 548/1101] 10.222.0.41 () {60 vars in 1153 bytes} [Fri Oct 29 16:03:58 2021] POST /identity/v3/users => generated 251 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:04:01.248383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207c6a0-40e2-43a8-a798-73428d2dec71 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:01.248944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207c6a0-40e2-43a8-a798-73428d2dec71 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:01.248944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207c6a0-40e2-43a8-a798-73428d2dec71 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:01.250901 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 554/1102] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:04:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:04:01.258598 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6158705-a622-4ba3-8a14-a059e703e4b9 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:01.258598 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6158705-a622-4ba3-8a14-a059e703e4b9 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:01.258598 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6158705-a622-4ba3-8a14-a059e703e4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:01.280099 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-d6158705-a622-4ba3-8a14-a059e703e4b9 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:04:01.281874 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d6158705-a622-4ba3-8a14-a059e703e4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:04:01.294672 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 549/1103] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:04:01 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:04:01.322584 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207c6a0-40e2-43a8-a798-73428d2dec71 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:01.338246 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207c6a0-40e2-43a8-a798-73428d2dec71 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:01.343915 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbaa419-1986-48e6-9bc4-148fb921e24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:01.344702 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbaa419-1986-48e6-9bc4-148fb921e24b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:01.344979 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbaa419-1986-48e6-9bc4-148fb921e24b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:01.345251 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbaa419-1986-48e6-9bc4-148fb921e24b admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:01.358458 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbaa419-1986-48e6-9bc4-148fb921e24b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:04:01.366721 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-cdbaa419-1986-48e6-9bc4-148fb921e24b admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:04:01.370391 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 555/1104] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:04:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:01.376051 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6158705-a622-4ba3-8a14-a059e703e4b9 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:01.387336 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6158705-a622-4ba3-8a14-a059e703e4b9 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:01.392000 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbf381-5509-4822-a3c2-2a4c9ea97212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:01.393616 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbf381-5509-4822-a3c2-2a4c9ea97212 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:01.393616 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbf381-5509-4822-a3c2-2a4c9ea97212 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:01.393616 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bbf381-5509-4822-a3c2-2a4c9ea97212 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:01.393989 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbf381-5509-4822-a3c2-2a4c9ea97212 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:01.394300 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbf381-5509-4822-a3c2-2a4c9ea97212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:01.395906 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41bbf381-5509-4822-a3c2-2a4c9ea97212 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:01.405276 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 550/1105] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:04:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:01.412692 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbaa419-1986-48e6-9bc4-148fb921e24b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:01.425529 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbaa419-1986-48e6-9bc4-148fb921e24b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:01.431521 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f82ac-660e-46a5-896b-dd2dfa5dad83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:01.432503 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f82ac-660e-46a5-896b-dd2dfa5dad83 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:01.432809 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f82ac-660e-46a5-896b-dd2dfa5dad83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:01.433074 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f82ac-660e-46a5-896b-dd2dfa5dad83 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:01.445367 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f82ac-660e-46a5-896b-dd2dfa5dad83 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:01.447700 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f82ac-660e-46a5-896b-dd2dfa5dad83 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:01.467635 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-3c2f82ac-660e-46a5-896b-dd2dfa5dad83 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:04:01.468955 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 556/1106] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:04:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:01.477180 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbf381-5509-4822-a3c2-2a4c9ea97212 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:01.489744 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bbf381-5509-4822-a3c2-2a4c9ea97212 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:01.494304 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92dcef-94ce-45a6-be75-e4bf0d708be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:01.494951 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92dcef-94ce-45a6-be75-e4bf0d708be2 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:01.495228 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92dcef-94ce-45a6-be75-e4bf0d708be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:01.495497 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92dcef-94ce-45a6-be75-e4bf0d708be2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:01.496364 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92dcef-94ce-45a6-be75-e4bf0d708be2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:01.496761 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92dcef-94ce-45a6-be75-e4bf0d708be2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:01.498669 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92dcef-94ce-45a6-be75-e4bf0d708be2 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:01.514926 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 551/1107] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:04:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:01.521763 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f82ac-660e-46a5-896b-dd2dfa5dad83 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:01.533820 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f82ac-660e-46a5-896b-dd2dfa5dad83 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:01.539522 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a5bd2-1820-4066-accf-51c9d0e0d42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:01.540425 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a5bd2-1820-4066-accf-51c9d0e0d42d admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:01.540709 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a5bd2-1820-4066-accf-51c9d0e0d42d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:01.540978 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a5bd2-1820-4066-accf-51c9d0e0d42d admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:01.551025 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a5bd2-1820-4066-accf-51c9d0e0d42d admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:01.553071 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a5bd2-1820-4066-accf-51c9d0e0d42d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:01.570174 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-915a5bd2-1820-4066-accf-51c9d0e0d42d admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 16:04:01.571621 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 557/1108] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:04:01 2021] GET /identity/v3/users/placement => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:01.579664 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92dcef-94ce-45a6-be75-e4bf0d708be2 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:01.593758 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92dcef-94ce-45a6-be75-e4bf0d708be2 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:01.599742 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeafdba-0aab-420a-8e1a-5c14f02074b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:01.600620 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeafdba-0aab-420a-8e1a-5c14f02074b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:01.601018 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeafdba-0aab-420a-8e1a-5c14f02074b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:01.601300 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeafdba-0aab-420a-8e1a-5c14f02074b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:01.602596 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeafdba-0aab-420a-8e1a-5c14f02074b4 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:01.602998 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeafdba-0aab-420a-8e1a-5c14f02074b4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:01.606298 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeafdba-0aab-420a-8e1a-5c14f02074b4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:01.630652 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 552/1109] 10.222.0.41 () {56 vars in 1164 bytes} [Fri Oct 29 16:04:01 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:01.637492 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a5bd2-1820-4066-accf-51c9d0e0d42d admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:01.649669 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a5bd2-1820-4066-accf-51c9d0e0d42d admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:01.654987 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71451023-d5fd-42c5-88bf-7120408d7e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:01.655614 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71451023-d5fd-42c5-88bf-7120408d7e14 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:01.655915 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71451023-d5fd-42c5-88bf-7120408d7e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:01.656184 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71451023-d5fd-42c5-88bf-7120408d7e14 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:01.664786 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71451023-d5fd-42c5-88bf-7120408d7e14 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:01.666583 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71451023-d5fd-42c5-88bf-7120408d7e14 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:01.676600 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 558/1110] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:04:01 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:04:01.684129 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeafdba-0aab-420a-8e1a-5c14f02074b4 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:01.698383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeafdba-0aab-420a-8e1a-5c14f02074b4 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:01.704640 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0d5c1-f327-462d-b06c-2c133eff2293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:01.705526 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0d5c1-f327-462d-b06c-2c133eff2293 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:01.706066 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0d5c1-f327-462d-b06c-2c133eff2293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:01.706288 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0d5c1-f327-462d-b06c-2c133eff2293 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:01.718875 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0d5c1-f327-462d-b06c-2c133eff2293 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:01.720772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0d5c1-f327-462d-b06c-2c133eff2293 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:01.741414 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-edb0d5c1-f327-462d-b06c-2c133eff2293 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:04:01.742982 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 553/1111] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:04:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:01.750630 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71451023-d5fd-42c5-88bf-7120408d7e14 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:01.759771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71451023-d5fd-42c5-88bf-7120408d7e14 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:01.764819 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79c5e6-1c6a-4e7e-9ba2-fe3be338d7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:01.767718 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79c5e6-1c6a-4e7e-9ba2-fe3be338d7ef admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:01.767718 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79c5e6-1c6a-4e7e-9ba2-fe3be338d7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:01.767718 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc79c5e6-1c6a-4e7e-9ba2-fe3be338d7ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:01.767718 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79c5e6-1c6a-4e7e-9ba2-fe3be338d7ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:01.767718 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79c5e6-1c6a-4e7e-9ba2-fe3be338d7ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:01.768670 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc79c5e6-1c6a-4e7e-9ba2-fe3be338d7ef admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:01.785959 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 559/1112] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:04:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:01.792045 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0d5c1-f327-462d-b06c-2c133eff2293 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:01.804968 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0d5c1-f327-462d-b06c-2c133eff2293 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:01.812411 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b14118-1a6c-4ba2-8da9-d6e8177b48c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:01.813196 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b14118-1a6c-4ba2-8da9-d6e8177b48c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:01.813473 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b14118-1a6c-4ba2-8da9-d6e8177b48c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:01.813742 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b14118-1a6c-4ba2-8da9-d6e8177b48c8 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:01.822221 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b14118-1a6c-4ba2-8da9-d6e8177b48c8 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:01.824887 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b14118-1a6c-4ba2-8da9-d6e8177b48c8 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:01.840813 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-53b14118-1a6c-4ba2-8da9-d6e8177b48c8 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:04:01.847708 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 554/1113] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:04:01 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:01.849607 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79c5e6-1c6a-4e7e-9ba2-fe3be338d7ef admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:01.861086 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc79c5e6-1c6a-4e7e-9ba2-fe3be338d7ef admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:01.865984 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8659a6-326e-475c-8f90-8b21a3339883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:01.866658 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8659a6-326e-475c-8f90-8b21a3339883 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:01.866953 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8659a6-326e-475c-8f90-8b21a3339883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:01.867245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8659a6-326e-475c-8f90-8b21a3339883 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:01.868026 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8659a6-326e-475c-8f90-8b21a3339883 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:01.868338 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8659a6-326e-475c-8f90-8b21a3339883 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:01.870647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8659a6-326e-475c-8f90-8b21a3339883 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:01.884197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 560/1114] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:04:01 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:04:01.891258 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b14118-1a6c-4ba2-8da9-d6e8177b48c8 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:01.902202 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b14118-1a6c-4ba2-8da9-d6e8177b48c8 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:01.907862 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b683592-94f4-4d0b-bc70-6233cc0a3369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:01.908553 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b683592-94f4-4d0b-bc70-6233cc0a3369 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:01.908797 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b683592-94f4-4d0b-bc70-6233cc0a3369 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:01.909076 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b683592-94f4-4d0b-bc70-6233cc0a3369 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:01.909928 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b683592-94f4-4d0b-bc70-6233cc0a3369 admin admin] RBAC: Adding query filter params (role.id=01b3b9b5c0d846968d6a5219373998f8, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=34c34efa8fd24230aa45e0f67209260e) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:01.910267 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b683592-94f4-4d0b-bc70-6233cc0a3369 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:01.912111 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b683592-94f4-4d0b-bc70-6233cc0a3369 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:01.922169 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 555/1115] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:04:01 2021] GET /identity/v3/role_assignments?user.id=34c34efa8fd24230aa45e0f67209260e&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=01b3b9b5c0d846968d6a5219373998f8 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:04.344845 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81456124-4fa7-4acd-81b0-aa94ecf9abc0 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:04.345375 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81456124-4fa7-4acd-81b0-aa94ecf9abc0 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:04.345375 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81456124-4fa7-4acd-81b0-aa94ecf9abc0 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:04.347718 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 561/1116] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:04:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:04:04.354957 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a06c1-aa84-4517-a866-43d93e728c71 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:04.355446 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a06c1-aa84-4517-a866-43d93e728c71 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:04.355527 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a06c1-aa84-4517-a866-43d93e728c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:04.375772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-734a06c1-aa84-4517-a866-43d93e728c71 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:04:04.377371 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-734a06c1-aa84-4517-a866-43d93e728c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:04:04.389966 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 556/1117] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:04:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 29 16:04:04.412254 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81456124-4fa7-4acd-81b0-aa94ecf9abc0 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:04.428490 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81456124-4fa7-4acd-81b0-aa94ecf9abc0 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:04.434248 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c4173-5f50-452d-98f5-23517eabde4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:04.435185 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c4173-5f50-452d-98f5-23517eabde4e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:04.435506 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c4173-5f50-452d-98f5-23517eabde4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:04.435817 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c4173-5f50-452d-98f5-23517eabde4e admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:04.448994 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c4173-5f50-452d-98f5-23517eabde4e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:04:04.457364 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-bb6c4173-5f50-452d-98f5-23517eabde4e admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:04:04.458930 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 562/1118] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:04:04 2021] GET /identity/v3/roles/service => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:04.466003 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a06c1-aa84-4517-a866-43d93e728c71 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:04.476335 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a06c1-aa84-4517-a866-43d93e728c71 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:04.482559 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d569b39-6c79-45f3-99d9-9c46785ffaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:04.483294 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d569b39-6c79-45f3-99d9-9c46785ffaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:04.483647 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d569b39-6c79-45f3-99d9-9c46785ffaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:04.484939 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d569b39-6c79-45f3-99d9-9c46785ffaf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:04.484939 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d569b39-6c79-45f3-99d9-9c46785ffaf3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:04.485143 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d569b39-6c79-45f3-99d9-9c46785ffaf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:04.486864 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d569b39-6c79-45f3-99d9-9c46785ffaf3 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:04.498087 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 557/1119] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:04:04 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:04:04.507525 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c4173-5f50-452d-98f5-23517eabde4e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:04.525185 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c4173-5f50-452d-98f5-23517eabde4e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:04.530378 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185941b3-a93f-416f-9f42-9ef8910fd73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:04.531194 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185941b3-a93f-416f-9f42-9ef8910fd73e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:04.531484 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185941b3-a93f-416f-9f42-9ef8910fd73e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:04.531759 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185941b3-a93f-416f-9f42-9ef8910fd73e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:04.542565 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185941b3-a93f-416f-9f42-9ef8910fd73e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:04.545208 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185941b3-a93f-416f-9f42-9ef8910fd73e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:04.571156 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-185941b3-a93f-416f-9f42-9ef8910fd73e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:04:04.572710 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 563/1120] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:04:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:04.580024 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d569b39-6c79-45f3-99d9-9c46785ffaf3 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:04.590819 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d569b39-6c79-45f3-99d9-9c46785ffaf3 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:04.595651 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd75259-39f2-409d-8f79-d074e971d318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:04.596358 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd75259-39f2-409d-8f79-d074e971d318 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:04.596734 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd75259-39f2-409d-8f79-d074e971d318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:04.597108 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd75259-39f2-409d-8f79-d074e971d318 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:04.600587 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd75259-39f2-409d-8f79-d074e971d318 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:04.600904 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd75259-39f2-409d-8f79-d074e971d318 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:04.602592 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd75259-39f2-409d-8f79-d074e971d318 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:04.620458 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 558/1121] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:04:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:04:04.629712 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185941b3-a93f-416f-9f42-9ef8910fd73e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:04.643349 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185941b3-a93f-416f-9f42-9ef8910fd73e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:04.649857 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205b218-a616-4c23-ac91-1f832e9ca8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:04.650936 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205b218-a616-4c23-ac91-1f832e9ca8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:04.651245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205b218-a616-4c23-ac91-1f832e9ca8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:04.651510 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205b218-a616-4c23-ac91-1f832e9ca8d5 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:04.660102 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205b218-a616-4c23-ac91-1f832e9ca8d5 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:04.662138 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205b218-a616-4c23-ac91-1f832e9ca8d5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:04.676309 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-f205b218-a616-4c23-ac91-1f832e9ca8d5 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 16:04:04.677626 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 564/1122] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:04:04 2021] GET /identity/v3/users/placement => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:04.684743 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd75259-39f2-409d-8f79-d074e971d318 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:04.696653 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd75259-39f2-409d-8f79-d074e971d318 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:04.702518 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5117249-a204-4a65-9cfe-95adad4b3a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:04.703521 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5117249-a204-4a65-9cfe-95adad4b3a29 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:04.704025 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5117249-a204-4a65-9cfe-95adad4b3a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:04.704375 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5117249-a204-4a65-9cfe-95adad4b3a29 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:04.705579 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5117249-a204-4a65-9cfe-95adad4b3a29 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:04.706068 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5117249-a204-4a65-9cfe-95adad4b3a29 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:04.709999 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5117249-a204-4a65-9cfe-95adad4b3a29 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:04.734069 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 559/1123] 10.222.0.41 () {56 vars in 1164 bytes} [Fri Oct 29 16:04:04 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:04.740519 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205b218-a616-4c23-ac91-1f832e9ca8d5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:04.751186 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205b218-a616-4c23-ac91-1f832e9ca8d5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:04.756093 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8cb4d-e2a5-4c32-b370-cc3a3da2853c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:04.756895 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8cb4d-e2a5-4c32-b370-cc3a3da2853c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:04.757224 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8cb4d-e2a5-4c32-b370-cc3a3da2853c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:04.757439 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8cb4d-e2a5-4c32-b370-cc3a3da2853c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:04.768610 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8cb4d-e2a5-4c32-b370-cc3a3da2853c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:04.770478 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8cb4d-e2a5-4c32-b370-cc3a3da2853c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:04.788868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-1ba8cb4d-e2a5-4c32-b370-cc3a3da2853c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:04:04.790115 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 565/1124] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:04:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:04:04.797070 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5117249-a204-4a65-9cfe-95adad4b3a29 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:04.807266 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5117249-a204-4a65-9cfe-95adad4b3a29 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:04.814239 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9803af-86e6-4afa-89b0-e46433cb11dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:04.814889 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9803af-86e6-4afa-89b0-e46433cb11dd admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:04.815747 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9803af-86e6-4afa-89b0-e46433cb11dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:04.815747 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9803af-86e6-4afa-89b0-e46433cb11dd admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:04.816164 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9803af-86e6-4afa-89b0-e46433cb11dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:04.816471 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9803af-86e6-4afa-89b0-e46433cb11dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:04.818091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9803af-86e6-4afa-89b0-e46433cb11dd admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:04.830334 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 560/1125] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:04:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:04.838084 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8cb4d-e2a5-4c32-b370-cc3a3da2853c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:04.849174 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8cb4d-e2a5-4c32-b370-cc3a3da2853c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:04.854077 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2623459-1bad-4474-87dc-7a228cb5ce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:04.854929 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2623459-1bad-4474-87dc-7a228cb5ce2f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:04.855208 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2623459-1bad-4474-87dc-7a228cb5ce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:04.856000 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2623459-1bad-4474-87dc-7a228cb5ce2f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:04.862912 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2623459-1bad-4474-87dc-7a228cb5ce2f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:04.864848 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2623459-1bad-4474-87dc-7a228cb5ce2f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:04.879507 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-c2623459-1bad-4474-87dc-7a228cb5ce2f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:04:04.880817 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 566/1126] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:04:04 2021] GET /identity/v3/projects/service => generated 88 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:04.888331 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9803af-86e6-4afa-89b0-e46433cb11dd admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:04.897789 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9803af-86e6-4afa-89b0-e46433cb11dd admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:04.902827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9efc9f-03c8-499c-8dc3-d5269c9a752e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:04.903463 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9efc9f-03c8-499c-8dc3-d5269c9a752e admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:04.903744 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9efc9f-03c8-499c-8dc3-d5269c9a752e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:04.904022 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9efc9f-03c8-499c-8dc3-d5269c9a752e admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:04.904814 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9efc9f-03c8-499c-8dc3-d5269c9a752e admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:04.905125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9efc9f-03c8-499c-8dc3-d5269c9a752e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:04.906993 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9efc9f-03c8-499c-8dc3-d5269c9a752e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:04.919737 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 561/1127] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:04:04 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:04.926505 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2623459-1bad-4474-87dc-7a228cb5ce2f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:04.937794 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2623459-1bad-4474-87dc-7a228cb5ce2f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:04.942656 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f96b4-bead-4cb9-830f-6cc0909634cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:04.943770 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f96b4-bead-4cb9-830f-6cc0909634cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:04.944134 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f96b4-bead-4cb9-830f-6cc0909634cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:04.944405 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f96b4-bead-4cb9-830f-6cc0909634cd admin admin] PATH_INFO: `/v3/projects/4939afba2b604181b67577f309c9550a/users/34c34efa8fd24230aa45e0f67209260e/roles/01b3b9b5c0d846968d6a5219373998f8` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:04.963369 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f96b4-bead-4cb9-830f-6cc0909634cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=4939afba2b604181b67577f309c9550a, user_id=34c34efa8fd24230aa45e0f67209260e, role_id=01b3b9b5c0d846968d6a5219373998f8)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:04.967108 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f96b4-bead-4cb9-830f-6cc0909634cd admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:04.981521 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 567/1128] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:04:04 2021] PUT /identity/v3/projects/4939afba2b604181b67577f309c9550a/users/34c34efa8fd24230aa45e0f67209260e/roles/01b3b9b5c0d846968d6a5219373998f8 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:04:07.247316 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba41ce0-8308-48ba-8a8f-c40098d92a6b None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:07.247994 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba41ce0-8308-48ba-8a8f-c40098d92a6b None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:07.247994 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba41ce0-8308-48ba-8a8f-c40098d92a6b None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:07.249867 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 562/1129] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:04:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:04:07.255996 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db856732-4847-4726-953a-d159388265ee None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:07.256567 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db856732-4847-4726-953a-d159388265ee None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:07.256567 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db856732-4847-4726-953a-d159388265ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:07.274730 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-db856732-4847-4726-953a-d159388265ee None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:04:07.275941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-db856732-4847-4726-953a-d159388265ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:04:07.347194 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 568/1130] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:04:07 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:04:07.372717 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba41ce0-8308-48ba-8a8f-c40098d92a6b None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:07.386729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba41ce0-8308-48ba-8a8f-c40098d92a6b None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:07.391655 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c2adf-bdc6-4dd2-8b08-c64cb7038866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:07.392451 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c2adf-bdc6-4dd2-8b08-c64cb7038866 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:07.392737 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c2adf-bdc6-4dd2-8b08-c64cb7038866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:07.393056 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c2adf-bdc6-4dd2-8b08-c64cb7038866 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:07.405459 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c2adf-bdc6-4dd2-8b08-c64cb7038866 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:04:07.412413 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-e22c2adf-bdc6-4dd2-8b08-c64cb7038866 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 29 16:04:07.413645 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 563/1131] 10.222.0.41 () {56 vars in 1123 bytes} [Fri Oct 29 16:04:07 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:07.423302 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db856732-4847-4726-953a-d159388265ee None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:07.436256 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db856732-4847-4726-953a-d159388265ee None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:07.442768 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ce338-3bc3-4baf-a98d-c79bb3fc2dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:07.443660 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ce338-3bc3-4baf-a98d-c79bb3fc2dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:07.444068 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ce338-3bc3-4baf-a98d-c79bb3fc2dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:07.444448 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ce338-3bc3-4baf-a98d-c79bb3fc2dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:07.445594 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ce338-3bc3-4baf-a98d-c79bb3fc2dc5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:07.446066 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ce338-3bc3-4baf-a98d-c79bb3fc2dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:07.448355 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ce338-3bc3-4baf-a98d-c79bb3fc2dc5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:07.460327 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 569/1132] 10.222.0.41 () {56 vars in 1124 bytes} [Fri Oct 29 16:04:07 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:04:07.468209 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c2adf-bdc6-4dd2-8b08-c64cb7038866 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:07.479610 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c2adf-bdc6-4dd2-8b08-c64cb7038866 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:07.485522 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4c59c-705d-4683-9a54-a1b58e3fdac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:07.486324 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4c59c-705d-4683-9a54-a1b58e3fdac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:07.486610 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4c59c-705d-4683-9a54-a1b58e3fdac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:07.486884 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4c59c-705d-4683-9a54-a1b58e3fdac1 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:07.497460 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4c59c-705d-4683-9a54-a1b58e3fdac1 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:07.499392 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4c59c-705d-4683-9a54-a1b58e3fdac1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:07.519432 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-aac4c59c-705d-4683-9a54-a1b58e3fdac1 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:04:07.520663 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 564/1133] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:04:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:04:07.527950 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ce338-3bc3-4baf-a98d-c79bb3fc2dc5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:07.539351 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ce338-3bc3-4baf-a98d-c79bb3fc2dc5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:07.544202 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05290a23-54ee-4317-949f-ce0c63cf29ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:07.544851 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05290a23-54ee-4317-949f-ce0c63cf29ef admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:07.545120 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05290a23-54ee-4317-949f-ce0c63cf29ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:07.545454 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05290a23-54ee-4317-949f-ce0c63cf29ef admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:07.546151 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05290a23-54ee-4317-949f-ce0c63cf29ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:07.546450 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05290a23-54ee-4317-949f-ce0c63cf29ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:07.548037 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05290a23-54ee-4317-949f-ce0c63cf29ef admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:07.571633 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 570/1134] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:04:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:04:07.574551 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4c59c-705d-4683-9a54-a1b58e3fdac1 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:07.588578 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4c59c-705d-4683-9a54-a1b58e3fdac1 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:07.595029 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe10dbc-21a8-41a7-afb8-4bec591fb5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:07.595965 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe10dbc-21a8-41a7-afb8-4bec591fb5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:07.596601 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe10dbc-21a8-41a7-afb8-4bec591fb5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:07.596921 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe10dbc-21a8-41a7-afb8-4bec591fb5c3 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:07.605647 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe10dbc-21a8-41a7-afb8-4bec591fb5c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:07.607952 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe10dbc-21a8-41a7-afb8-4bec591fb5c3 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:07.626675 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-cfe10dbc-21a8-41a7-afb8-4bec591fb5c3 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 16:04:07.627898 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 565/1135] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:04:07 2021] GET /identity/v3/users/placement => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:07.635549 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05290a23-54ee-4317-949f-ce0c63cf29ef admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:07.647974 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05290a23-54ee-4317-949f-ce0c63cf29ef admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:07.653317 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df0c41-3cb9-4a38-bcb0-401594315a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:07.654072 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df0c41-3cb9-4a38-bcb0-401594315a38 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:07.654406 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df0c41-3cb9-4a38-bcb0-401594315a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:07.654652 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93df0c41-3cb9-4a38-bcb0-401594315a38 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:07.655571 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df0c41-3cb9-4a38-bcb0-401594315a38 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:07.656113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df0c41-3cb9-4a38-bcb0-401594315a38 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:07.658113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93df0c41-3cb9-4a38-bcb0-401594315a38 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:07.678951 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 571/1136] 10.222.0.41 () {56 vars in 1164 bytes} [Fri Oct 29 16:04:07 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:04:07.685945 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe10dbc-21a8-41a7-afb8-4bec591fb5c3 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:07.696473 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe10dbc-21a8-41a7-afb8-4bec591fb5c3 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:07.702571 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343dc3f-623b-4f18-a6c5-f3835be75835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:07.703349 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343dc3f-623b-4f18-a6c5-f3835be75835 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:07.703735 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343dc3f-623b-4f18-a6c5-f3835be75835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:07.704120 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343dc3f-623b-4f18-a6c5-f3835be75835 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:07.712961 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343dc3f-623b-4f18-a6c5-f3835be75835 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:07.715480 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343dc3f-623b-4f18-a6c5-f3835be75835 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:07.725649 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 566/1137] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:04:07 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:04:07.735037 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df0c41-3cb9-4a38-bcb0-401594315a38 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:07.748425 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93df0c41-3cb9-4a38-bcb0-401594315a38 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:07.755605 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb7875-00ac-437c-8d1f-74eb6c0872fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:07.756420 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb7875-00ac-437c-8d1f-74eb6c0872fd admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:07.756706 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb7875-00ac-437c-8d1f-74eb6c0872fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:07.756987 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb7875-00ac-437c-8d1f-74eb6c0872fd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:07.768271 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb7875-00ac-437c-8d1f-74eb6c0872fd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:07.770183 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb7875-00ac-437c-8d1f-74eb6c0872fd admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:07.788759 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-3eeb7875-00ac-437c-8d1f-74eb6c0872fd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:04:07.790146 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 572/1138] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:04:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:07.797082 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343dc3f-623b-4f18-a6c5-f3835be75835 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:07.807141 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343dc3f-623b-4f18-a6c5-f3835be75835 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:07.812703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cb557-0484-40e0-87d8-71b60de97965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:07.813458 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cb557-0484-40e0-87d8-71b60de97965 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:07.813809 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cb557-0484-40e0-87d8-71b60de97965 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:07.814150 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cb557-0484-40e0-87d8-71b60de97965 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:07.815025 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cb557-0484-40e0-87d8-71b60de97965 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:07.815356 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cb557-0484-40e0-87d8-71b60de97965 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:07.816942 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cb557-0484-40e0-87d8-71b60de97965 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:07.838389 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 567/1139] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:04:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:07.844258 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb7875-00ac-437c-8d1f-74eb6c0872fd admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:07.855576 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb7875-00ac-437c-8d1f-74eb6c0872fd admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:07.860630 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41ae25-724b-49af-a1e1-9058b1745cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:07.861489 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41ae25-724b-49af-a1e1-9058b1745cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:07.861786 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41ae25-724b-49af-a1e1-9058b1745cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:07.862215 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41ae25-724b-49af-a1e1-9058b1745cd3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:07.870574 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41ae25-724b-49af-a1e1-9058b1745cd3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:07.873953 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41ae25-724b-49af-a1e1-9058b1745cd3 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:07.887410 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-ab41ae25-724b-49af-a1e1-9058b1745cd3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:04:07.888987 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 573/1140] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:04:07 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:07.895669 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cb557-0484-40e0-87d8-71b60de97965 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:07.905624 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cb557-0484-40e0-87d8-71b60de97965 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:07.911000 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c6948-6b27-4aae-a2cd-466dc247fa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:07.911830 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c6948-6b27-4aae-a2cd-466dc247fa97 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:07.912184 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c6948-6b27-4aae-a2cd-466dc247fa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:07.912525 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c6948-6b27-4aae-a2cd-466dc247fa97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:07.913327 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c6948-6b27-4aae-a2cd-466dc247fa97 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:07.913650 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c6948-6b27-4aae-a2cd-466dc247fa97 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:07.915606 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0c6948-6b27-4aae-a2cd-466dc247fa97 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:07.943034 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41ae25-724b-49af-a1e1-9058b1745cd3 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:07.949684 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 568/1141] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:04:07 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:04:07.955337 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41ae25-724b-49af-a1e1-9058b1745cd3 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:07.960951 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed406f-d63f-4ea4-a327-564f46314abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:07.961669 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed406f-d63f-4ea4-a327-564f46314abf admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:07.962099 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed406f-d63f-4ea4-a327-564f46314abf admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:07.962245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed406f-d63f-4ea4-a327-564f46314abf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:07.963125 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed406f-d63f-4ea4-a327-564f46314abf admin admin] RBAC: Adding query filter params (role.id=01b3b9b5c0d846968d6a5219373998f8, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=34c34efa8fd24230aa45e0f67209260e) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:07.963444 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed406f-d63f-4ea4-a327-564f46314abf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:07.965572 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed406f-d63f-4ea4-a327-564f46314abf admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:07.972092 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 574/1142] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:04:07 2021] GET /identity/v3/role_assignments?user.id=34c34efa8fd24230aa45e0f67209260e&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=01b3b9b5c0d846968d6a5219373998f8 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:10.381699 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a799e-aac6-4544-9168-6f28c7d473ba None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:10.382276 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a799e-aac6-4544-9168-6f28c7d473ba None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:10.382276 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a799e-aac6-4544-9168-6f28c7d473ba None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:10.384042 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 569/1143] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:04:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:04:10.390033 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30a831-2002-4d19-8e76-da8daf788254 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:10.390527 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30a831-2002-4d19-8e76-da8daf788254 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:10.390634 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30a831-2002-4d19-8e76-da8daf788254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:10.408208 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-ff30a831-2002-4d19-8e76-da8daf788254 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:04:10.409396 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ff30a831-2002-4d19-8e76-da8daf788254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:04:10.417423 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 575/1144] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:04:10 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:04:10.442188 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a799e-aac6-4544-9168-6f28c7d473ba None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:10.456129 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a799e-aac6-4544-9168-6f28c7d473ba None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:10.460763 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2644564-9c2f-4859-b25b-40bd872e1da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:10.461535 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2644564-9c2f-4859-b25b-40bd872e1da8 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:10.461823 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2644564-9c2f-4859-b25b-40bd872e1da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:10.462125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2644564-9c2f-4859-b25b-40bd872e1da8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:10.472902 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2644564-9c2f-4859-b25b-40bd872e1da8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:04:10.479597 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-c2644564-9c2f-4859-b25b-40bd872e1da8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:04:10.481400 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 570/1145] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:04:10 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:04:10.488096 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30a831-2002-4d19-8e76-da8daf788254 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:10.498614 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30a831-2002-4d19-8e76-da8daf788254 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:10.504260 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2b2db-33da-4eec-a568-7c567f802448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:10.504989 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2b2db-33da-4eec-a568-7c567f802448 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:10.505272 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2b2db-33da-4eec-a568-7c567f802448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:10.505550 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2b2db-33da-4eec-a568-7c567f802448 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:10.506328 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2b2db-33da-4eec-a568-7c567f802448 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:10.506632 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2b2db-33da-4eec-a568-7c567f802448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:10.508502 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2b2db-33da-4eec-a568-7c567f802448 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:10.519714 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 576/1146] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:04:10 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:04:10.526277 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2644564-9c2f-4859-b25b-40bd872e1da8 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:10.538161 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2644564-9c2f-4859-b25b-40bd872e1da8 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:10.543448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3284d9-2eba-4434-8e60-13b75602331c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:10.544220 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3284d9-2eba-4434-8e60-13b75602331c admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:10.544506 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3284d9-2eba-4434-8e60-13b75602331c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:10.544782 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3284d9-2eba-4434-8e60-13b75602331c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:10.555182 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3284d9-2eba-4434-8e60-13b75602331c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:10.557059 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3284d9-2eba-4434-8e60-13b75602331c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:10.573387 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-9a3284d9-2eba-4434-8e60-13b75602331c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:04:10.575096 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 571/1147] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:04:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:10.581740 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2b2db-33da-4eec-a568-7c567f802448 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:10.592176 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2b2db-33da-4eec-a568-7c567f802448 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:10.597149 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a8ab1-aac8-47df-80cf-1841760537c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:10.597816 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8ab1-aac8-47df-80cf-1841760537c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:10.598128 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8ab1-aac8-47df-80cf-1841760537c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:10.598403 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a8ab1-aac8-47df-80cf-1841760537c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:10.599140 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a8ab1-aac8-47df-80cf-1841760537c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:10.599442 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a8ab1-aac8-47df-80cf-1841760537c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:10.601043 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a8ab1-aac8-47df-80cf-1841760537c0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:10.613296 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 577/1148] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:04:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:10.621663 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3284d9-2eba-4434-8e60-13b75602331c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:10.634618 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3284d9-2eba-4434-8e60-13b75602331c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:10.642471 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513efe2-ba3f-4fbc-bb0d-bed1d1872a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:10.643512 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513efe2-ba3f-4fbc-bb0d-bed1d1872a5b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:10.643880 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513efe2-ba3f-4fbc-bb0d-bed1d1872a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:10.644141 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513efe2-ba3f-4fbc-bb0d-bed1d1872a5b admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:10.656025 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513efe2-ba3f-4fbc-bb0d-bed1d1872a5b admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:10.658679 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a513efe2-ba3f-4fbc-bb0d-bed1d1872a5b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:10.673979 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-a513efe2-ba3f-4fbc-bb0d-bed1d1872a5b admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 16:04:10.675476 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 572/1149] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:04:10 2021] GET /identity/v3/users/placement => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:10.682444 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a8ab1-aac8-47df-80cf-1841760537c0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:10.692163 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a8ab1-aac8-47df-80cf-1841760537c0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:10.696680 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14115ecc-963f-4790-8770-a7e6420f29fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:10.697336 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14115ecc-963f-4790-8770-a7e6420f29fc admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:10.697617 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14115ecc-963f-4790-8770-a7e6420f29fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:10.697891 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14115ecc-963f-4790-8770-a7e6420f29fc admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:10.699323 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14115ecc-963f-4790-8770-a7e6420f29fc admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:10.699634 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14115ecc-963f-4790-8770-a7e6420f29fc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:10.701737 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14115ecc-963f-4790-8770-a7e6420f29fc admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:10.719283 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 578/1150] 10.222.0.41 () {56 vars in 1164 bytes} [Fri Oct 29 16:04:10 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:10.726295 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513efe2-ba3f-4fbc-bb0d-bed1d1872a5b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:10.736965 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513efe2-ba3f-4fbc-bb0d-bed1d1872a5b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:10.741693 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3ccb9-d8a7-4825-abec-3de2239351ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:10.742430 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3ccb9-d8a7-4825-abec-3de2239351ed admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:10.742776 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3ccb9-d8a7-4825-abec-3de2239351ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:10.743125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3ccb9-d8a7-4825-abec-3de2239351ed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:10.751248 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3ccb9-d8a7-4825-abec-3de2239351ed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:10.752974 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3ccb9-d8a7-4825-abec-3de2239351ed admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:10.762266 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 573/1151] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:04:10 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:04:10.769113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14115ecc-963f-4790-8770-a7e6420f29fc admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:10.782006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14115ecc-963f-4790-8770-a7e6420f29fc admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:10.787264 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf58dc-6909-4ceb-8818-ebc2b6f4e228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:10.788292 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf58dc-6909-4ceb-8818-ebc2b6f4e228 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:10.788571 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf58dc-6909-4ceb-8818-ebc2b6f4e228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:10.789079 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf58dc-6909-4ceb-8818-ebc2b6f4e228 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:10.800797 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf58dc-6909-4ceb-8818-ebc2b6f4e228 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:10.802890 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf58dc-6909-4ceb-8818-ebc2b6f4e228 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:10.822165 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-5cdf58dc-6909-4ceb-8818-ebc2b6f4e228 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:04:10.823363 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 579/1152] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:04:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:10.830873 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3ccb9-d8a7-4825-abec-3de2239351ed admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:10.841308 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3ccb9-d8a7-4825-abec-3de2239351ed admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:10.846724 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb22146-2222-4eac-ad99-c15b6cd12213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:10.847420 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb22146-2222-4eac-ad99-c15b6cd12213 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:10.847723 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb22146-2222-4eac-ad99-c15b6cd12213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:10.848052 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb22146-2222-4eac-ad99-c15b6cd12213 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:10.848915 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb22146-2222-4eac-ad99-c15b6cd12213 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:10.849284 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb22146-2222-4eac-ad99-c15b6cd12213 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:10.851039 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb22146-2222-4eac-ad99-c15b6cd12213 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:10.863872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 574/1153] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:04:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:10.870525 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf58dc-6909-4ceb-8818-ebc2b6f4e228 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:10.881797 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf58dc-6909-4ceb-8818-ebc2b6f4e228 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:10.887976 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfe5f5-0e82-4d01-a7ee-4706e45ee9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:10.888826 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe5f5-0e82-4d01-a7ee-4706e45ee9cc admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:10.889134 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe5f5-0e82-4d01-a7ee-4706e45ee9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:10.889413 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dfe5f5-0e82-4d01-a7ee-4706e45ee9cc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:10.898035 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfe5f5-0e82-4d01-a7ee-4706e45ee9cc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:10.899987 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dfe5f5-0e82-4d01-a7ee-4706e45ee9cc admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:10.912762 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-e3dfe5f5-0e82-4d01-a7ee-4706e45ee9cc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:04:10.913954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 580/1154] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:04:10 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:10.921130 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb22146-2222-4eac-ad99-c15b6cd12213 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:10.930977 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb22146-2222-4eac-ad99-c15b6cd12213 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:10.936896 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ffc24-00c7-459d-8e74-53454775e57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:10.937736 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ffc24-00c7-459d-8e74-53454775e57a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:10.938156 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ffc24-00c7-459d-8e74-53454775e57a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:10.938462 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ffc24-00c7-459d-8e74-53454775e57a admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:10.939373 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ffc24-00c7-459d-8e74-53454775e57a admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:10.939717 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ffc24-00c7-459d-8e74-53454775e57a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:10.941714 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ffc24-00c7-459d-8e74-53454775e57a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:10.956608 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 575/1155] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:04:10 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:10.964554 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfe5f5-0e82-4d01-a7ee-4706e45ee9cc admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:10.977175 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dfe5f5-0e82-4d01-a7ee-4706e45ee9cc admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:10.981910 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f2516-32fe-4ad2-be5c-a712150bcb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:10.982572 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f2516-32fe-4ad2-be5c-a712150bcb6f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:10.982853 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f2516-32fe-4ad2-be5c-a712150bcb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:10.983146 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f2516-32fe-4ad2-be5c-a712150bcb6f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:10.983961 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f2516-32fe-4ad2-be5c-a712150bcb6f admin admin] RBAC: Adding query filter params (role.id=f28d3f93a0524078a592a15459808378, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=34c34efa8fd24230aa45e0f67209260e) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:10.984266 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f2516-32fe-4ad2-be5c-a712150bcb6f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:10.986126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f2516-32fe-4ad2-be5c-a712150bcb6f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:10.991668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 581/1156] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:04:10 2021] GET /identity/v3/role_assignments?user.id=34c34efa8fd24230aa45e0f67209260e&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=f28d3f93a0524078a592a15459808378 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:13.360429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e30c7-5b29-43d2-bd38-7a1b1eb9d2f6 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:13.360961 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e30c7-5b29-43d2-bd38-7a1b1eb9d2f6 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:13.361078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e30c7-5b29-43d2-bd38-7a1b1eb9d2f6 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:13.362868 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 576/1157] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:04:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:04:13.369361 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29391c-5059-4ac1-b0a5-1766bec3b38d None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:13.369844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29391c-5059-4ac1-b0a5-1766bec3b38d None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:13.369993 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad29391c-5059-4ac1-b0a5-1766bec3b38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:13.388497 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-ad29391c-5059-4ac1-b0a5-1766bec3b38d None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:04:13.389891 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ad29391c-5059-4ac1-b0a5-1766bec3b38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:04:13.398147 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 582/1158] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:04:13 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:04:13.426578 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e30c7-5b29-43d2-bd38-7a1b1eb9d2f6 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:13.438997 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e30c7-5b29-43d2-bd38-7a1b1eb9d2f6 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:13.443636 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce845414-6a80-4401-acf5-ededd15b2bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:13.444419 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce845414-6a80-4401-acf5-ededd15b2bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:13.444697 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce845414-6a80-4401-acf5-ededd15b2bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:13.444968 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce845414-6a80-4401-acf5-ededd15b2bc2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:13.456790 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce845414-6a80-4401-acf5-ededd15b2bc2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:04:13.465189 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-ce845414-6a80-4401-acf5-ededd15b2bc2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:04:13.466487 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 577/1159] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:04:13 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:13.473970 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29391c-5059-4ac1-b0a5-1766bec3b38d None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:13.484537 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad29391c-5059-4ac1-b0a5-1766bec3b38d None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:13.491516 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def2786-88c1-4ce9-ada7-2fd38287d78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:13.492281 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def2786-88c1-4ce9-ada7-2fd38287d78c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:13.492639 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def2786-88c1-4ce9-ada7-2fd38287d78c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:13.492941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0def2786-88c1-4ce9-ada7-2fd38287d78c admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:13.493827 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def2786-88c1-4ce9-ada7-2fd38287d78c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:13.494177 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def2786-88c1-4ce9-ada7-2fd38287d78c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:13.496098 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0def2786-88c1-4ce9-ada7-2fd38287d78c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:13.505450 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 583/1160] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:04:13 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:04:13.513078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce845414-6a80-4401-acf5-ededd15b2bc2 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:13.524226 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce845414-6a80-4401-acf5-ededd15b2bc2 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:13.530106 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c4b2d-b133-49d6-9ebf-3788123b7c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:13.531035 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c4b2d-b133-49d6-9ebf-3788123b7c41 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:13.531316 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c4b2d-b133-49d6-9ebf-3788123b7c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:13.531583 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c4b2d-b133-49d6-9ebf-3788123b7c41 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:13.544373 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c4b2d-b133-49d6-9ebf-3788123b7c41 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:13.546570 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c4b2d-b133-49d6-9ebf-3788123b7c41 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:13.563779 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-bc8c4b2d-b133-49d6-9ebf-3788123b7c41 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:04:13.564963 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 578/1161] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:04:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:13.571404 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def2786-88c1-4ce9-ada7-2fd38287d78c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:13.582298 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0def2786-88c1-4ce9-ada7-2fd38287d78c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:13.587094 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe67501-4fbe-42d8-a15c-eef1267f2ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:13.587747 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67501-4fbe-42d8-a15c-eef1267f2ecb admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:13.588026 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67501-4fbe-42d8-a15c-eef1267f2ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:13.588298 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67501-4fbe-42d8-a15c-eef1267f2ecb admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:13.589031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe67501-4fbe-42d8-a15c-eef1267f2ecb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:13.589388 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe67501-4fbe-42d8-a15c-eef1267f2ecb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:13.591541 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe67501-4fbe-42d8-a15c-eef1267f2ecb admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:13.603552 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 584/1162] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:04:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:13.610728 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c4b2d-b133-49d6-9ebf-3788123b7c41 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:13.621486 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c4b2d-b133-49d6-9ebf-3788123b7c41 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:13.626810 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ac0c5-3b4a-451b-ad5c-71c2c34aff25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:13.627621 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ac0c5-3b4a-451b-ad5c-71c2c34aff25 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:13.628093 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ac0c5-3b4a-451b-ad5c-71c2c34aff25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:13.628238 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36ac0c5-3b4a-451b-ad5c-71c2c34aff25 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:13.636836 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ac0c5-3b4a-451b-ad5c-71c2c34aff25 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:13.638893 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36ac0c5-3b4a-451b-ad5c-71c2c34aff25 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:13.654217 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-a36ac0c5-3b4a-451b-ad5c-71c2c34aff25 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 16:04:13.655408 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 579/1163] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:04:13 2021] GET /identity/v3/users/placement => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:13.661892 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe67501-4fbe-42d8-a15c-eef1267f2ecb admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:13.671910 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe67501-4fbe-42d8-a15c-eef1267f2ecb admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:13.676895 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8b038-6134-4fdf-9aef-abe3331bcde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:13.677636 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8b038-6134-4fdf-9aef-abe3331bcde0 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:13.677984 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8b038-6134-4fdf-9aef-abe3331bcde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:13.678226 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8b038-6134-4fdf-9aef-abe3331bcde0 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:13.679149 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8b038-6134-4fdf-9aef-abe3331bcde0 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:13.679461 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8b038-6134-4fdf-9aef-abe3331bcde0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:13.681379 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8b038-6134-4fdf-9aef-abe3331bcde0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:13.706119 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 585/1164] 10.222.0.41 () {56 vars in 1164 bytes} [Fri Oct 29 16:04:13 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:13.707402 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ac0c5-3b4a-451b-ad5c-71c2c34aff25 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:13.718535 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36ac0c5-3b4a-451b-ad5c-71c2c34aff25 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:13.723783 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079a42b-e583-4634-8af1-46366e60774d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:13.724661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079a42b-e583-4634-8af1-46366e60774d admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:13.724937 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079a42b-e583-4634-8af1-46366e60774d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:13.725205 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8079a42b-e583-4634-8af1-46366e60774d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:13.736739 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079a42b-e583-4634-8af1-46366e60774d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:13.738838 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8079a42b-e583-4634-8af1-46366e60774d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:13.757159 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-8079a42b-e583-4634-8af1-46366e60774d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:04:13.758631 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 580/1165] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:04:13 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:13.765624 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8b038-6134-4fdf-9aef-abe3331bcde0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:13.776595 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8b038-6134-4fdf-9aef-abe3331bcde0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:13.783003 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b6daa-f492-4c86-8f94-5828cc54b511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:13.783703 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b6daa-f492-4c86-8f94-5828cc54b511 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:13.784020 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b6daa-f492-4c86-8f94-5828cc54b511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:13.784327 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b6daa-f492-4c86-8f94-5828cc54b511 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:13.785255 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b6daa-f492-4c86-8f94-5828cc54b511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:13.785582 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b6daa-f492-4c86-8f94-5828cc54b511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:13.787383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277b6daa-f492-4c86-8f94-5828cc54b511 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:13.800097 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 586/1166] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:04:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:13.806924 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079a42b-e583-4634-8af1-46366e60774d admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:13.817764 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8079a42b-e583-4634-8af1-46366e60774d admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:13.822639 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e1705-5eaf-46af-98e2-83812472ca99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:13.823530 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e1705-5eaf-46af-98e2-83812472ca99 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:13.824404 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e1705-5eaf-46af-98e2-83812472ca99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:13.824706 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769e1705-5eaf-46af-98e2-83812472ca99 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:13.832767 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e1705-5eaf-46af-98e2-83812472ca99 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:13.835042 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769e1705-5eaf-46af-98e2-83812472ca99 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:13.849865 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-769e1705-5eaf-46af-98e2-83812472ca99 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:04:13.851261 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 581/1167] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:04:13 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:13.858097 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b6daa-f492-4c86-8f94-5828cc54b511 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:13.869573 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b6daa-f492-4c86-8f94-5828cc54b511 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:13.874941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4da08-789e-42cf-83a6-bd57a9d82ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:13.875668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4da08-789e-42cf-83a6-bd57a9d82ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:13.876005 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4da08-789e-42cf-83a6-bd57a9d82ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:13.876288 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4da08-789e-42cf-83a6-bd57a9d82ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:13.877181 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4da08-789e-42cf-83a6-bd57a9d82ed0 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:13.877577 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4da08-789e-42cf-83a6-bd57a9d82ed0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:13.879751 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b4da08-789e-42cf-83a6-bd57a9d82ed0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:13.893791 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 587/1168] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:04:13 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:04:13.900733 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e1705-5eaf-46af-98e2-83812472ca99 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:13.911106 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769e1705-5eaf-46af-98e2-83812472ca99 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:13.915956 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57102627-bd1d-466c-95eb-5384e2fe1f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:13.916836 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57102627-bd1d-466c-95eb-5384e2fe1f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:13.917117 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57102627-bd1d-466c-95eb-5384e2fe1f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:13.917780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57102627-bd1d-466c-95eb-5384e2fe1f69 admin admin] PATH_INFO: `/v3/projects/4939afba2b604181b67577f309c9550a/users/34c34efa8fd24230aa45e0f67209260e/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:13.919892 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57102627-bd1d-466c-95eb-5384e2fe1f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4939afba2b604181b67577f309c9550a, user_id=34c34efa8fd24230aa45e0f67209260e, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:13.922647 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57102627-bd1d-466c-95eb-5384e2fe1f69 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:13.936122 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 582/1169] 10.222.0.41 () {58 vars in 1460 bytes} [Fri Oct 29 16:04:13 2021] PUT /identity/v3/projects/4939afba2b604181b67577f309c9550a/users/34c34efa8fd24230aa45e0f67209260e/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:04:16.250580 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fef01d-5e57-4a75-8a85-0c671f4a25ce None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:16.251107 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fef01d-5e57-4a75-8a85-0c671f4a25ce None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:16.251201 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fef01d-5e57-4a75-8a85-0c671f4a25ce None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:16.252915 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 588/1170] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:04:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:04:16.258842 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb7028-42f9-4baf-bb78-3f1fb2365468 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:16.259260 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb7028-42f9-4baf-bb78-3f1fb2365468 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:16.259367 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb7028-42f9-4baf-bb78-3f1fb2365468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:16.276486 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-a5bb7028-42f9-4baf-bb78-3f1fb2365468 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:04:16.277677 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a5bb7028-42f9-4baf-bb78-3f1fb2365468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:04:16.332571 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 583/1171] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:04:16 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:04:16.356502 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fef01d-5e57-4a75-8a85-0c671f4a25ce None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:16.368450 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fef01d-5e57-4a75-8a85-0c671f4a25ce None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:16.373312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a41c85-f0df-4c73-b131-7017e3dc0f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:16.374120 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a41c85-f0df-4c73-b131-7017e3dc0f63 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:16.374404 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a41c85-f0df-4c73-b131-7017e3dc0f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:16.374729 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a41c85-f0df-4c73-b131-7017e3dc0f63 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:16.384526 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a41c85-f0df-4c73-b131-7017e3dc0f63 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 29 16:04:16.391906 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-c7a41c85-f0df-4c73-b131-7017e3dc0f63 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 29 16:04:16.393034 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 589/1172] 10.222.0.41 () {56 vars in 1117 bytes} [Fri Oct 29 16:04:16 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:16.399224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb7028-42f9-4baf-bb78-3f1fb2365468 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:16.407848 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb7028-42f9-4baf-bb78-3f1fb2365468 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:16.412258 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2808b-0726-4b75-9d78-bf2589617a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:16.412896 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2808b-0726-4b75-9d78-bf2589617a4f admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:16.413176 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2808b-0726-4b75-9d78-bf2589617a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:16.413447 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2808b-0726-4b75-9d78-bf2589617a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:16.414242 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2808b-0726-4b75-9d78-bf2589617a4f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:16.414549 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2808b-0726-4b75-9d78-bf2589617a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:16.416143 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2808b-0726-4b75-9d78-bf2589617a4f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:16.424014 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 584/1173] 10.222.0.41 () {56 vars in 1120 bytes} [Fri Oct 29 16:04:16 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:16.430011 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a41c85-f0df-4c73-b131-7017e3dc0f63 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:16.440284 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a41c85-f0df-4c73-b131-7017e3dc0f63 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:16.444780 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d4c1c-22eb-4b17-868c-2d37ff35516a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:16.445518 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d4c1c-22eb-4b17-868c-2d37ff35516a admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:16.445798 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d4c1c-22eb-4b17-868c-2d37ff35516a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:16.446097 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d4c1c-22eb-4b17-868c-2d37ff35516a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:16.456676 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d4c1c-22eb-4b17-868c-2d37ff35516a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:16.458545 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d4c1c-22eb-4b17-868c-2d37ff35516a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:16.474536 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-871d4c1c-22eb-4b17-868c-2d37ff35516a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:04:16.475623 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 590/1174] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:04:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:16.481688 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2808b-0726-4b75-9d78-bf2589617a4f admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:16.491011 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2808b-0726-4b75-9d78-bf2589617a4f admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:16.496112 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce617e5-494f-4928-b120-fdac20a5f987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:16.496739 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce617e5-494f-4928-b120-fdac20a5f987 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:16.497021 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce617e5-494f-4928-b120-fdac20a5f987 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:16.497298 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce617e5-494f-4928-b120-fdac20a5f987 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:16.498060 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce617e5-494f-4928-b120-fdac20a5f987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:16.498366 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce617e5-494f-4928-b120-fdac20a5f987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:16.499938 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce617e5-494f-4928-b120-fdac20a5f987 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:16.511972 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 585/1175] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:04:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:16.518019 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d4c1c-22eb-4b17-868c-2d37ff35516a admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:16.527398 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d4c1c-22eb-4b17-868c-2d37ff35516a admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:16.531882 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18127878-4b67-4d95-b8de-6d5cc14c36cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:16.532635 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18127878-4b67-4d95-b8de-6d5cc14c36cb admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:16.532916 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18127878-4b67-4d95-b8de-6d5cc14c36cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:16.533190 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18127878-4b67-4d95-b8de-6d5cc14c36cb admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:16.540256 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18127878-4b67-4d95-b8de-6d5cc14c36cb admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:16.542808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18127878-4b67-4d95-b8de-6d5cc14c36cb admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:16.556421 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-18127878-4b67-4d95-b8de-6d5cc14c36cb admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 29 16:04:16.557513 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 591/1176] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:04:16 2021] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:16.563900 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce617e5-494f-4928-b120-fdac20a5f987 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:16.573230 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce617e5-494f-4928-b120-fdac20a5f987 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:16.578068 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c0e30-c9da-4cc8-bff0-4bbbfad2222b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:16.578703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c0e30-c9da-4cc8-bff0-4bbbfad2222b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:16.578986 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c0e30-c9da-4cc8-bff0-4bbbfad2222b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:16.579262 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c0e30-c9da-4cc8-bff0-4bbbfad2222b admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:16.580100 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c0e30-c9da-4cc8-bff0-4bbbfad2222b admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:16.580405 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c0e30-c9da-4cc8-bff0-4bbbfad2222b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:16.582253 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c0e30-c9da-4cc8-bff0-4bbbfad2222b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:16.598627 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 586/1177] 10.222.0.41 () {56 vars in 1164 bytes} [Fri Oct 29 16:04:16 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:04:16.604590 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18127878-4b67-4d95-b8de-6d5cc14c36cb admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:16.616129 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18127878-4b67-4d95-b8de-6d5cc14c36cb admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:16.623389 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa187fa-8211-4b26-847c-872ce68352e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:16.624315 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa187fa-8211-4b26-847c-872ce68352e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:16.624703 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa187fa-8211-4b26-847c-872ce68352e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:16.625243 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa187fa-8211-4b26-847c-872ce68352e2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:16.636104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa187fa-8211-4b26-847c-872ce68352e2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:16.638306 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa187fa-8211-4b26-847c-872ce68352e2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:16.650735 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 592/1178] 10.222.0.41 () {58 vars in 1324 bytes} [Fri Oct 29 16:04:16 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:04:16.657320 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c0e30-c9da-4cc8-bff0-4bbbfad2222b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:16.666830 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c0e30-c9da-4cc8-bff0-4bbbfad2222b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:16.671926 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266b00a-43ab-4681-b077-6a3b3d28099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:16.672690 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266b00a-43ab-4681-b077-6a3b3d28099a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:16.672974 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266b00a-43ab-4681-b077-6a3b3d28099a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:16.673251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266b00a-43ab-4681-b077-6a3b3d28099a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:16.683751 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266b00a-43ab-4681-b077-6a3b3d28099a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:16.685576 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266b00a-43ab-4681-b077-6a3b3d28099a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:16.702753 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-a266b00a-43ab-4681-b077-6a3b3d28099a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 29 16:04:16.703866 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 587/1179] 10.222.0.41 () {56 vars in 1129 bytes} [Fri Oct 29 16:04:16 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:16.709873 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa187fa-8211-4b26-847c-872ce68352e2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:16.718520 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa187fa-8211-4b26-847c-872ce68352e2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:16.723053 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2980011-0c20-494c-8e4b-086b39131dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:16.723690 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2980011-0c20-494c-8e4b-086b39131dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:16.723972 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2980011-0c20-494c-8e4b-086b39131dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:16.724246 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2980011-0c20-494c-8e4b-086b39131dd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:16.724971 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2980011-0c20-494c-8e4b-086b39131dd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:16.725275 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2980011-0c20-494c-8e4b-086b39131dd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:16.726883 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2980011-0c20-494c-8e4b-086b39131dd7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:16.738347 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 593/1180] 10.222.0.41 () {56 vars in 1130 bytes} [Fri Oct 29 16:04:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:16.744197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266b00a-43ab-4681-b077-6a3b3d28099a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:16.754157 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266b00a-43ab-4681-b077-6a3b3d28099a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:16.758605 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87024763-f164-4a91-9a9f-ca8b1eb9b962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:16.759338 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87024763-f164-4a91-9a9f-ca8b1eb9b962 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:16.759624 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87024763-f164-4a91-9a9f-ca8b1eb9b962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:16.759898 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87024763-f164-4a91-9a9f-ca8b1eb9b962 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:16.766601 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87024763-f164-4a91-9a9f-ca8b1eb9b962 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:16.768477 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87024763-f164-4a91-9a9f-ca8b1eb9b962 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:16.780964 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-87024763-f164-4a91-9a9f-ca8b1eb9b962 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 29 16:04:16.782122 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 588/1181] 10.222.0.41 () {56 vars in 1132 bytes} [Fri Oct 29 16:04:16 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:16.788315 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2980011-0c20-494c-8e4b-086b39131dd7 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:16.798550 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2980011-0c20-494c-8e4b-086b39131dd7 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:16.803018 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e194d-9afc-4994-bfa0-38cfb7d3fc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:16.803658 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e194d-9afc-4994-bfa0-38cfb7d3fc7f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:16.803946 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e194d-9afc-4994-bfa0-38cfb7d3fc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:16.804223 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e194d-9afc-4994-bfa0-38cfb7d3fc7f admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:16.805013 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e194d-9afc-4994-bfa0-38cfb7d3fc7f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:16.805322 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e194d-9afc-4994-bfa0-38cfb7d3fc7f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:16.807193 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e194d-9afc-4994-bfa0-38cfb7d3fc7f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:16.819423 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 594/1182] 10.222.0.41 () {56 vars in 1169 bytes} [Fri Oct 29 16:04:16 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:04:16.825573 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87024763-f164-4a91-9a9f-ca8b1eb9b962 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:16.835748 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87024763-f164-4a91-9a9f-ca8b1eb9b962 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:16.840165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd84751-1a31-42a6-97cc-0eb878e70083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:16.840771 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd84751-1a31-42a6-97cc-0eb878e70083 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:16.841053 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd84751-1a31-42a6-97cc-0eb878e70083 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:16.841326 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd84751-1a31-42a6-97cc-0eb878e70083 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:16.842190 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd84751-1a31-42a6-97cc-0eb878e70083 admin admin] RBAC: Adding query filter params (role.id=f28d3f93a0524078a592a15459808378, scope.project.id=4939afba2b604181b67577f309c9550a, user.id=34c34efa8fd24230aa45e0f67209260e) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:16.842500 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd84751-1a31-42a6-97cc-0eb878e70083 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:16.844294 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd84751-1a31-42a6-97cc-0eb878e70083 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:16.849794 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 589/1183] 10.222.0.41 () {56 vars in 1395 bytes} [Fri Oct 29 16:04:16 2021] GET /identity/v3/role_assignments?user.id=34c34efa8fd24230aa45e0f67209260e&scope.project.id=4939afba2b604181b67577f309c9550a&role.id=f28d3f93a0524078a592a15459808378 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:19.094224 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7314d4-1707-423c-bd3a-9a84b2336b2e None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:19.094727 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7314d4-1707-423c-bd3a-9a84b2336b2e None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:19.094843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7314d4-1707-423c-bd3a-9a84b2336b2e None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:19.096538 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 595/1184] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:04:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:04:19.102379 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84103453-8cb9-46ab-824a-ca72515cf947 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:19.102782 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84103453-8cb9-46ab-824a-ca72515cf947 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:19.102918 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84103453-8cb9-46ab-824a-ca72515cf947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:19.119948 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-84103453-8cb9-46ab-824a-ca72515cf947 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:04:19.121708 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-84103453-8cb9-46ab-824a-ca72515cf947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:04:19.129148 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 590/1185] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:04:19 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:04:19.152178 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7314d4-1707-423c-bd3a-9a84b2336b2e None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:19.164049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7314d4-1707-423c-bd3a-9a84b2336b2e None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:19.168813 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968263a-b305-430e-b216-590bf997e893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:19.169565 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968263a-b305-430e-b216-590bf997e893 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:19.169841 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968263a-b305-430e-b216-590bf997e893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:19.170142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968263a-b305-430e-b216-590bf997e893 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:19.170793 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968263a-b305-430e-b216-590bf997e893 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:19.172500 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1968263a-b305-430e-b216-590bf997e893 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:19.183035 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-1968263a-b305-430e-b216-590bf997e893 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 16:04:19.184117 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 596/1186] 10.222.0.41 () {56 vars in 1138 bytes} [Fri Oct 29 16:04:19 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:19.190341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84103453-8cb9-46ab-824a-ca72515cf947 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:19.199021 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84103453-8cb9-46ab-824a-ca72515cf947 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:19.203749 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30f64db-a095-464a-853e-c9b292af33cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:19.204382 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f64db-a095-464a-853e-c9b292af33cd admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:19.204662 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f64db-a095-464a-853e-c9b292af33cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:19.204936 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f64db-a095-464a-853e-c9b292af33cd admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:19.205644 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f64db-a095-464a-853e-c9b292af33cd admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:19.205977 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f64db-a095-464a-853e-c9b292af33cd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:19.207542 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30f64db-a095-464a-853e-c9b292af33cd admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:19.212132 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 591/1187] 10.222.0.41 () {56 vars in 1137 bytes} [Fri Oct 29 16:04:19 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:04:19.218359 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968263a-b305-430e-b216-590bf997e893 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:19.227495 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1968263a-b305-430e-b216-590bf997e893 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:19.232596 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efced6-a4f9-44a8-8079-55c18aceddf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:19.233214 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efced6-a4f9-44a8-8079-55c18aceddf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:19.233493 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efced6-a4f9-44a8-8079-55c18aceddf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:19.233766 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efced6-a4f9-44a8-8079-55c18aceddf6 admin admin] PATH_INFO: `/v3/services` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:19.234496 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efced6-a4f9-44a8-8079-55c18aceddf6 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:19.234798 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efced6-a4f9-44a8-8079-55c18aceddf6 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:19.236336 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efced6-a4f9-44a8-8079-55c18aceddf6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:19.240522 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 597/1188] 10.222.0.41 () {56 vars in 1137 bytes} [Fri Oct 29 16:04:19 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:21.454831 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cf88b-cec9-4c02-bf9a-0e38344f66c0 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:21.455381 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cf88b-cec9-4c02-bf9a-0e38344f66c0 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:21.455381 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cf88b-cec9-4c02-bf9a-0e38344f66c0 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:21.457115 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 592/1189] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:04:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:04:21.462865 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a9776-2b1d-45cb-a1e6-3b577ac69a6a None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:21.463253 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a9776-2b1d-45cb-a1e6-3b577ac69a6a None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:21.463414 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192a9776-2b1d-45cb-a1e6-3b577ac69a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:21.480586 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-192a9776-2b1d-45cb-a1e6-3b577ac69a6a None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:04:21.481762 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-192a9776-2b1d-45cb-a1e6-3b577ac69a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:04:21.489286 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 598/1190] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:04:21 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:04:21.513421 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cf88b-cec9-4c02-bf9a-0e38344f66c0 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:21.525158 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cf88b-cec9-4c02-bf9a-0e38344f66c0 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:21.529488 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d20ac04-1aec-4285-b4d0-6f710cb7e354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:21.530140 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20ac04-1aec-4285-b4d0-6f710cb7e354 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:21.530420 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20ac04-1aec-4285-b4d0-6f710cb7e354 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:21.530689 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d20ac04-1aec-4285-b4d0-6f710cb7e354 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:21.531410 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20ac04-1aec-4285-b4d0-6f710cb7e354 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:21.532962 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d20ac04-1aec-4285-b4d0-6f710cb7e354 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:21.545268 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 593/1191] 10.222.0.41 () {60 vars in 1162 bytes} [Fri Oct 29 16:04:21 2021] POST /identity/v3/services => generated 246 bytes in 32 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:04:23.790654 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b099112-28ae-4d63-8b9b-e87898cdbf6f None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:23.791059 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b099112-28ae-4d63-8b9b-e87898cdbf6f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:23.791200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b099112-28ae-4d63-8b9b-e87898cdbf6f None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:23.793541 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 599/1192] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:04:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:04:23.799429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec456c-734d-4051-bf9f-e3eb74b54f66 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:23.799828 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec456c-734d-4051-bf9f-e3eb74b54f66 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:23.799980 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec456c-734d-4051-bf9f-e3eb74b54f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:23.817205 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-daec456c-734d-4051-bf9f-e3eb74b54f66 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:04:23.818426 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-daec456c-734d-4051-bf9f-e3eb74b54f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:04:23.834816 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 594/1193] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:04:23 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:04:23.859125 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b099112-28ae-4d63-8b9b-e87898cdbf6f None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:23.870837 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b099112-28ae-4d63-8b9b-e87898cdbf6f None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:23.875107 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8b772-f5dd-4f46-a209-69aa29fc2a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:23.875866 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8b772-f5dd-4f46-a209-69aa29fc2a5e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:23.876142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8b772-f5dd-4f46-a209-69aa29fc2a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:23.876411 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8b772-f5dd-4f46-a209-69aa29fc2a5e admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:23.877059 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8b772-f5dd-4f46-a209-69aa29fc2a5e admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:23.878666 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8b772-f5dd-4f46-a209-69aa29fc2a5e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:23.889132 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-ecd8b772-f5dd-4f46-a209-69aa29fc2a5e admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 16:04:23.890394 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 600/1194] 10.222.0.41 () {56 vars in 1138 bytes} [Fri Oct 29 16:04:23 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 29 16:04:23.896536 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec456c-734d-4051-bf9f-e3eb74b54f66 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:23.905573 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec456c-734d-4051-bf9f-e3eb74b54f66 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:23.910010 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b3c82-2bd3-453d-b515-82d6e70aa462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:23.910643 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b3c82-2bd3-453d-b515-82d6e70aa462 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:23.910925 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b3c82-2bd3-453d-b515-82d6e70aa462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:23.911201 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b3c82-2bd3-453d-b515-82d6e70aa462 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:23.911912 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b3c82-2bd3-453d-b515-82d6e70aa462 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:23.912216 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b3c82-2bd3-453d-b515-82d6e70aa462 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:23.913779 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b3c82-2bd3-453d-b515-82d6e70aa462 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:23.919391 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 595/1195] 10.222.0.41 () {56 vars in 1137 bytes} [Fri Oct 29 16:04:23 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:23.925255 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8b772-f5dd-4f46-a209-69aa29fc2a5e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:23.934451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8b772-f5dd-4f46-a209-69aa29fc2a5e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:23.938921 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c985d2-07a8-492b-83a9-5ed4d1ff2be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:23.939540 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c985d2-07a8-492b-83a9-5ed4d1ff2be2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:23.939825 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c985d2-07a8-492b-83a9-5ed4d1ff2be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:23.940100 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c985d2-07a8-492b-83a9-5ed4d1ff2be2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:23.940885 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c985d2-07a8-492b-83a9-5ed4d1ff2be2 admin admin] RBAC: Adding query filter params (interface=public, service_id=61a66dcbe183421b829d971c960c952a, region_id=RegionOne) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:23.941191 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c985d2-07a8-492b-83a9-5ed4d1ff2be2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:23.942768 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c985d2-07a8-492b-83a9-5ed4d1ff2be2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:23.947606 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 601/1196] 10.222.0.41 () {56 vars in 1272 bytes} [Fri Oct 29 16:04:23 2021] GET /identity/v3/endpoints?service_id=61a66dcbe183421b829d971c960c952a&interface=public®ion_id=RegionOne => generated 194 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:23.953621 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b3c82-2bd3-453d-b515-82d6e70aa462 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:23.962637 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b3c82-2bd3-453d-b515-82d6e70aa462 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:23.967639 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c80c9c-88ba-4556-a5af-4d094d015e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:23.968246 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c80c9c-88ba-4556-a5af-4d094d015e04 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:23.968527 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c80c9c-88ba-4556-a5af-4d094d015e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:23.968802 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c80c9c-88ba-4556-a5af-4d094d015e04 admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:23.969469 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c80c9c-88ba-4556-a5af-4d094d015e04 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:23.971089 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c80c9c-88ba-4556-a5af-4d094d015e04 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:23.977595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 596/1197] 10.222.0.41 () {56 vars in 1108 bytes} [Fri Oct 29 16:04:23 2021] GET /identity/v3/services => generated 2191 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:04:26.194523 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c39882-2321-48ce-8a31-0b3f574cb4ef None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:26.195050 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c39882-2321-48ce-8a31-0b3f574cb4ef None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:26.195146 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c39882-2321-48ce-8a31-0b3f574cb4ef None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:26.196890 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 602/1198] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:04:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:04:26.203730 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f711d39-0d0f-43e4-b693-80eb5079d4c8 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:26.204119 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f711d39-0d0f-43e4-b693-80eb5079d4c8 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:26.204275 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f711d39-0d0f-43e4-b693-80eb5079d4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:26.221287 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-1f711d39-0d0f-43e4-b693-80eb5079d4c8 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:04:26.222530 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1f711d39-0d0f-43e4-b693-80eb5079d4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:04:26.230080 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 597/1199] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:04:26 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:04:26.254234 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c39882-2321-48ce-8a31-0b3f574cb4ef None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:26.266491 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c39882-2321-48ce-8a31-0b3f574cb4ef None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:26.270717 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bc464-e924-4e5a-8869-8a4d129efb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:26.271474 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bc464-e924-4e5a-8869-8a4d129efb9a admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:26.271750 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bc464-e924-4e5a-8869-8a4d129efb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:26.272017 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53bc464-e924-4e5a-8869-8a4d129efb9a admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:26.272664 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bc464-e924-4e5a-8869-8a4d129efb9a admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:26.274252 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53bc464-e924-4e5a-8869-8a4d129efb9a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:26.284710 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-f53bc464-e924-4e5a-8869-8a4d129efb9a admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 29 16:04:26.285791 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 603/1200] 10.222.0.41 () {56 vars in 1138 bytes} [Fri Oct 29 16:04:26 2021] GET /identity/v3/services/placement => generated 90 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 29 16:04:26.292687 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f711d39-0d0f-43e4-b693-80eb5079d4c8 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:26.301385 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f711d39-0d0f-43e4-b693-80eb5079d4c8 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:26.305941 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb3441-918f-4ffa-8e72-1ab17a4a2afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:26.306575 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb3441-918f-4ffa-8e72-1ab17a4a2afb admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:26.306851 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb3441-918f-4ffa-8e72-1ab17a4a2afb admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:26.307117 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb3441-918f-4ffa-8e72-1ab17a4a2afb admin admin] PATH_INFO: `/v3/services` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:26.308369 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb3441-918f-4ffa-8e72-1ab17a4a2afb admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:04:26.308668 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb3441-918f-4ffa-8e72-1ab17a4a2afb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:26.310261 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb3441-918f-4ffa-8e72-1ab17a4a2afb admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:26.315253 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 598/1201] 10.222.0.41 () {56 vars in 1137 bytes} [Fri Oct 29 16:04:26 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:04:26.320960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bc464-e924-4e5a-8869-8a4d129efb9a admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:04:26.330735 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53bc464-e924-4e5a-8869-8a4d129efb9a admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:04:26.335084 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bc8567-9446-45e6-b13c-73aaa07a40c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:04:26.335686 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc8567-9446-45e6-b13c-73aaa07a40c6 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:04:26.335964 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc8567-9446-45e6-b13c-73aaa07a40c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:04:26.336238 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bc8567-9446-45e6-b13c-73aaa07a40c6 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:04:26.336969 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc8567-9446-45e6-b13c-73aaa07a40c6 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:04:26.338568 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bc8567-9446-45e6-b13c-73aaa07a40c6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:04:26.356251 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 604/1202] 10.222.0.41 () {60 vars in 1165 bytes} [Fri Oct 29 16:04:26 2021] POST /identity/v3/endpoints => generated 331 bytes in 36 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:05:29.419510 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf964-0f57-45ad-9b4f-cfa1337c5448 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:29.419984 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf964-0f57-45ad-9b4f-cfa1337c5448 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:29.420206 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daf964-0f57-45ad-9b4f-cfa1337c5448 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:29.422143 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 599/1203] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:05:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:05:29.430194 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00e238-3a41-47fb-8269-08b7d1e36299 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:29.431123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00e238-3a41-47fb-8269-08b7d1e36299 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:29.431559 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b00e238-3a41-47fb-8269-08b7d1e36299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:29.526329 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-3b00e238-3a41-47fb-8269-08b7d1e36299 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:05:29.527674 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-3b00e238-3a41-47fb-8269-08b7d1e36299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:29.689579 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 605/1204] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:05:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:05:29.713875 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daf964-0f57-45ad-9b4f-cfa1337c5448 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:05:29.715872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-b8daf964-0f57-45ad-9b4f-cfa1337c5448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:29.870235 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8daf964-0f57-45ad-9b4f-cfa1337c5448 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:05:29.965426 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f388ec-95dd-43cb-8892-00e723709b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:05:29.966444 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f388ec-95dd-43cb-8892-00e723709b99 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:29.966872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f388ec-95dd-43cb-8892-00e723709b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:29.967299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f388ec-95dd-43cb-8892-00e723709b99 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:29.968180 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f388ec-95dd-43cb-8892-00e723709b99 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:05:29.970251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f388ec-95dd-43cb-8892-00e723709b99 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:05:29.989557 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 600/1205] 10.222.0.41 () {56 vars in 1108 bytes} [Fri Oct 29 16:05:29 2021] GET /identity/v3/projects => generated 2553 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:05:32.268774 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929758-8ad6-4dde-91ea-568a7056147a None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:32.269326 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929758-8ad6-4dde-91ea-568a7056147a None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:32.269326 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929758-8ad6-4dde-91ea-568a7056147a None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:32.271159 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 606/1206] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:05:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:05:32.276900 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a496f5-71d0-44ea-b347-9cf24793c4d3 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:32.277283 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a496f5-71d0-44ea-b347-9cf24793c4d3 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:32.277451 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a496f5-71d0-44ea-b347-9cf24793c4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:32.357412 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-d3a496f5-71d0-44ea-b347-9cf24793c4d3 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:05:32.358624 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d3a496f5-71d0-44ea-b347-9cf24793c4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:32.448676 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 601/1207] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:05:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:05:32.499365 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb85861-4dc9-4f3c-bdea-05399ac3923b None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:32.499654 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb85861-4dc9-4f3c-bdea-05399ac3923b None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:32.499935 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb85861-4dc9-4f3c-bdea-05399ac3923b None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:32.501725 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 607/1208] 10.222.0.41 () {54 vars in 964 bytes} [Fri Oct 29 16:05:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:05:32.507706 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46437553-5e9c-4edf-bb2a-43c139fe0bfe None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:32.508504 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46437553-5e9c-4edf-bb2a-43c139fe0bfe None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:32.508779 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46437553-5e9c-4edf-bb2a-43c139fe0bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:32.579676 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-46437553-5e9c-4edf-bb2a-43c139fe0bfe None None] MFA Rules not processed for user `3bb8aa43328d4be08455441d0ffa4e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:05:32.580868 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-46437553-5e9c-4edf-bb2a-43c139fe0bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:32.653403 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 602/1209] 10.222.0.41 () {58 vars in 1061 bytes} [Fri Oct 29 16:05:32 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:05:32.663067 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb85861-4dc9-4f3c-bdea-05399ac3923b None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:05:32.664600 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-8bb85861-4dc9-4f3c-bdea-05399ac3923b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:32.763374 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb85861-4dc9-4f3c-bdea-05399ac3923b None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:05:32.832445 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5be159-c382-4103-ab5f-34be7a3ed04b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:05:32.833014 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5be159-c382-4103-ab5f-34be7a3ed04b service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:32.833291 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5be159-c382-4103-ab5f-34be7a3ed04b service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:32.833562 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5be159-c382-4103-ab5f-34be7a3ed04b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:32.835211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-6b5be159-c382-4103-ab5f-34be7a3ed04b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:32.939102 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5be159-c382-4103-ab5f-34be7a3ed04b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:05:32.940555 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5be159-c382-4103-ab5f-34be7a3ed04b service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:05:32.958767 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 608/1210] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:05:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:05:35.483573 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27517ca-d5f4-42b1-9020-58f2f3bdb386 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:35.484079 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27517ca-d5f4-42b1-9020-58f2f3bdb386 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:35.484282 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27517ca-d5f4-42b1-9020-58f2f3bdb386 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:35.485930 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 603/1211] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:05:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:05:35.492339 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400e455-f01f-401c-b00c-42f15b964a60 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:35.493236 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400e455-f01f-401c-b00c-42f15b964a60 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:35.493382 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9400e455-f01f-401c-b00c-42f15b964a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:35.553516 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-9400e455-f01f-401c-b00c-42f15b964a60 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:05:35.554770 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-9400e455-f01f-401c-b00c-42f15b964a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:35.651188 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 609/1212] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:05:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:05:35.690634 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27517ca-d5f4-42b1-9020-58f2f3bdb386 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:05:35.692154 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-f27517ca-d5f4-42b1-9020-58f2f3bdb386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:35.792404 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27517ca-d5f4-42b1-9020-58f2f3bdb386 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:05:35.863197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f1761-4ba3-4ecf-b28e-6dd07ce108cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:05:35.863843 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f1761-4ba3-4ecf-b28e-6dd07ce108cc service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:35.864126 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f1761-4ba3-4ecf-b28e-6dd07ce108cc service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:35.864402 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f1761-4ba3-4ecf-b28e-6dd07ce108cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:35.866062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-4b0f1761-4ba3-4ecf-b28e-6dd07ce108cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:35.969490 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f1761-4ba3-4ecf-b28e-6dd07ce108cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:05:35.970870 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f1761-4ba3-4ecf-b28e-6dd07ce108cc service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:05:35.988405 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 604/1213] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:05:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:05:38.550336 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b68794-435c-433f-ba60-7c52600a7cec None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:38.550928 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b68794-435c-433f-ba60-7c52600a7cec None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:38.550928 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b68794-435c-433f-ba60-7c52600a7cec None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:38.552642 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 610/1214] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:05:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:05:38.558553 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14960d4b-c50a-4392-8ef1-7379e531bc42 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:38.558982 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14960d4b-c50a-4392-8ef1-7379e531bc42 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:38.559100 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14960d4b-c50a-4392-8ef1-7379e531bc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:38.622027 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-14960d4b-c50a-4392-8ef1-7379e531bc42 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:05:38.623244 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-14960d4b-c50a-4392-8ef1-7379e531bc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:38.714010 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 605/1215] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:05:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:05:38.750231 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b68794-435c-433f-ba60-7c52600a7cec None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:05:38.751772 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c6b68794-435c-433f-ba60-7c52600a7cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:38.868738 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b68794-435c-433f-ba60-7c52600a7cec None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:05:38.955709 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1e2a3-731e-4c5c-b1cd-a6a6d5d87c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:05:38.956577 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1e2a3-731e-4c5c-b1cd-a6a6d5d87c7d admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:38.956854 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1e2a3-731e-4c5c-b1cd-a6a6d5d87c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:38.957126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1e2a3-731e-4c5c-b1cd-a6a6d5d87c7d admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:38.967143 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1e2a3-731e-4c5c-b1cd-a6a6d5d87c7d admin admin] RBAC: Authorizing `identity:get_project(project_id=77d119a645a14cd79d87aae94a06ec80)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:05:38.969260 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf1e2a3-731e-4c5c-b1cd-a6a6d5d87c7d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:05:38.971007 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 611/1216] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:05:38 2021] GET /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:05:38.984274 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14960d4b-c50a-4392-8ef1-7379e531bc42 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:05:38.985459 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-14960d4b-c50a-4392-8ef1-7379e531bc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:39.071479 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14960d4b-c50a-4392-8ef1-7379e531bc42 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:05:39.140939 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eab059-98c8-49a7-809c-68f520cdc971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:05:39.141510 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eab059-98c8-49a7-809c-68f520cdc971 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:39.141802 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eab059-98c8-49a7-809c-68f520cdc971 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:39.142086 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eab059-98c8-49a7-809c-68f520cdc971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:39.143679 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-f8eab059-98c8-49a7-809c-68f520cdc971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:39.246136 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eab059-98c8-49a7-809c-68f520cdc971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:05:39.247541 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eab059-98c8-49a7-809c-68f520cdc971 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:05:39.264533 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 606/1217] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:05:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:05:42.015951 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb60c6-9f26-42cb-bf67-180291cddcc3 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:42.016496 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb60c6-9f26-42cb-bf67-180291cddcc3 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:42.016496 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb60c6-9f26-42cb-bf67-180291cddcc3 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:42.018316 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 612/1218] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:05:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:05:42.024670 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8af1b2-8d01-4065-8cf3-3ebb5c9f5007 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:42.025081 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8af1b2-8d01-4065-8cf3-3ebb5c9f5007 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:42.025224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8af1b2-8d01-4065-8cf3-3ebb5c9f5007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:42.087405 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-9e8af1b2-8d01-4065-8cf3-3ebb5c9f5007 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:05:42.088611 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-9e8af1b2-8d01-4065-8cf3-3ebb5c9f5007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:42.179290 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 607/1219] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:05:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:05:42.215109 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb60c6-9f26-42cb-bf67-180291cddcc3 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:05:42.216601 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-83cb60c6-9f26-42cb-bf67-180291cddcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:42.333333 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb60c6-9f26-42cb-bf67-180291cddcc3 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:05:42.419757 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e53700-0620-48c6-b715-d5661150ef94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:05:42.420515 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e53700-0620-48c6-b715-d5661150ef94 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:42.420790 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e53700-0620-48c6-b715-d5661150ef94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:42.421056 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e53700-0620-48c6-b715-d5661150ef94 admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:42.430868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e53700-0620-48c6-b715-d5661150ef94 admin admin] RBAC: Authorizing `identity:get_project(project_id=77d119a645a14cd79d87aae94a06ec80)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:05:42.432900 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e53700-0620-48c6-b715-d5661150ef94 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:05:42.434725 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 613/1220] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:05:42 2021] GET /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:05:42.447491 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8af1b2-8d01-4065-8cf3-3ebb5c9f5007 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:05:42.448689 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-9e8af1b2-8d01-4065-8cf3-3ebb5c9f5007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:42.533549 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8af1b2-8d01-4065-8cf3-3ebb5c9f5007 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:05:42.602322 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18374897-1a20-469e-9a2c-b3f7e85281be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:05:42.602989 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18374897-1a20-469e-9a2c-b3f7e85281be service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:42.603266 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18374897-1a20-469e-9a2c-b3f7e85281be service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:42.603535 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18374897-1a20-469e-9a2c-b3f7e85281be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:42.605146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-18374897-1a20-469e-9a2c-b3f7e85281be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:42.709002 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18374897-1a20-469e-9a2c-b3f7e85281be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:05:42.710380 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18374897-1a20-469e-9a2c-b3f7e85281be service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:05:42.727601 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 608/1221] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:05:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:05:45.648629 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27263055-b6e6-4d64-8792-b97666162f4f None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:45.649138 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27263055-b6e6-4d64-8792-b97666162f4f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:45.649138 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27263055-b6e6-4d64-8792-b97666162f4f None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:45.650936 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 614/1222] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:05:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:05:45.657480 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3e162-8f60-4cd2-854e-0f1955e2b3a0 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:45.658052 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3e162-8f60-4cd2-854e-0f1955e2b3a0 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:45.658148 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3e162-8f60-4cd2-854e-0f1955e2b3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:45.723911 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-cef3e162-8f60-4cd2-854e-0f1955e2b3a0 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:05:45.725133 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-cef3e162-8f60-4cd2-854e-0f1955e2b3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:45.818898 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 609/1223] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:05:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:05:45.856639 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27263055-b6e6-4d64-8792-b97666162f4f None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:05:45.858164 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-27263055-b6e6-4d64-8792-b97666162f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:45.957131 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27263055-b6e6-4d64-8792-b97666162f4f None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:05:46.026301 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca7ae2-7c59-4a65-bb2e-4fd172fcdafd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:05:46.026949 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca7ae2-7c59-4a65-bb2e-4fd172fcdafd service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:46.027228 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca7ae2-7c59-4a65-bb2e-4fd172fcdafd service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:46.027499 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca7ae2-7c59-4a65-bb2e-4fd172fcdafd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:46.029109 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c5ca7ae2-7c59-4a65-bb2e-4fd172fcdafd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:46.132188 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca7ae2-7c59-4a65-bb2e-4fd172fcdafd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:05:46.134238 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca7ae2-7c59-4a65-bb2e-4fd172fcdafd service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:05:46.151819 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 615/1224] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:05:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:05:48.463703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469418c8-c9f1-49dc-9e52-56fe3fb0c2b6 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:48.464199 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469418c8-c9f1-49dc-9e52-56fe3fb0c2b6 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:48.464199 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469418c8-c9f1-49dc-9e52-56fe3fb0c2b6 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:48.466109 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 610/1225] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:05:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:05:48.471864 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b504437-163b-46dc-93fe-2ef37aaf33b5 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:48.472310 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b504437-163b-46dc-93fe-2ef37aaf33b5 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:48.472415 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b504437-163b-46dc-93fe-2ef37aaf33b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:48.534764 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-7b504437-163b-46dc-93fe-2ef37aaf33b5 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:05:48.535941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-7b504437-163b-46dc-93fe-2ef37aaf33b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:48.626156 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 616/1226] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:05:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:05:48.679023 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571715-4c6c-4602-a722-b83f1873508b None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:48.679344 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571715-4c6c-4602-a722-b83f1873508b None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:48.679612 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca571715-4c6c-4602-a722-b83f1873508b None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:48.681371 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 611/1227] 10.222.0.41 () {54 vars in 964 bytes} [Fri Oct 29 16:05:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:05:48.687648 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ecb1f-93c3-4568-9144-ceb2a5b39039 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:48.688007 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ecb1f-93c3-4568-9144-ceb2a5b39039 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:48.688352 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ecb1f-93c3-4568-9144-ceb2a5b39039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:48.760419 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e49ecb1f-93c3-4568-9144-ceb2a5b39039 None None] MFA Rules not processed for user `3bb8aa43328d4be08455441d0ffa4e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:05:48.761550 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e49ecb1f-93c3-4568-9144-ceb2a5b39039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:48.836836 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 617/1228] 10.222.0.41 () {58 vars in 1061 bytes} [Fri Oct 29 16:05:48 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:05:48.846565 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca571715-4c6c-4602-a722-b83f1873508b None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:05:48.848066 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-ca571715-4c6c-4602-a722-b83f1873508b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:48.950364 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca571715-4c6c-4602-a722-b83f1873508b None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:05:49.019828 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a053b229-52b0-4ba7-97fb-e478ae87c413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:05:49.020394 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053b229-52b0-4ba7-97fb-e478ae87c413 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:49.020672 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053b229-52b0-4ba7-97fb-e478ae87c413 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:49.020940 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a053b229-52b0-4ba7-97fb-e478ae87c413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:49.022592 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a053b229-52b0-4ba7-97fb-e478ae87c413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:49.126430 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053b229-52b0-4ba7-97fb-e478ae87c413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:05:49.127856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a053b229-52b0-4ba7-97fb-e478ae87c413 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:05:49.145972 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 612/1229] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:05:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:05:51.662309 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444760dd-2149-4f15-a515-a206c54c16a1 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:51.662864 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444760dd-2149-4f15-a515-a206c54c16a1 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:51.662947 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444760dd-2149-4f15-a515-a206c54c16a1 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:51.665426 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 618/1230] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:05:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:05:51.671365 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dd836-e997-4d3c-9f58-0ec8f945b483 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:51.671816 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dd836-e997-4d3c-9f58-0ec8f945b483 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:51.671928 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dd836-e997-4d3c-9f58-0ec8f945b483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:51.734278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-0c9dd836-e997-4d3c-9f58-0ec8f945b483 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:05:51.735468 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-0c9dd836-e997-4d3c-9f58-0ec8f945b483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:51.829638 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 613/1231] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:05:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:05:51.863523 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444760dd-2149-4f15-a515-a206c54c16a1 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:05:51.865076 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-444760dd-2149-4f15-a515-a206c54c16a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:51.985295 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444760dd-2149-4f15-a515-a206c54c16a1 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:05:52.072844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75478dcd-877e-4563-88ef-307354ef0af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:05:52.073714 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75478dcd-877e-4563-88ef-307354ef0af4 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:52.074022 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75478dcd-877e-4563-88ef-307354ef0af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:52.074298 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75478dcd-877e-4563-88ef-307354ef0af4 admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:52.084121 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75478dcd-877e-4563-88ef-307354ef0af4 admin admin] RBAC: Authorizing `identity:get_project(project_id=77d119a645a14cd79d87aae94a06ec80)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:05:52.086847 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75478dcd-877e-4563-88ef-307354ef0af4 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:05:52.088568 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 619/1232] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:05:51 2021] GET /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:05:52.100750 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dd836-e997-4d3c-9f58-0ec8f945b483 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:05:52.102044 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-0c9dd836-e997-4d3c-9f58-0ec8f945b483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:52.189896 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dd836-e997-4d3c-9f58-0ec8f945b483 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:05:52.259117 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37d5e4c-26da-411f-8755-8f11a71811d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:05:52.259761 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d5e4c-26da-411f-8755-8f11a71811d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:52.260041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d5e4c-26da-411f-8755-8f11a71811d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:52.260310 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37d5e4c-26da-411f-8755-8f11a71811d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:52.263242 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e37d5e4c-26da-411f-8755-8f11a71811d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:52.382183 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d5e4c-26da-411f-8755-8f11a71811d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:05:52.384290 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37d5e4c-26da-411f-8755-8f11a71811d4 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:05:52.403311 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 614/1233] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:05:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:05:55.048563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a5923-4915-4320-8edd-f726a98b7d9a None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:55.049060 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a5923-4915-4320-8edd-f726a98b7d9a None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:55.049060 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a5923-4915-4320-8edd-f726a98b7d9a None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:55.050866 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 620/1234] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:05:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:05:55.057343 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fb6b8-2f03-4ad0-b241-ca0cdfd9e9e7 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:55.057753 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fb6b8-2f03-4ad0-b241-ca0cdfd9e9e7 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:55.057911 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fb6b8-2f03-4ad0-b241-ca0cdfd9e9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:55.128820 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-7a7fb6b8-2f03-4ad0-b241-ca0cdfd9e9e7 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:05:55.130053 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7a7fb6b8-2f03-4ad0-b241-ca0cdfd9e9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:55.221437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 615/1235] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:05:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:05:55.258677 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a5923-4915-4320-8edd-f726a98b7d9a None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:05:55.260216 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-3f1a5923-4915-4320-8edd-f726a98b7d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:55.360464 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a5923-4915-4320-8edd-f726a98b7d9a None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:05:55.429932 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4725d6-32b5-41de-ae9b-a6e6f1d90dea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:05:55.430587 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4725d6-32b5-41de-ae9b-a6e6f1d90dea service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:55.430870 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4725d6-32b5-41de-ae9b-a6e6f1d90dea service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:55.431142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4725d6-32b5-41de-ae9b-a6e6f1d90dea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:55.432765 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-7b4725d6-32b5-41de-ae9b-a6e6f1d90dea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:55.538904 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4725d6-32b5-41de-ae9b-a6e6f1d90dea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:05:55.540337 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4725d6-32b5-41de-ae9b-a6e6f1d90dea service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:05:55.557421 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 621/1236] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:05:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:05:57.828075 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0b75d-b7a3-4813-971e-b12a5c9da45f None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:57.828570 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0b75d-b7a3-4813-971e-b12a5c9da45f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:57.828672 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0b75d-b7a3-4813-971e-b12a5c9da45f None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:57.830448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 616/1237] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:05:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:05:57.836284 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895d659-62de-4176-a876-293f47c31910 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:57.836712 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895d659-62de-4176-a876-293f47c31910 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:57.836831 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895d659-62de-4176-a876-293f47c31910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:57.900546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-c895d659-62de-4176-a876-293f47c31910 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:05:57.901749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c895d659-62de-4176-a876-293f47c31910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:57.992717 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 622/1238] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:05:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:05:58.034435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0b75d-b7a3-4813-971e-b12a5c9da45f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:05:58.035888 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-70e0b75d-b7a3-4813-971e-b12a5c9da45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:58.136125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0b75d-b7a3-4813-971e-b12a5c9da45f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:05:58.205145 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85112754-9d15-457b-811e-bbdfadeaf1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:05:58.205798 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85112754-9d15-457b-811e-bbdfadeaf1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:05:58.206106 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85112754-9d15-457b-811e-bbdfadeaf1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:05:58.206376 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85112754-9d15-457b-811e-bbdfadeaf1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:05:58.207967 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-85112754-9d15-457b-811e-bbdfadeaf1b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:05:58.310613 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85112754-9d15-457b-811e-bbdfadeaf1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:05:58.311960 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85112754-9d15-457b-811e-bbdfadeaf1b0 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:05:58.329440 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 617/1239] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:05:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:06:01.045659 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f853eb-9abc-4b14-b097-29911ce0a836 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:01.046122 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f853eb-9abc-4b14-b097-29911ce0a836 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:01.046222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f853eb-9abc-4b14-b097-29911ce0a836 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:01.048034 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 623/1240] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:06:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:01.054298 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d43e5-a5ce-4dd2-9f35-16a6433c4c14 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:01.054708 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d43e5-a5ce-4dd2-9f35-16a6433c4c14 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:01.054824 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d43e5-a5ce-4dd2-9f35-16a6433c4c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:01.123249 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-7a5d43e5-a5ce-4dd2-9f35-16a6433c4c14 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:01.124483 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7a5d43e5-a5ce-4dd2-9f35-16a6433c4c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:01.224772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 618/1241] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:06:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:01.262955 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f853eb-9abc-4b14-b097-29911ce0a836 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:06:01.265065 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-d2f853eb-9abc-4b14-b097-29911ce0a836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:01.354494 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f853eb-9abc-4b14-b097-29911ce0a836 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:06:01.358009 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4234ab-49c8-4ef3-bf7f-c693e5d51029 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:06:01.358647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4234ab-49c8-4ef3-bf7f-c693e5d51029 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:01.358929 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4234ab-49c8-4ef3-bf7f-c693e5d51029 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:01.359203 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4234ab-49c8-4ef3-bf7f-c693e5d51029 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:01.368329 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4234ab-49c8-4ef3-bf7f-c693e5d51029 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:06:01.369750 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4234ab-49c8-4ef3-bf7f-c693e5d51029 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:06:01.378879 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 624/1242] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:06:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:06:05.597555 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ef6cf-ec10-4a53-b5da-a38774a5cbbf None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:05.598273 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ef6cf-ec10-4a53-b5da-a38774a5cbbf None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:05.598273 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ef6cf-ec10-4a53-b5da-a38774a5cbbf None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:05.599940 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 619/1243] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:06:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:05.606352 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c909f2-690e-4ae7-8f56-8c8168c9828c None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:05.606837 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c909f2-690e-4ae7-8f56-8c8168c9828c None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:05.606944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c909f2-690e-4ae7-8f56-8c8168c9828c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:05.629171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e7c909f2-690e-4ae7-8f56-8c8168c9828c None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:05.630409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e7c909f2-690e-4ae7-8f56-8c8168c9828c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:05.639211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 625/1244] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:06:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:05.679348 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ef6cf-ec10-4a53-b5da-a38774a5cbbf None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:06:05.690581 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ef6cf-ec10-4a53-b5da-a38774a5cbbf None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:06:05.694851 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749403a6-fb18-4ca3-b37c-341b6232997d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:06:05.695498 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749403a6-fb18-4ca3-b37c-341b6232997d service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:05.695778 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749403a6-fb18-4ca3-b37c-341b6232997d service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:05.696049 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749403a6-fb18-4ca3-b37c-341b6232997d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:05.708854 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749403a6-fb18-4ca3-b37c-341b6232997d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:06:05.710349 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749403a6-fb18-4ca3-b37c-341b6232997d service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:06:05.719875 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 620/1245] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:06:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:06:08.593052 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbd8d3-d5fe-4cab-9d93-ee0d2630a3f3 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:08.593636 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbd8d3-d5fe-4cab-9d93-ee0d2630a3f3 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:08.593636 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbd8d3-d5fe-4cab-9d93-ee0d2630a3f3 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:08.595437 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 626/1246] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:06:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:06:08.602100 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f4cc3-a828-4c2e-a04d-dd7bf9a21170 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:08.602547 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f4cc3-a828-4c2e-a04d-dd7bf9a21170 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:08.602635 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f4cc3-a828-4c2e-a04d-dd7bf9a21170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:08.621707 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-4a3f4cc3-a828-4c2e-a04d-dd7bf9a21170 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:08.623090 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-4a3f4cc3-a828-4c2e-a04d-dd7bf9a21170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:08.633098 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 621/1247] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:06:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:08.675996 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbd8d3-d5fe-4cab-9d93-ee0d2630a3f3 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:06:08.688840 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbd8d3-d5fe-4cab-9d93-ee0d2630a3f3 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:06:08.692322 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f5ed2c-17cf-4c65-ad04-efd6c8ca0cfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:06:08.692960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5ed2c-17cf-4c65-ad04-efd6c8ca0cfd service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:08.693236 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5ed2c-17cf-4c65-ad04-efd6c8ca0cfd service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:08.693507 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f5ed2c-17cf-4c65-ad04-efd6c8ca0cfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:08.702737 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5ed2c-17cf-4c65-ad04-efd6c8ca0cfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:06:08.704166 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f5ed2c-17cf-4c65-ad04-efd6c8ca0cfd service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:06:08.714223 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 627/1248] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:06:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:06:13.005026 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d401f-a9ca-44bd-bef2-841311381b16 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:13.005548 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d401f-a9ca-44bd-bef2-841311381b16 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:13.005548 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341d401f-a9ca-44bd-bef2-841311381b16 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:13.007488 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 622/1249] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:06:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:06:13.013633 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f011e-2928-42cf-82be-9d95a43e499e None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:13.014245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f011e-2928-42cf-82be-9d95a43e499e None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:13.014245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f011e-2928-42cf-82be-9d95a43e499e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:13.031401 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-b54f011e-2928-42cf-82be-9d95a43e499e None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:13.032512 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b54f011e-2928-42cf-82be-9d95a43e499e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:13.040657 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 628/1250] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:06:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:13.080507 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d401f-a9ca-44bd-bef2-841311381b16 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:06:13.091556 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341d401f-a9ca-44bd-bef2-841311381b16 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:06:13.095046 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a83f748-4d33-4755-a893-19725c876281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:06:13.095673 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83f748-4d33-4755-a893-19725c876281 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:13.095959 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83f748-4d33-4755-a893-19725c876281 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:13.096234 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a83f748-4d33-4755-a893-19725c876281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:13.105946 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83f748-4d33-4755-a893-19725c876281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:06:13.107406 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a83f748-4d33-4755-a893-19725c876281 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:06:13.117299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 623/1251] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:06:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:06:18.146247 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61effd6-570e-4e15-b4e5-fdac6f10a67a None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:18.147793 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61effd6-570e-4e15-b4e5-fdac6f10a67a None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:18.148287 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61effd6-570e-4e15-b4e5-fdac6f10a67a None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:18.150372 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 629/1252] 10.222.0.41 () {54 vars in 921 bytes} [Fri Oct 29 16:06:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:18.160559 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22a09f-508e-40e4-bcc6-f936a05027ad None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:18.161053 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22a09f-508e-40e4-bcc6-f936a05027ad None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:18.161144 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22a09f-508e-40e4-bcc6-f936a05027ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:18.270811 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-9f22a09f-508e-40e4-bcc6-f936a05027ad None None] MFA Rules not processed for user `34c34efa8fd24230aa45e0f67209260e`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:18.272114 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-9f22a09f-508e-40e4-bcc6-f936a05027ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:18.353515 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 624/1253] 10.222.0.41 () {58 vars in 1018 bytes} [Fri Oct 29 16:06:18 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:22.573960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba9f8-63f8-462b-9aff-3862d7307e7f None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:22.574520 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba9f8-63f8-462b-9aff-3862d7307e7f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:22.574821 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cba9f8-63f8-462b-9aff-3862d7307e7f None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:22.577106 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 630/1254] 10.222.0.41 () {54 vars in 921 bytes} [Fri Oct 29 16:06:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:22.582496 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb193159-a573-4ec8-bc45-485bd1caa812 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:22.583229 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb193159-a573-4ec8-bc45-485bd1caa812 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:22.583655 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb193159-a573-4ec8-bc45-485bd1caa812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:22.602297 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-eb193159-a573-4ec8-bc45-485bd1caa812 None None] MFA Rules not processed for user `34c34efa8fd24230aa45e0f67209260e`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:22.603578 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-eb193159-a573-4ec8-bc45-485bd1caa812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:22.612215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 625/1255] 10.222.0.41 () {58 vars in 1018 bytes} [Fri Oct 29 16:06:22 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:24.158869 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba521663-9ad1-43b0-afac-7c9d3da33a91 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:24.159399 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba521663-9ad1-43b0-afac-7c9d3da33a91 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:24.159399 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba521663-9ad1-43b0-afac-7c9d3da33a91 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:24.161171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 631/1256] 10.222.0.41 () {54 vars in 921 bytes} [Fri Oct 29 16:06:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:24.166568 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004db91a-5a28-4a6b-aebe-183b4ad15d67 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:24.166977 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004db91a-5a28-4a6b-aebe-183b4ad15d67 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:24.167127 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004db91a-5a28-4a6b-aebe-183b4ad15d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:24.184761 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-004db91a-5a28-4a6b-aebe-183b4ad15d67 None None] MFA Rules not processed for user `34c34efa8fd24230aa45e0f67209260e`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:24.185971 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-004db91a-5a28-4a6b-aebe-183b4ad15d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:24.195114 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 626/1257] 10.222.0.41 () {58 vars in 1018 bytes} [Fri Oct 29 16:06:24 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:28.144845 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f434ef1-2ede-43fa-902d-eda0fd687316 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:28.145369 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f434ef1-2ede-43fa-902d-eda0fd687316 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:28.145451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f434ef1-2ede-43fa-902d-eda0fd687316 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:28.147772 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 632/1258] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:06:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:28.153703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed3bde-4764-4756-9b89-2ae30ed22815 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:28.154140 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed3bde-4764-4756-9b89-2ae30ed22815 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:28.154451 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed3bde-4764-4756-9b89-2ae30ed22815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:28.172860 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-e6ed3bde-4764-4756-9b89-2ae30ed22815 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:28.174410 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e6ed3bde-4764-4756-9b89-2ae30ed22815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:28.182501 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 627/1259] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:06:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:28.234277 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e8b40-2a52-433b-a2d2-d8451fb54e49 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:28.234939 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e8b40-2a52-433b-a2d2-d8451fb54e49 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:28.235402 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930e8b40-2a52-433b-a2d2-d8451fb54e49 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:28.237609 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 633/1260] 10.222.0.41 () {54 vars in 960 bytes} [Fri Oct 29 16:06:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:28.243676 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50632765-0704-4314-8377-ee22d186d294 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:28.244155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50632765-0704-4314-8377-ee22d186d294 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:28.244500 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50632765-0704-4314-8377-ee22d186d294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:28.295986 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-50632765-0704-4314-8377-ee22d186d294 None None] MFA Rules not processed for user `4f13d0e9f79a433c81759ecd819a6dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:28.297326 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-50632765-0704-4314-8377-ee22d186d294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:28.382896 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 628/1261] 10.222.0.41 () {58 vars in 1057 bytes} [Fri Oct 29 16:06:28 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:28.391645 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e8b40-2a52-433b-a2d2-d8451fb54e49 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:06:28.407110 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930e8b40-2a52-433b-a2d2-d8451fb54e49 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:06:28.413289 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83edc049-5b17-4f81-9b81-ef4b62deb4f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:06:28.413954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edc049-5b17-4f81-9b81-ef4b62deb4f6 service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:28.414288 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edc049-5b17-4f81-9b81-ef4b62deb4f6 service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:28.414755 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83edc049-5b17-4f81-9b81-ef4b62deb4f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:28.423372 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edc049-5b17-4f81-9b81-ef4b62deb4f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:06:28.425122 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83edc049-5b17-4f81-9b81-ef4b62deb4f6 service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:06:28.435295 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 634/1262] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:06:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:06:30.905259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360da5c7-4558-495e-8698-58652924724a None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:30.905711 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360da5c7-4558-495e-8698-58652924724a None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:30.905803 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360da5c7-4558-495e-8698-58652924724a None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:30.907762 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 629/1263] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:06:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:30.913990 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268f418-4fb0-4ff8-9cba-b0e4fb4c9d73 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:30.914761 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268f418-4fb0-4ff8-9cba-b0e4fb4c9d73 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:30.915045 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c268f418-4fb0-4ff8-9cba-b0e4fb4c9d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:30.933264 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-c268f418-4fb0-4ff8-9cba-b0e4fb4c9d73 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:30.934421 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c268f418-4fb0-4ff8-9cba-b0e4fb4c9d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:30.942267 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 635/1264] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:06:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:30.987898 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360da5c7-4558-495e-8698-58652924724a None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:06:31.003143 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360da5c7-4558-495e-8698-58652924724a None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:06:31.008645 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec74fb6-390b-43de-a744-0e3b49d0a3ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:06:31.009274 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec74fb6-390b-43de-a744-0e3b49d0a3ef service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:31.009692 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec74fb6-390b-43de-a744-0e3b49d0a3ef service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:31.009867 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec74fb6-390b-43de-a744-0e3b49d0a3ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:31.022348 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec74fb6-390b-43de-a744-0e3b49d0a3ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:06:31.023913 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec74fb6-390b-43de-a744-0e3b49d0a3ef service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:06:31.034940 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 630/1265] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:06:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:06:33.627676 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16625c11-bfeb-4181-8967-a6b03dda9626 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:33.628755 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16625c11-bfeb-4181-8967-a6b03dda9626 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:33.629320 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16625c11-bfeb-4181-8967-a6b03dda9626 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:33.631636 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 636/1266] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:06:33 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:33.638315 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6a97b-ea6c-4ece-a0db-365cc6f002e1 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:33.638744 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6a97b-ea6c-4ece-a0db-365cc6f002e1 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:33.638831 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6a97b-ea6c-4ece-a0db-365cc6f002e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:33.659463 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-c3c6a97b-ea6c-4ece-a0db-365cc6f002e1 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:33.661541 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-c3c6a97b-ea6c-4ece-a0db-365cc6f002e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:33.672342 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 631/1267] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:06:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:33.721238 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0ea83-f4f1-4951-aed0-da7325ec8db4 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:33.721521 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0ea83-f4f1-4951-aed0-da7325ec8db4 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:33.721793 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf0ea83-f4f1-4951-aed0-da7325ec8db4 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:33.723776 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 637/1268] 10.222.0.41 () {54 vars in 960 bytes} [Fri Oct 29 16:06:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:33.733146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd63e7-c18e-4b48-b723-f66ca183239e None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:33.733434 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd63e7-c18e-4b48-b723-f66ca183239e None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:33.733710 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd63e7-c18e-4b48-b723-f66ca183239e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:33.753868 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-00cd63e7-c18e-4b48-b723-f66ca183239e None None] MFA Rules not processed for user `4f13d0e9f79a433c81759ecd819a6dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:33.755086 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-00cd63e7-c18e-4b48-b723-f66ca183239e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:33.765819 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 632/1269] 10.222.0.41 () {58 vars in 1057 bytes} [Fri Oct 29 16:06:33 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:33.774417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0ea83-f4f1-4951-aed0-da7325ec8db4 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:06:33.794521 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf0ea83-f4f1-4951-aed0-da7325ec8db4 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:06:33.800181 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2222a7-0eab-4196-a31e-af184e638dde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:06:33.801001 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2222a7-0eab-4196-a31e-af184e638dde service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:33.801469 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2222a7-0eab-4196-a31e-af184e638dde service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:33.801742 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2222a7-0eab-4196-a31e-af184e638dde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:33.811114 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2222a7-0eab-4196-a31e-af184e638dde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:06:33.812705 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2222a7-0eab-4196-a31e-af184e638dde service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:06:33.822488 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 638/1270] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:06:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:06:35.934333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac57f5-97f9-482b-a418-5f97b6b23bd5 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:35.934846 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac57f5-97f9-482b-a418-5f97b6b23bd5 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:35.934950 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac57f5-97f9-482b-a418-5f97b6b23bd5 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:35.936669 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 633/1271] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:06:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:35.942714 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b90b3-10a7-413c-b5a4-f934e00662e1 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:35.943733 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b90b3-10a7-413c-b5a4-f934e00662e1 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:35.943827 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4b90b3-10a7-413c-b5a4-f934e00662e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:35.963141 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-6f4b90b3-10a7-413c-b5a4-f934e00662e1 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:35.964471 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-6f4b90b3-10a7-413c-b5a4-f934e00662e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:35.972620 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 639/1272] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:06:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:36.028064 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9004e7-1642-4608-8c71-c222d1c57fbb None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:36.028347 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9004e7-1642-4608-8c71-c222d1c57fbb None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:36.028810 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9004e7-1642-4608-8c71-c222d1c57fbb None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:36.031138 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 634/1273] 10.222.0.41 () {54 vars in 962 bytes} [Fri Oct 29 16:06:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:36.037547 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6629cdc-c1d5-40f7-9163-a2330de4afe8 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:36.038171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6629cdc-c1d5-40f7-9163-a2330de4afe8 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:36.038525 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6629cdc-c1d5-40f7-9163-a2330de4afe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:36.096403 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-c6629cdc-c1d5-40f7-9163-a2330de4afe8 None None] MFA Rules not processed for user `9652ec3b44ee410dba2491c8f9795e20`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:36.097593 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c6629cdc-c1d5-40f7-9163-a2330de4afe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:36.154376 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 640/1274] 10.222.0.41 () {58 vars in 1059 bytes} [Fri Oct 29 16:06:36 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:36.164029 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9004e7-1642-4608-8c71-c222d1c57fbb None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:06:36.176022 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9004e7-1642-4608-8c71-c222d1c57fbb None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:06:36.179809 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fd3ba-7f34-4386-8477-0a5b2aec4202 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:06:36.180514 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fd3ba-7f34-4386-8477-0a5b2aec4202 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:36.180867 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fd3ba-7f34-4386-8477-0a5b2aec4202 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:36.181214 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fd3ba-7f34-4386-8477-0a5b2aec4202 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:36.189763 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b63689-f27a-455d-99fb-05707faef8d4 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:36.190089 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b63689-f27a-455d-99fb-05707faef8d4 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:36.190369 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b63689-f27a-455d-99fb-05707faef8d4 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:36.190801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fd3ba-7f34-4386-8477-0a5b2aec4202 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:06:36.192312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 641/1275] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:06:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:06:36.192430 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fd3ba-7f34-4386-8477-0a5b2aec4202 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:06:36.198757 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b6959-a476-4050-915f-a85063e67052 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:36.199047 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b6959-a476-4050-915f-a85063e67052 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:36.199336 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8b6959-a476-4050-915f-a85063e67052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:36.203319 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 635/1276] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:06:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:06:36.218677 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-3f8b6959-a476-4050-915f-a85063e67052 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:36.219880 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-3f8b6959-a476-4050-915f-a85063e67052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:36.239543 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 642/1277] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:06:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:06:36.277236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fd3ba-7f34-4386-8477-0a5b2aec4202 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:06:36.288878 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fd3ba-7f34-4386-8477-0a5b2aec4202 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:06:36.294486 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f9c67-c145-49a2-953d-c9767783c249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:06:36.295116 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f9c67-c145-49a2-953d-c9767783c249 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:36.295396 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f9c67-c145-49a2-953d-c9767783c249 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:36.295670 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f9c67-c145-49a2-953d-c9767783c249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:36.303871 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f9c67-c145-49a2-953d-c9767783c249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:06:36.305427 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f9c67-c145-49a2-953d-c9767783c249 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:06:36.315220 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 636/1278] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:06:36 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:06:38.632546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af9965-ab57-41b2-b71a-1a3927835d81 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:38.633084 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af9965-ab57-41b2-b71a-1a3927835d81 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:38.633084 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0af9965-ab57-41b2-b71a-1a3927835d81 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:38.634852 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 643/1279] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:06:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:38.640843 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd300899-00d0-403f-af43-92c47809515c None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:38.641293 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd300899-00d0-403f-af43-92c47809515c None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:38.641396 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd300899-00d0-403f-af43-92c47809515c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:38.659273 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-dd300899-00d0-403f-af43-92c47809515c None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:38.660436 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-dd300899-00d0-403f-af43-92c47809515c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:38.668738 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 637/1280] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:06:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:38.715097 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af9965-ab57-41b2-b71a-1a3927835d81 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:06:38.729688 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0af9965-ab57-41b2-b71a-1a3927835d81 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:06:38.735240 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725a97b-ba1b-4b27-8260-9d0b8406d8fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:06:38.735875 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725a97b-ba1b-4b27-8260-9d0b8406d8fa service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:38.736159 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725a97b-ba1b-4b27-8260-9d0b8406d8fa service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:38.736438 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725a97b-ba1b-4b27-8260-9d0b8406d8fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:38.744399 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725a97b-ba1b-4b27-8260-9d0b8406d8fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:06:38.746106 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1725a97b-ba1b-4b27-8260-9d0b8406d8fa service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:06:38.755320 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 644/1281] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:06:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:06:41.072286 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44624697-489d-4571-a287-3282e875a9c9 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:41.072817 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44624697-489d-4571-a287-3282e875a9c9 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:41.072817 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44624697-489d-4571-a287-3282e875a9c9 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:41.074628 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 638/1282] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:06:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:41.080766 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bf278-8f9c-4e9c-8448-4e2431449759 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:41.081157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bf278-8f9c-4e9c-8448-4e2431449759 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:41.081324 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bf278-8f9c-4e9c-8448-4e2431449759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:41.100126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-824bf278-8f9c-4e9c-8448-4e2431449759 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:41.101306 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-824bf278-8f9c-4e9c-8448-4e2431449759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:41.109311 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 645/1283] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:06:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:41.155827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44624697-489d-4571-a287-3282e875a9c9 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:06:41.171088 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44624697-489d-4571-a287-3282e875a9c9 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:06:41.176808 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef04087-8005-4ad4-b976-602def7ac85b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:06:41.177627 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef04087-8005-4ad4-b976-602def7ac85b service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:41.178048 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef04087-8005-4ad4-b976-602def7ac85b service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:41.178397 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef04087-8005-4ad4-b976-602def7ac85b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:41.187668 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef04087-8005-4ad4-b976-602def7ac85b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:06:41.189342 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef04087-8005-4ad4-b976-602def7ac85b service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:06:41.200141 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 639/1284] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:06:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:06:43.540050 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993744c-edf4-4107-9871-296e429e48cb None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:43.540622 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993744c-edf4-4107-9871-296e429e48cb None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:43.540622 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4993744c-edf4-4107-9871-296e429e48cb None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:43.542435 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 646/1285] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:06:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:43.549221 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62b96c-a2e9-45ff-b2ba-dfce99091630 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:43.549645 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62b96c-a2e9-45ff-b2ba-dfce99091630 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:43.549773 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62b96c-a2e9-45ff-b2ba-dfce99091630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:43.567967 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-7d62b96c-a2e9-45ff-b2ba-dfce99091630 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:43.569169 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7d62b96c-a2e9-45ff-b2ba-dfce99091630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:43.577347 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 640/1286] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:06:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:06:43.622541 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993744c-edf4-4107-9871-296e429e48cb None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:06:43.636897 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4993744c-edf4-4107-9871-296e429e48cb None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:06:43.644988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bbf201-8ca5-45ab-bdbe-060649add5a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:06:43.645667 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbf201-8ca5-45ab-bdbe-060649add5a4 service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:43.646044 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbf201-8ca5-45ab-bdbe-060649add5a4 service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:43.646327 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bbf201-8ca5-45ab-bdbe-060649add5a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:43.654907 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbf201-8ca5-45ab-bdbe-060649add5a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:06:43.656497 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bbf201-8ca5-45ab-bdbe-060649add5a4 service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:06:43.666311 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 647/1287] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:06:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:06:45.936432 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2a9a4-bd15-4477-9608-be9491580550 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:45.936976 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2a9a4-bd15-4477-9608-be9491580550 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:45.936976 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf2a9a4-bd15-4477-9608-be9491580550 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:45.938808 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 641/1288] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:06:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:06:45.945444 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1297f90-9fd8-4ea5-ba3d-3cec8f572139 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:45.945831 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1297f90-9fd8-4ea5-ba3d-3cec8f572139 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:45.946019 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1297f90-9fd8-4ea5-ba3d-3cec8f572139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:45.965577 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-a1297f90-9fd8-4ea5-ba3d-3cec8f572139 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:45.966798 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a1297f90-9fd8-4ea5-ba3d-3cec8f572139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:45.974401 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 648/1289] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:06:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:46.020012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2a9a4-bd15-4477-9608-be9491580550 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:06:46.036167 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf2a9a4-bd15-4477-9608-be9491580550 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:06:46.042341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15469db0-9a8b-428f-a78b-54fba9577d21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:06:46.043100 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15469db0-9a8b-428f-a78b-54fba9577d21 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:46.043444 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15469db0-9a8b-428f-a78b-54fba9577d21 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:46.043735 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15469db0-9a8b-428f-a78b-54fba9577d21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:46.052784 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15469db0-9a8b-428f-a78b-54fba9577d21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:06:46.054538 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15469db0-9a8b-428f-a78b-54fba9577d21 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:06:46.065129 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 642/1290] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:06:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:06:48.637651 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f960f7-e69e-43ba-b0e9-eebd2587071a None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:48.638329 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f960f7-e69e-43ba-b0e9-eebd2587071a None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:48.638329 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f960f7-e69e-43ba-b0e9-eebd2587071a None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:48.640123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 649/1291] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:06:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:48.647051 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8601b-56cb-424b-a0ab-12efa0f8d090 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:48.647504 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8601b-56cb-424b-a0ab-12efa0f8d090 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:48.647606 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8601b-56cb-424b-a0ab-12efa0f8d090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:48.669582 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-7ec8601b-56cb-424b-a0ab-12efa0f8d090 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:48.671093 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7ec8601b-56cb-424b-a0ab-12efa0f8d090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:48.680738 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 643/1292] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:06:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:48.737711 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f960f7-e69e-43ba-b0e9-eebd2587071a None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:06:48.754311 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f960f7-e69e-43ba-b0e9-eebd2587071a None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:06:48.760452 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9819f1f8-5c58-4b3e-8777-b4538b1a76ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:06:48.761131 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819f1f8-5c58-4b3e-8777-b4538b1a76ba service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:48.761416 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819f1f8-5c58-4b3e-8777-b4538b1a76ba service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:48.761687 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9819f1f8-5c58-4b3e-8777-b4538b1a76ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:48.771223 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819f1f8-5c58-4b3e-8777-b4538b1a76ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:06:48.773136 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9819f1f8-5c58-4b3e-8777-b4538b1a76ba service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:06:48.783450 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 650/1293] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:06:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:06:51.089237 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbaf4e8-a561-447d-b8f1-f16ede240881 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:51.089765 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbaf4e8-a561-447d-b8f1-f16ede240881 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:51.089880 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbaf4e8-a561-447d-b8f1-f16ede240881 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:51.091627 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 644/1294] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:06:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:51.098228 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9deaee-6351-4889-af75-02b4db27b762 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:51.098681 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9deaee-6351-4889-af75-02b4db27b762 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:51.098933 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9deaee-6351-4889-af75-02b4db27b762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:51.120134 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-1a9deaee-6351-4889-af75-02b4db27b762 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:51.121876 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-1a9deaee-6351-4889-af75-02b4db27b762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:51.131999 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 651/1295] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:06:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:51.187607 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbaf4e8-a561-447d-b8f1-f16ede240881 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:06:51.202693 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbaf4e8-a561-447d-b8f1-f16ede240881 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:06:51.208763 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c9c8d-bb43-4883-81e2-69f53bdd6251 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:06:51.209395 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c9c8d-bb43-4883-81e2-69f53bdd6251 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:51.209676 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c9c8d-bb43-4883-81e2-69f53bdd6251 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:51.210043 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c9c8d-bb43-4883-81e2-69f53bdd6251 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:51.218426 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c9c8d-bb43-4883-81e2-69f53bdd6251 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:06:51.220011 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c9c8d-bb43-4883-81e2-69f53bdd6251 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:06:51.229496 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 645/1296] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:06:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:06:53.532962 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d44c1-73f8-4ac3-af43-64081a709ea1 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:53.533506 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d44c1-73f8-4ac3-af43-64081a709ea1 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:53.533506 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d44c1-73f8-4ac3-af43-64081a709ea1 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:53.535425 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 652/1297] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:06:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:53.542149 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb9973-2268-44fe-a220-118bdce24700 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:53.542631 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb9973-2268-44fe-a220-118bdce24700 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:53.542741 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfb9973-2268-44fe-a220-118bdce24700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:53.560872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-1bfb9973-2268-44fe-a220-118bdce24700 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:53.562098 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1bfb9973-2268-44fe-a220-118bdce24700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:53.570604 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 646/1298] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:06:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:53.617666 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d44c1-73f8-4ac3-af43-64081a709ea1 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:06:53.632520 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d44c1-73f8-4ac3-af43-64081a709ea1 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:06:53.638010 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaec10e-9bb6-4062-a0a7-65c127373408 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:06:53.638651 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaec10e-9bb6-4062-a0a7-65c127373408 service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:53.638937 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaec10e-9bb6-4062-a0a7-65c127373408 service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:53.639217 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaec10e-9bb6-4062-a0a7-65c127373408 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:53.647408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaec10e-9bb6-4062-a0a7-65c127373408 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:06:53.648992 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaec10e-9bb6-4062-a0a7-65c127373408 service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:06:53.658301 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 653/1299] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:06:53 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:06:54.601294 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1735ee1-a58f-47cf-9201-84a6d333d02a None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:54.601856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1735ee1-a58f-47cf-9201-84a6d333d02a None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:54.601856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1735ee1-a58f-47cf-9201-84a6d333d02a None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:54.603776 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 647/1300] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:06:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:54.609838 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdcf0e-a7c9-4866-8da3-22bd9f82c483 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:54.610289 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdcf0e-a7c9-4866-8da3-22bd9f82c483 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:54.610427 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfdcf0e-a7c9-4866-8da3-22bd9f82c483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:54.628173 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-edfdcf0e-a7c9-4866-8da3-22bd9f82c483 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:54.629350 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-edfdcf0e-a7c9-4866-8da3-22bd9f82c483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:54.638125 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 654/1301] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:06:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:06:54.695424 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c1270-e060-4a06-af6b-78236a69abcd None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:54.695835 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c1270-e060-4a06-af6b-78236a69abcd None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:54.696120 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0c1270-e060-4a06-af6b-78236a69abcd None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:54.697883 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 648/1302] 10.222.0.41 () {54 vars in 962 bytes} [Fri Oct 29 16:06:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:54.703957 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354573a2-0c86-48ab-83cd-72406f95fd5e None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:54.704328 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354573a2-0c86-48ab-83cd-72406f95fd5e None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:54.704702 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354573a2-0c86-48ab-83cd-72406f95fd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:54.750895 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-354573a2-0c86-48ab-83cd-72406f95fd5e None None] MFA Rules not processed for user `e27a0c9ae2bf40caa92e9dbceff8d68b`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:54.752078 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-354573a2-0c86-48ab-83cd-72406f95fd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:54.810811 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 655/1303] 10.222.0.41 () {58 vars in 1059 bytes} [Fri Oct 29 16:06:54 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:06:54.818715 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c1270-e060-4a06-af6b-78236a69abcd None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:06:54.829177 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0c1270-e060-4a06-af6b-78236a69abcd None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:06:54.832639 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a39f7f-b7e5-403d-9ef8-f425f61ce99e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27a0c9ae2bf40caa92e9dbceff8d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:06:54.833265 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a39f7f-b7e5-403d-9ef8-f425f61ce99e service glance] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:54.833546 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a39f7f-b7e5-403d-9ef8-f425f61ce99e service glance] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:54.833818 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a39f7f-b7e5-403d-9ef8-f425f61ce99e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:54.842557 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a39f7f-b7e5-403d-9ef8-f425f61ce99e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:06:54.843980 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a39f7f-b7e5-403d-9ef8-f425f61ce99e service glance] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:06:54.854434 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 649/1304] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:06:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:06:55.297151 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561149f4-ff02-4098-bbed-a34c8831149b None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:55.297448 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561149f4-ff02-4098-bbed-a34c8831149b None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:55.297730 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561149f4-ff02-4098-bbed-a34c8831149b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:55.347495 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-561149f4-ff02-4098-bbed-a34c8831149b None None] MFA Rules not processed for user `10b4daa146fa4b638d90ea1e9a4878eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:55.349282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-561149f4-ff02-4098-bbed-a34c8831149b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:55.411285 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 656/1305] 10.222.0.41 () {58 vars in 1009 bytes} [Fri Oct 29 16:06:55 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:55.458758 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672af0a0-f562-4bdf-92fa-e8dfd10b3f6e None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:55.459044 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672af0a0-f562-4bdf-92fa-e8dfd10b3f6e None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:55.459314 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672af0a0-f562-4bdf-92fa-e8dfd10b3f6e None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:55.461340 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 650/1306] 10.222.0.41 () {54 vars in 942 bytes} [Fri Oct 29 16:06:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:55.467876 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c60a00-1cc9-409b-a166-54b87b0e66db None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:55.468231 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c60a00-1cc9-409b-a166-54b87b0e66db None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:55.468568 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c60a00-1cc9-409b-a166-54b87b0e66db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:55.515887 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-d7c60a00-1cc9-409b-a166-54b87b0e66db None None] MFA Rules not processed for user `f518ae309c4b4f7eacca882b58e58bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:55.517058 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-d7c60a00-1cc9-409b-a166-54b87b0e66db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:55.584117 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 657/1307] 10.222.0.41 () {58 vars in 1039 bytes} [Fri Oct 29 16:06:55 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:06:55.593843 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672af0a0-f562-4bdf-92fa-e8dfd10b3f6e None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:06:55.607229 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672af0a0-f562-4bdf-92fa-e8dfd10b3f6e None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:06:55.612121 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedbf1f8-c61e-44c1-8f34-da2268b474ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f518ae309c4b4f7eacca882b58e58bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:06:55.612776 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbf1f8-c61e-44c1-8f34-da2268b474ab service swift] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:55.613051 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbf1f8-c61e-44c1-8f34-da2268b474ab service swift] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:55.613321 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbf1f8-c61e-44c1-8f34-da2268b474ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:55.622046 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbf1f8-c61e-44c1-8f34-da2268b474ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:06:55.623607 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedbf1f8-c61e-44c1-8f34-da2268b474ab service swift] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:06:55.631743 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 651/1308] 10.222.0.41 () {60 vars in 1384 bytes} [Fri Oct 29 16:06:55 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 16:06:55.949533 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ff10f-0762-4f37-a8f4-a76403b8767f None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:55.950055 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ff10f-0762-4f37-a8f4-a76403b8767f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:55.950137 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00ff10f-0762-4f37-a8f4-a76403b8767f None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:55.952344 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 658/1309] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:06:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:06:55.959636 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d53894-6b75-40c6-b069-c6d4a8cae555 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:55.960188 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d53894-6b75-40c6-b069-c6d4a8cae555 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:55.960536 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d53894-6b75-40c6-b069-c6d4a8cae555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:55.981643 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-53d53894-6b75-40c6-b069-c6d4a8cae555 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:06:55.983071 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-53d53894-6b75-40c6-b069-c6d4a8cae555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:06:55.993902 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 652/1310] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:06:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:06:56.060105 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ff10f-0762-4f37-a8f4-a76403b8767f None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:06:56.090103 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00ff10f-0762-4f37-a8f4-a76403b8767f None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:06:56.096183 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b613e-298e-440b-ba60-88c1febc30c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:06:56.096836 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b613e-298e-440b-ba60-88c1febc30c3 service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:06:56.097124 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b613e-298e-440b-ba60-88c1febc30c3 service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:06:56.097403 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b613e-298e-440b-ba60-88c1febc30c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:06:56.106694 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b613e-298e-440b-ba60-88c1febc30c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:06:56.108304 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b613e-298e-440b-ba60-88c1febc30c3 service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:06:56.118378 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 659/1311] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:06:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:07:13.318980 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fdc95-77da-4933-b3a5-7c099d20b320 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:13.319543 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fdc95-77da-4933-b3a5-7c099d20b320 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:13.319543 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fdc95-77da-4933-b3a5-7c099d20b320 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:13.321307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 653/1312] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:07:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:13.327573 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0f911-e2f4-4b8f-ab6f-1236dee76d25 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:13.327982 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0f911-e2f4-4b8f-ab6f-1236dee76d25 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:13.328131 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0f911-e2f4-4b8f-ab6f-1236dee76d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:13.345265 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-a3b0f911-e2f4-4b8f-ab6f-1236dee76d25 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:13.346473 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a3b0f911-e2f4-4b8f-ab6f-1236dee76d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:13.354094 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 660/1313] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:07:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:13.378527 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fdc95-77da-4933-b3a5-7c099d20b320 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:13.391400 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fdc95-77da-4933-b3a5-7c099d20b320 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:13.395967 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af947f41-4dd9-493b-ac12-143f57762dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:13.396599 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af947f41-4dd9-493b-ac12-143f57762dcb admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:13.396885 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af947f41-4dd9-493b-ac12-143f57762dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:13.397187 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af947f41-4dd9-493b-ac12-143f57762dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:13.397954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af947f41-4dd9-493b-ac12-143f57762dcb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:13.399808 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af947f41-4dd9-493b-ac12-143f57762dcb admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:13.412975 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 654/1314] 10.222.0.41 () {56 vars in 1108 bytes} [Fri Oct 29 16:07:13 2021] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:07:15.628362 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4195e-6e2b-42f8-b212-39b6cdd942a3 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:15.628913 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4195e-6e2b-42f8-b212-39b6cdd942a3 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:15.628913 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b4195e-6e2b-42f8-b212-39b6cdd942a3 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:15.631262 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 661/1315] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:07:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:15.637115 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1599d-cc81-4088-9156-2031c198bc60 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:15.637546 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1599d-cc81-4088-9156-2031c198bc60 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:15.637670 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf1599d-cc81-4088-9156-2031c198bc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:15.654935 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-9cf1599d-cc81-4088-9156-2031c198bc60 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:15.656146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-9cf1599d-cc81-4088-9156-2031c198bc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:15.663885 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 655/1316] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:07:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:15.688300 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4195e-6e2b-42f8-b212-39b6cdd942a3 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:15.701417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b4195e-6e2b-42f8-b212-39b6cdd942a3 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:15.705738 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9f9be-e21d-4589-8623-49008d4b1d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:15.706615 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9f9be-e21d-4589-8623-49008d4b1d65 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:15.706894 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9f9be-e21d-4589-8623-49008d4b1d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:15.707167 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c9f9be-e21d-4589-8623-49008d4b1d65 admin admin] PATH_INFO: `/v3/projects/04cbc33f4bf74d74bcf6ce860dd3a783` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:15.717434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9f9be-e21d-4589-8623-49008d4b1d65 admin admin] RBAC: Authorizing `identity:get_project(project_id=04cbc33f4bf74d74bcf6ce860dd3a783)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:15.719534 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c9f9be-e21d-4589-8623-49008d4b1d65 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:15.721242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 662/1317] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:07:15 2021] GET /identity/v3/projects/04cbc33f4bf74d74bcf6ce860dd3a783 => generated 312 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:15.727961 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1599d-cc81-4088-9156-2031c198bc60 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:15.737072 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf1599d-cc81-4088-9156-2031c198bc60 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:15.742143 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1473eda-c0dc-426c-bc53-9b4b43d01870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:15.742775 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1473eda-c0dc-426c-bc53-9b4b43d01870 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:15.743054 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1473eda-c0dc-426c-bc53-9b4b43d01870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:15.743326 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1473eda-c0dc-426c-bc53-9b4b43d01870 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:15.744097 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1473eda-c0dc-426c-bc53-9b4b43d01870 admin admin] RBAC: Adding query filter params (scope.project.id=04cbc33f4bf74d74bcf6ce860dd3a783) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:07:15.744399 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1473eda-c0dc-426c-bc53-9b4b43d01870 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:15.746242 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1473eda-c0dc-426c-bc53-9b4b43d01870 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:15.752513 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 656/1318] 10.222.0.41 () {56 vars in 1231 bytes} [Fri Oct 29 16:07:15 2021] GET /identity/v3/role_assignments?scope.project.id=04cbc33f4bf74d74bcf6ce860dd3a783 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:15.759298 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9f9be-e21d-4589-8623-49008d4b1d65 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:15.769070 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c9f9be-e21d-4589-8623-49008d4b1d65 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:15.773645 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c31707-2375-47a4-9a6d-f132ef31127e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:15.774623 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c31707-2375-47a4-9a6d-f132ef31127e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:15.774905 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c31707-2375-47a4-9a6d-f132ef31127e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:15.775245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c31707-2375-47a4-9a6d-f132ef31127e admin admin] PATH_INFO: `/v3/users/9633a24420954abdbab396f4125ba772` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:15.789099 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c31707-2375-47a4-9a6d-f132ef31127e admin admin] RBAC: Authorizing `identity:get_user(user_id=9633a24420954abdbab396f4125ba772)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:15.791307 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c31707-2375-47a4-9a6d-f132ef31127e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:15.792941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 663/1319] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:07:15 2021] GET /identity/v3/users/9633a24420954abdbab396f4125ba772 => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:18.042146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68171-6cfd-46ba-97f5-4b9530335a45 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:18.042664 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68171-6cfd-46ba-97f5-4b9530335a45 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:18.042664 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68171-6cfd-46ba-97f5-4b9530335a45 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:18.044390 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 657/1320] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:07:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:18.050331 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12100589-500f-444a-8aac-ef6c6f90a2a8 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:18.050721 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12100589-500f-444a-8aac-ef6c6f90a2a8 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:18.050900 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12100589-500f-444a-8aac-ef6c6f90a2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:18.068274 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-12100589-500f-444a-8aac-ef6c6f90a2a8 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:18.069449 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-12100589-500f-444a-8aac-ef6c6f90a2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:18.077597 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 664/1321] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:07:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:18.101675 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb68171-6cfd-46ba-97f5-4b9530335a45 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:18.113793 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb68171-6cfd-46ba-97f5-4b9530335a45 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:18.118245 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cce513-d585-441d-8cd7-8a38f67c1c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:18.119066 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cce513-d585-441d-8cd7-8a38f67c1c41 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:18.119347 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cce513-d585-441d-8cd7-8a38f67c1c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:18.119645 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cce513-d585-441d-8cd7-8a38f67c1c41 admin admin] PATH_INFO: `/v3/projects/36a0d7a42b6f44718fa076e51c1cbca8` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:18.130806 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cce513-d585-441d-8cd7-8a38f67c1c41 admin admin] RBAC: Authorizing `identity:get_project(project_id=36a0d7a42b6f44718fa076e51c1cbca8)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:18.132854 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cce513-d585-441d-8cd7-8a38f67c1c41 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:18.134536 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 658/1322] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:07:18 2021] GET /identity/v3/projects/36a0d7a42b6f44718fa076e51c1cbca8 => generated 361 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:18.140966 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12100589-500f-444a-8aac-ef6c6f90a2a8 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:18.150375 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12100589-500f-444a-8aac-ef6c6f90a2a8 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:18.154864 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe5764-b744-4846-bc17-2479ab946712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:18.155501 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe5764-b744-4846-bc17-2479ab946712 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:18.155777 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe5764-b744-4846-bc17-2479ab946712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:18.156048 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe5764-b744-4846-bc17-2479ab946712 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:18.156813 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe5764-b744-4846-bc17-2479ab946712 admin admin] RBAC: Adding query filter params (scope.project.id=36a0d7a42b6f44718fa076e51c1cbca8) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:07:18.157113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe5764-b744-4846-bc17-2479ab946712 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:18.158969 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe5764-b744-4846-bc17-2479ab946712 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:18.165189 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 665/1323] 10.222.0.41 () {56 vars in 1231 bytes} [Fri Oct 29 16:07:18 2021] GET /identity/v3/role_assignments?scope.project.id=36a0d7a42b6f44718fa076e51c1cbca8 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:18.171215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cce513-d585-441d-8cd7-8a38f67c1c41 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:18.180656 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cce513-d585-441d-8cd7-8a38f67c1c41 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:18.185187 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a298a54-7baf-428f-ba18-d4f3b3254e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:18.186069 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a298a54-7baf-428f-ba18-d4f3b3254e1b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:18.186355 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a298a54-7baf-428f-ba18-d4f3b3254e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:18.186639 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a298a54-7baf-428f-ba18-d4f3b3254e1b admin admin] PATH_INFO: `/v3/users/7a075070de4d462b9d9fb24a37064ca8` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:18.200108 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a298a54-7baf-428f-ba18-d4f3b3254e1b admin admin] RBAC: Authorizing `identity:get_user(user_id=7a075070de4d462b9d9fb24a37064ca8)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:18.202572 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a298a54-7baf-428f-ba18-d4f3b3254e1b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:18.204175 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 659/1324] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:07:18 2021] GET /identity/v3/users/7a075070de4d462b9d9fb24a37064ca8 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:20.461364 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeef15b-56f0-4526-ad77-b8346401b2d6 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:20.461954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeef15b-56f0-4526-ad77-b8346401b2d6 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:20.461954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeef15b-56f0-4526-ad77-b8346401b2d6 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:20.463733 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 666/1325] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:07:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:20.469683 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10344aba-62a7-4af5-a4e1-3d8d3069f8e0 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:20.470104 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10344aba-62a7-4af5-a4e1-3d8d3069f8e0 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:20.470289 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10344aba-62a7-4af5-a4e1-3d8d3069f8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:20.487802 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-10344aba-62a7-4af5-a4e1-3d8d3069f8e0 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:20.489594 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-10344aba-62a7-4af5-a4e1-3d8d3069f8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:20.497356 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 660/1326] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:07:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:07:20.520601 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeef15b-56f0-4526-ad77-b8346401b2d6 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:20.532996 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeef15b-56f0-4526-ad77-b8346401b2d6 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:20.538005 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55c9cd-b7e5-41cb-8478-b15e53d272d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:20.538838 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55c9cd-b7e5-41cb-8478-b15e53d272d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:20.539119 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55c9cd-b7e5-41cb-8478-b15e53d272d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:20.539392 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55c9cd-b7e5-41cb-8478-b15e53d272d0 admin admin] PATH_INFO: `/v3/projects/42d8c8692f4449f38699eb596233e6a8` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:20.550013 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55c9cd-b7e5-41cb-8478-b15e53d272d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=42d8c8692f4449f38699eb596233e6a8)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:20.552694 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55c9cd-b7e5-41cb-8478-b15e53d272d0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:20.554385 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 667/1327] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:07:20 2021] GET /identity/v3/projects/42d8c8692f4449f38699eb596233e6a8 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:20.560849 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10344aba-62a7-4af5-a4e1-3d8d3069f8e0 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:20.569846 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10344aba-62a7-4af5-a4e1-3d8d3069f8e0 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:20.574449 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cffc9-eb99-4ad9-9aba-170347a961a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:20.575084 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cffc9-eb99-4ad9-9aba-170347a961a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:20.575370 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cffc9-eb99-4ad9-9aba-170347a961a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:20.575905 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679cffc9-eb99-4ad9-9aba-170347a961a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:20.576692 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cffc9-eb99-4ad9-9aba-170347a961a6 admin admin] RBAC: Adding query filter params (scope.project.id=42d8c8692f4449f38699eb596233e6a8) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:07:20.577005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cffc9-eb99-4ad9-9aba-170347a961a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:20.578859 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679cffc9-eb99-4ad9-9aba-170347a961a6 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:20.584470 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 661/1328] 10.222.0.41 () {56 vars in 1231 bytes} [Fri Oct 29 16:07:20 2021] GET /identity/v3/role_assignments?scope.project.id=42d8c8692f4449f38699eb596233e6a8 => generated 877 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:20.590543 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55c9cd-b7e5-41cb-8478-b15e53d272d0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:20.600636 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55c9cd-b7e5-41cb-8478-b15e53d272d0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:20.605104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff019b4-ec2e-4eea-b8c2-0c097f08d1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:20.605944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff019b4-ec2e-4eea-b8c2-0c097f08d1bc admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:20.606243 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff019b4-ec2e-4eea-b8c2-0c097f08d1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:20.606513 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff019b4-ec2e-4eea-b8c2-0c097f08d1bc admin admin] PATH_INFO: `/v3/users/243e54fa940a4a2bbec212da98f05f19` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:20.621311 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff019b4-ec2e-4eea-b8c2-0c097f08d1bc admin admin] RBAC: Authorizing `identity:get_user(user_id=243e54fa940a4a2bbec212da98f05f19)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:20.623470 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff019b4-ec2e-4eea-b8c2-0c097f08d1bc admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:20.625085 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 668/1329] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:07:20 2021] GET /identity/v3/users/243e54fa940a4a2bbec212da98f05f19 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:20.631297 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cffc9-eb99-4ad9-9aba-170347a961a6 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:20.641300 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679cffc9-eb99-4ad9-9aba-170347a961a6 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:20.646346 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a1c740-06d2-4dcb-9bdb-1e6940399a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:20.647184 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1c740-06d2-4dcb-9bdb-1e6940399a85 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:20.647471 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1c740-06d2-4dcb-9bdb-1e6940399a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:20.647748 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a1c740-06d2-4dcb-9bdb-1e6940399a85 admin admin] PATH_INFO: `/v3/users/066d46fd3ea540a5afab903d46f73ccb` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:20.661224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1c740-06d2-4dcb-9bdb-1e6940399a85 admin admin] RBAC: Authorizing `identity:get_user(user_id=066d46fd3ea540a5afab903d46f73ccb)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:20.663386 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a1c740-06d2-4dcb-9bdb-1e6940399a85 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:20.665030 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 662/1330] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:07:20 2021] GET /identity/v3/users/066d46fd3ea540a5afab903d46f73ccb => generated 285 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:22.963145 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0b6c6-de5a-4bd0-8716-a0a055bdc8b1 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:22.963731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0b6c6-de5a-4bd0-8716-a0a055bdc8b1 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:22.963731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0b6c6-de5a-4bd0-8716-a0a055bdc8b1 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:22.965480 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 669/1331] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:07:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:22.971339 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441574d9-907f-4b80-9df9-4ae667ac338d None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:22.971752 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441574d9-907f-4b80-9df9-4ae667ac338d None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:22.971877 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441574d9-907f-4b80-9df9-4ae667ac338d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:22.989225 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-441574d9-907f-4b80-9df9-4ae667ac338d None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:22.990424 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-441574d9-907f-4b80-9df9-4ae667ac338d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:22.998095 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 663/1332] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:07:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:23.021444 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0b6c6-de5a-4bd0-8716-a0a055bdc8b1 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:23.033393 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0b6c6-de5a-4bd0-8716-a0a055bdc8b1 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:23.038319 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83e850-250d-48d3-b3c9-418a65a90b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:23.039144 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83e850-250d-48d3-b3c9-418a65a90b84 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:23.039417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83e850-250d-48d3-b3c9-418a65a90b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:23.039682 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83e850-250d-48d3-b3c9-418a65a90b84 admin admin] PATH_INFO: `/v3/projects/5eef9a6532ef47b784e55118202657c3` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:23.050005 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83e850-250d-48d3-b3c9-418a65a90b84 admin admin] RBAC: Authorizing `identity:get_project(project_id=5eef9a6532ef47b784e55118202657c3)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:23.052067 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83e850-250d-48d3-b3c9-418a65a90b84 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:23.053769 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 670/1333] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:07:23 2021] GET /identity/v3/projects/5eef9a6532ef47b784e55118202657c3 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:23.060137 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441574d9-907f-4b80-9df9-4ae667ac338d None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:23.068878 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441574d9-907f-4b80-9df9-4ae667ac338d None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:23.073369 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66727b20-6884-41d4-974b-cc41b0e5d0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:23.074027 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66727b20-6884-41d4-974b-cc41b0e5d0dd admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:23.074307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66727b20-6884-41d4-974b-cc41b0e5d0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:23.074581 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66727b20-6884-41d4-974b-cc41b0e5d0dd admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:23.075345 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66727b20-6884-41d4-974b-cc41b0e5d0dd admin admin] RBAC: Adding query filter params (scope.project.id=5eef9a6532ef47b784e55118202657c3) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:07:23.075645 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66727b20-6884-41d4-974b-cc41b0e5d0dd admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:23.077703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66727b20-6884-41d4-974b-cc41b0e5d0dd admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:23.083474 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 664/1334] 10.222.0.41 () {56 vars in 1231 bytes} [Fri Oct 29 16:07:23 2021] GET /identity/v3/role_assignments?scope.project.id=5eef9a6532ef47b784e55118202657c3 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:23.089448 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83e850-250d-48d3-b3c9-418a65a90b84 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:23.099688 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83e850-250d-48d3-b3c9-418a65a90b84 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:23.104451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b271fc-9a1e-478f-938d-906f9407cca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:23.105298 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b271fc-9a1e-478f-938d-906f9407cca3 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:23.105577 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b271fc-9a1e-478f-938d-906f9407cca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:23.105848 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b271fc-9a1e-478f-938d-906f9407cca3 admin admin] PATH_INFO: `/v3/users/df609d4027da453f9aa0f582237535fc` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:23.118955 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b271fc-9a1e-478f-938d-906f9407cca3 admin admin] RBAC: Authorizing `identity:get_user(user_id=df609d4027da453f9aa0f582237535fc)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:23.121086 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b271fc-9a1e-478f-938d-906f9407cca3 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:23.122716 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 671/1335] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:07:23 2021] GET /identity/v3/users/df609d4027da453f9aa0f582237535fc => generated 286 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:25.369542 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f1f62-70c3-4c04-926b-cbeb7e93f3c6 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:25.370094 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f1f62-70c3-4c04-926b-cbeb7e93f3c6 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:25.370094 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f1f62-70c3-4c04-926b-cbeb7e93f3c6 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:25.372016 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 665/1336] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:07:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:25.377881 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9211d4c-6978-474f-8e9a-0dd96b2e829a None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:25.378296 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9211d4c-6978-474f-8e9a-0dd96b2e829a None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:25.378473 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9211d4c-6978-474f-8e9a-0dd96b2e829a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:25.395862 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e9211d4c-6978-474f-8e9a-0dd96b2e829a None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:25.397042 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e9211d4c-6978-474f-8e9a-0dd96b2e829a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:25.404724 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 672/1337] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:07:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:25.429259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f1f62-70c3-4c04-926b-cbeb7e93f3c6 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:25.441279 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f1f62-70c3-4c04-926b-cbeb7e93f3c6 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:25.445704 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd519a-3c89-4a31-afde-f83fb431d23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:25.446563 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd519a-3c89-4a31-afde-f83fb431d23f admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:25.446844 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd519a-3c89-4a31-afde-f83fb431d23f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:25.447120 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd519a-3c89-4a31-afde-f83fb431d23f admin admin] PATH_INFO: `/v3/projects/77d119a645a14cd79d87aae94a06ec80` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:25.458712 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd519a-3c89-4a31-afde-f83fb431d23f admin admin] RBAC: Authorizing `identity:get_project(project_id=77d119a645a14cd79d87aae94a06ec80)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:25.460771 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd519a-3c89-4a31-afde-f83fb431d23f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:25.462529 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 666/1338] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:07:25 2021] GET /identity/v3/projects/77d119a645a14cd79d87aae94a06ec80 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:25.469037 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9211d4c-6978-474f-8e9a-0dd96b2e829a None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:25.478734 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9211d4c-6978-474f-8e9a-0dd96b2e829a None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:25.483179 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea900b-17ca-4d47-8ce5-a77fc2e58ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:25.483813 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea900b-17ca-4d47-8ce5-a77fc2e58ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:25.484094 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea900b-17ca-4d47-8ce5-a77fc2e58ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:25.484365 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea900b-17ca-4d47-8ce5-a77fc2e58ad5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:25.485134 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea900b-17ca-4d47-8ce5-a77fc2e58ad5 admin admin] RBAC: Adding query filter params (scope.project.id=77d119a645a14cd79d87aae94a06ec80) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:07:25.485462 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea900b-17ca-4d47-8ce5-a77fc2e58ad5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:25.487340 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea900b-17ca-4d47-8ce5-a77fc2e58ad5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:25.493785 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 673/1339] 10.222.0.41 () {56 vars in 1231 bytes} [Fri Oct 29 16:07:25 2021] GET /identity/v3/role_assignments?scope.project.id=77d119a645a14cd79d87aae94a06ec80 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:07:25.500133 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd519a-3c89-4a31-afde-f83fb431d23f admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:25.510151 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd519a-3c89-4a31-afde-f83fb431d23f admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:25.514651 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6c1f80-f86a-48d8-8c35-889600b62944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:25.515484 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c1f80-f86a-48d8-8c35-889600b62944 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:25.515764 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c1f80-f86a-48d8-8c35-889600b62944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:25.516041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6c1f80-f86a-48d8-8c35-889600b62944 admin admin] PATH_INFO: `/v3/users/9633a24420954abdbab396f4125ba772` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:25.517218 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c1f80-f86a-48d8-8c35-889600b62944 admin admin] RBAC: Authorizing `identity:get_user(user_id=9633a24420954abdbab396f4125ba772)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:25.519353 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6c1f80-f86a-48d8-8c35-889600b62944 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:25.521517 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 667/1340] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:07:25 2021] GET /identity/v3/users/9633a24420954abdbab396f4125ba772 => generated 275 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:25.527514 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea900b-17ca-4d47-8ce5-a77fc2e58ad5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:25.536867 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea900b-17ca-4d47-8ce5-a77fc2e58ad5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:25.541297 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a6ea5-41a6-4c38-a6b3-98214ac063d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:25.542162 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a6ea5-41a6-4c38-a6b3-98214ac063d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:25.542442 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a6ea5-41a6-4c38-a6b3-98214ac063d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:25.542710 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a6ea5-41a6-4c38-a6b3-98214ac063d9 admin admin] PATH_INFO: `/v3/users/bfeda756d5b84f81aba1c8d226cdac52` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:25.543875 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a6ea5-41a6-4c38-a6b3-98214ac063d9 admin admin] RBAC: Authorizing `identity:get_user(user_id=bfeda756d5b84f81aba1c8d226cdac52)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:25.545643 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a6ea5-41a6-4c38-a6b3-98214ac063d9 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:25.547213 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 674/1341] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:07:25 2021] GET /identity/v3/users/bfeda756d5b84f81aba1c8d226cdac52 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:27.857909 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b1c07-147d-4299-b0bb-d07a64c85875 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:27.858501 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b1c07-147d-4299-b0bb-d07a64c85875 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:27.858501 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b1c07-147d-4299-b0bb-d07a64c85875 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:27.860249 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 668/1342] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:07:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:27.866651 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fbe77-78ff-4809-9aca-acdf14c369f1 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:27.867082 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fbe77-78ff-4809-9aca-acdf14c369f1 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:27.867219 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38fbe77-78ff-4809-9aca-acdf14c369f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:27.885317 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-a38fbe77-78ff-4809-9aca-acdf14c369f1 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:27.886535 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a38fbe77-78ff-4809-9aca-acdf14c369f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:27.894185 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 675/1343] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:07:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:27.918215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b1c07-147d-4299-b0bb-d07a64c85875 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:27.930228 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b1c07-147d-4299-b0bb-d07a64c85875 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:27.934630 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b5806-8f13-4227-ab66-2b392ac6e811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:27.935447 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b5806-8f13-4227-ab66-2b392ac6e811 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:27.935729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b5806-8f13-4227-ab66-2b392ac6e811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:27.936004 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b5806-8f13-4227-ab66-2b392ac6e811 admin admin] PATH_INFO: `/v3/projects/98d7e030a12e408899c86d19f869ade2` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:27.946827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b5806-8f13-4227-ab66-2b392ac6e811 admin admin] RBAC: Authorizing `identity:get_project(project_id=98d7e030a12e408899c86d19f869ade2)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:27.948866 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b5806-8f13-4227-ab66-2b392ac6e811 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:27.950551 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 669/1344] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:07:27 2021] GET /identity/v3/projects/98d7e030a12e408899c86d19f869ade2 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:27.957866 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fbe77-78ff-4809-9aca-acdf14c369f1 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:27.966693 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38fbe77-78ff-4809-9aca-acdf14c369f1 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:27.971173 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f909e-55bc-4d42-b0a1-a6fb6aaf9f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:27.971806 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f909e-55bc-4d42-b0a1-a6fb6aaf9f3e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:27.972090 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f909e-55bc-4d42-b0a1-a6fb6aaf9f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:27.972365 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677f909e-55bc-4d42-b0a1-a6fb6aaf9f3e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:27.973646 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f909e-55bc-4d42-b0a1-a6fb6aaf9f3e admin admin] RBAC: Adding query filter params (scope.project.id=98d7e030a12e408899c86d19f869ade2) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:07:27.973978 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f909e-55bc-4d42-b0a1-a6fb6aaf9f3e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:27.975813 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677f909e-55bc-4d42-b0a1-a6fb6aaf9f3e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:27.982245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 676/1345] 10.222.0.41 () {56 vars in 1231 bytes} [Fri Oct 29 16:07:27 2021] GET /identity/v3/role_assignments?scope.project.id=98d7e030a12e408899c86d19f869ade2 => generated 1934 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:07:27.989158 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b5806-8f13-4227-ab66-2b392ac6e811 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:27.998540 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b5806-8f13-4227-ab66-2b392ac6e811 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:28.003595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5971e4a-b564-48aa-92cc-137f36b0cbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:28.004559 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5971e4a-b564-48aa-92cc-137f36b0cbd9 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:28.004956 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5971e4a-b564-48aa-92cc-137f36b0cbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:28.005278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5971e4a-b564-48aa-92cc-137f36b0cbd9 admin admin] PATH_INFO: `/v3/users/bfeda756d5b84f81aba1c8d226cdac52` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:28.006590 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5971e4a-b564-48aa-92cc-137f36b0cbd9 admin admin] RBAC: Authorizing `identity:get_user(user_id=bfeda756d5b84f81aba1c8d226cdac52)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:28.008408 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5971e4a-b564-48aa-92cc-137f36b0cbd9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:28.010002 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 670/1346] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:07:27 2021] GET /identity/v3/users/bfeda756d5b84f81aba1c8d226cdac52 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:28.016035 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f909e-55bc-4d42-b0a1-a6fb6aaf9f3e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:28.025380 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677f909e-55bc-4d42-b0a1-a6fb6aaf9f3e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:28.029863 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15906aa-3c58-48bb-82f7-e5fa820b3078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:28.030702 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15906aa-3c58-48bb-82f7-e5fa820b3078 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:28.030988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15906aa-3c58-48bb-82f7-e5fa820b3078 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:28.031265 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15906aa-3c58-48bb-82f7-e5fa820b3078 admin admin] PATH_INFO: `/v3/users/b6985df347344ceb8b5a19e9ed66bcf1` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:28.045052 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15906aa-3c58-48bb-82f7-e5fa820b3078 admin admin] RBAC: Authorizing `identity:get_user(user_id=b6985df347344ceb8b5a19e9ed66bcf1)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:28.047244 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15906aa-3c58-48bb-82f7-e5fa820b3078 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:28.048894 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 677/1347] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:07:28 2021] GET /identity/v3/users/b6985df347344ceb8b5a19e9ed66bcf1 => generated 283 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:30.365756 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c7cb5-1468-4705-a616-c6541f4b475f None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:30.366355 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c7cb5-1468-4705-a616-c6541f4b475f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:30.366355 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c7cb5-1468-4705-a616-c6541f4b475f None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:30.368113 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 671/1348] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:07:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:30.374207 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f5be8-a9cd-4653-9ded-81a1de4484d6 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:30.374608 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f5be8-a9cd-4653-9ded-81a1de4484d6 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:30.374764 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f5be8-a9cd-4653-9ded-81a1de4484d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:30.391559 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-b79f5be8-a9cd-4653-9ded-81a1de4484d6 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:30.392737 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b79f5be8-a9cd-4653-9ded-81a1de4484d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:30.400928 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 678/1349] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:07:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:30.425217 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c7cb5-1468-4705-a616-c6541f4b475f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:30.437295 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c7cb5-1468-4705-a616-c6541f4b475f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:30.441717 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4607a-cb5c-428c-89ad-fc122b36562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:30.442569 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4607a-cb5c-428c-89ad-fc122b36562d admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:30.442854 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4607a-cb5c-428c-89ad-fc122b36562d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:30.443131 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4607a-cb5c-428c-89ad-fc122b36562d admin admin] PATH_INFO: `/v3/projects/fe31d02174b84ed29a89c0315c571a54` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:30.444315 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4607a-cb5c-428c-89ad-fc122b36562d admin admin] RBAC: Authorizing `identity:get_project(project_id=fe31d02174b84ed29a89c0315c571a54)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:30.446118 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4607a-cb5c-428c-89ad-fc122b36562d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:30.447751 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 672/1350] 10.222.0.41 () {56 vars in 1207 bytes} [Fri Oct 29 16:07:30 2021] GET /identity/v3/projects/fe31d02174b84ed29a89c0315c571a54 => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:30.454310 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f5be8-a9cd-4653-9ded-81a1de4484d6 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:30.463513 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f5be8-a9cd-4653-9ded-81a1de4484d6 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:30.467991 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b072c0b4-80f4-405f-9947-d32df3444dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:30.468618 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072c0b4-80f4-405f-9947-d32df3444dbb admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:30.468900 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072c0b4-80f4-405f-9947-d32df3444dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:30.469173 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b072c0b4-80f4-405f-9947-d32df3444dbb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:30.469971 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072c0b4-80f4-405f-9947-d32df3444dbb admin admin] RBAC: Adding query filter params (scope.project.id=fe31d02174b84ed29a89c0315c571a54) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:07:30.470279 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072c0b4-80f4-405f-9947-d32df3444dbb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:30.472102 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b072c0b4-80f4-405f-9947-d32df3444dbb admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:30.479328 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 679/1351] 10.222.0.41 () {56 vars in 1231 bytes} [Fri Oct 29 16:07:30 2021] GET /identity/v3/role_assignments?scope.project.id=fe31d02174b84ed29a89c0315c571a54 => generated 879 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:30.485378 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4607a-cb5c-428c-89ad-fc122b36562d admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:30.494806 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4607a-cb5c-428c-89ad-fc122b36562d admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:30.499333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21c68e-7707-463b-b9ae-fac8a14f30d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:30.500164 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21c68e-7707-463b-b9ae-fac8a14f30d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:30.500448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21c68e-7707-463b-b9ae-fac8a14f30d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:30.500725 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21c68e-7707-463b-b9ae-fac8a14f30d7 admin admin] PATH_INFO: `/v3/users/bfeda756d5b84f81aba1c8d226cdac52` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:30.501898 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21c68e-7707-463b-b9ae-fac8a14f30d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=bfeda756d5b84f81aba1c8d226cdac52)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:30.503688 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a21c68e-7707-463b-b9ae-fac8a14f30d7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:30.505374 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 673/1352] 10.222.0.41 () {56 vars in 1198 bytes} [Fri Oct 29 16:07:30 2021] GET /identity/v3/users/bfeda756d5b84f81aba1c8d226cdac52 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:07:35.688922 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ba50e-8fbb-43fb-a12d-1c2c96378350 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:35.689479 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ba50e-8fbb-43fb-a12d-1c2c96378350 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:35.689479 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ba50e-8fbb-43fb-a12d-1c2c96378350 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:35.691283 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 680/1353] 10.222.0.41 () {54 vars in 918 bytes} [Fri Oct 29 16:07:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:35.697083 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557f016-916c-49de-858f-3adef0abf040 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:35.697509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557f016-916c-49de-858f-3adef0abf040 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:35.697625 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8557f016-916c-49de-858f-3adef0abf040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:35.716489 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-8557f016-916c-49de-858f-3adef0abf040 None None] MFA Rules not processed for user `34c34efa8fd24230aa45e0f67209260e`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:35.717611 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8557f016-916c-49de-858f-3adef0abf040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:35.726767 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 674/1354] 10.222.0.41 () {58 vars in 1015 bytes} [Fri Oct 29 16:07:35 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:35.741584 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6625ea-f78f-4b66-b958-33e069ffd750 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:35.741874 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6625ea-f78f-4b66-b958-33e069ffd750 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:35.742192 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6625ea-f78f-4b66-b958-33e069ffd750 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:35.743966 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 681/1355] 10.222.0.41 () {54 vars in 918 bytes} [Fri Oct 29 16:07:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:35.749335 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5056837-661f-48e0-8c58-6d5f456f1013 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:35.749623 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5056837-661f-48e0-8c58-6d5f456f1013 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:35.749905 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5056837-661f-48e0-8c58-6d5f456f1013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:35.767460 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-c5056837-661f-48e0-8c58-6d5f456f1013 None None] MFA Rules not processed for user `4f13d0e9f79a433c81759ecd819a6dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:35.768656 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-c5056837-661f-48e0-8c58-6d5f456f1013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:35.778649 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 675/1356] 10.222.0.41 () {58 vars in 1015 bytes} [Fri Oct 29 16:07:35 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:38.641324 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294fb00-ba8a-46d4-b9b5-3841e318def2 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:38.641857 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294fb00-ba8a-46d4-b9b5-3841e318def2 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:38.641857 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294fb00-ba8a-46d4-b9b5-3841e318def2 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:38.643711 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 682/1357] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:07:38 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:38.650265 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075b58b-462c-4807-990a-283b1b5c3a23 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:38.650677 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075b58b-462c-4807-990a-283b1b5c3a23 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:38.650828 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e075b58b-462c-4807-990a-283b1b5c3a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:38.668776 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-e075b58b-462c-4807-990a-283b1b5c3a23 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:38.669997 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e075b58b-462c-4807-990a-283b1b5c3a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:38.677669 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 676/1358] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:07:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:38.721380 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294fb00-ba8a-46d4-b9b5-3841e318def2 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:38.735980 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294fb00-ba8a-46d4-b9b5-3841e318def2 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:38.741362 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a7789-b2c6-4f6d-92dd-3385427e14b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:38.742016 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a7789-b2c6-4f6d-92dd-3385427e14b9 service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:38.742379 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a7789-b2c6-4f6d-92dd-3385427e14b9 service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:38.742584 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a7789-b2c6-4f6d-92dd-3385427e14b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:38.750698 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a7789-b2c6-4f6d-92dd-3385427e14b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:38.752314 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a7789-b2c6-4f6d-92dd-3385427e14b9 service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:38.761542 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 683/1359] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:07:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:07:40.256282 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d56de-b2ce-42e6-8671-71cbf1740f55 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:40.256819 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d56de-b2ce-42e6-8671-71cbf1740f55 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:40.256964 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d56de-b2ce-42e6-8671-71cbf1740f55 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:40.258702 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 677/1360] 10.222.0.41 () {54 vars in 911 bytes} [Fri Oct 29 16:07:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:40.264153 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934ae10-d402-4472-b892-0e9d5a03c14f None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:40.264570 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934ae10-d402-4472-b892-0e9d5a03c14f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:40.264717 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934ae10-d402-4472-b892-0e9d5a03c14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:40.282740 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e934ae10-d402-4472-b892-0e9d5a03c14f None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:40.283930 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e934ae10-d402-4472-b892-0e9d5a03c14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:40.292214 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 684/1361] 10.222.0.41 () {58 vars in 1008 bytes} [Fri Oct 29 16:07:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:40.444230 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d56de-b2ce-42e6-8671-71cbf1740f55 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:40.458985 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d56de-b2ce-42e6-8671-71cbf1740f55 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:40.464307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ba703f-36eb-4b15-8fca-2b06b12c9192 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:40.464929 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba703f-36eb-4b15-8fca-2b06b12c9192 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:40.465208 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba703f-36eb-4b15-8fca-2b06b12c9192 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:40.465480 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ba703f-36eb-4b15-8fca-2b06b12c9192 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:40.473886 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba703f-36eb-4b15-8fca-2b06b12c9192 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:40.475480 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ba703f-36eb-4b15-8fca-2b06b12c9192 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:40.484453 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 678/1362] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:07:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:07:41.934426 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebe92b-a03a-4f94-a212-d502328e2cd6 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:41.934967 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebe92b-a03a-4f94-a212-d502328e2cd6 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:41.935077 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ebe92b-a03a-4f94-a212-d502328e2cd6 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:41.936894 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 685/1363] 10.222.0.41 () {54 vars in 911 bytes} [Fri Oct 29 16:07:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:41.942969 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5f0b1-7846-4161-9034-0113d0e07cdb None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:41.943384 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5f0b1-7846-4161-9034-0113d0e07cdb None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:41.943520 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b5f0b1-7846-4161-9034-0113d0e07cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:41.960966 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-90b5f0b1-7846-4161-9034-0113d0e07cdb None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:41.962255 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-90b5f0b1-7846-4161-9034-0113d0e07cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:41.969807 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 679/1364] 10.222.0.41 () {58 vars in 1008 bytes} [Fri Oct 29 16:07:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:42.122866 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebe92b-a03a-4f94-a212-d502328e2cd6 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:42.136702 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ebe92b-a03a-4f94-a212-d502328e2cd6 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:42.142081 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cd8b9-a927-4a62-92cb-77481813aa66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:42.142710 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cd8b9-a927-4a62-92cb-77481813aa66 service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:42.142991 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cd8b9-a927-4a62-92cb-77481813aa66 service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:42.143264 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cd8b9-a927-4a62-92cb-77481813aa66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:42.151122 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3cd8b9-a927-4a62-92cb-77481813aa66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:42.152751 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3cd8b9-a927-4a62-92cb-77481813aa66 service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:42.162773 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 686/1365] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:07:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:07:43.608595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe5eb4-a1f9-4b28-a6a3-f99eb6d2f60e None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:43.609136 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe5eb4-a1f9-4b28-a6a3-f99eb6d2f60e None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:43.609136 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe5eb4-a1f9-4b28-a6a3-f99eb6d2f60e None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:43.610961 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 680/1366] 10.222.0.41 () {54 vars in 911 bytes} [Fri Oct 29 16:07:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:43.617204 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be62dad-a341-456d-a911-c2fe5ea594c8 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:43.617629 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be62dad-a341-456d-a911-c2fe5ea594c8 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:43.617742 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be62dad-a341-456d-a911-c2fe5ea594c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:43.635012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-6be62dad-a341-456d-a911-c2fe5ea594c8 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:43.636202 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-6be62dad-a341-456d-a911-c2fe5ea594c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:43.643848 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 687/1367] 10.222.0.41 () {58 vars in 1008 bytes} [Fri Oct 29 16:07:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:43.796566 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe5eb4-a1f9-4b28-a6a3-f99eb6d2f60e None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:43.811072 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe5eb4-a1f9-4b28-a6a3-f99eb6d2f60e None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:43.816547 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ec212d-4029-496f-b965-b74d0c9eb6b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:43.817173 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec212d-4029-496f-b965-b74d0c9eb6b3 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:43.817449 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec212d-4029-496f-b965-b74d0c9eb6b3 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:43.817721 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ec212d-4029-496f-b965-b74d0c9eb6b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:43.825758 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec212d-4029-496f-b965-b74d0c9eb6b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:43.827620 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ec212d-4029-496f-b965-b74d0c9eb6b3 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:43.836530 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 681/1368] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:07:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:07:45.299592 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86dff0-f814-4bd9-855e-a6b88c998c4d None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:45.300153 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86dff0-f814-4bd9-855e-a6b88c998c4d None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:45.300153 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86dff0-f814-4bd9-855e-a6b88c998c4d None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:45.302580 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 688/1369] 10.222.0.41 () {54 vars in 911 bytes} [Fri Oct 29 16:07:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:45.308007 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262ffc8-91e3-4e2a-8d0c-31e758c42600 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:45.308415 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262ffc8-91e3-4e2a-8d0c-31e758c42600 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:45.308557 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c262ffc8-91e3-4e2a-8d0c-31e758c42600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:45.326523 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-c262ffc8-91e3-4e2a-8d0c-31e758c42600 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:45.327714 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-c262ffc8-91e3-4e2a-8d0c-31e758c42600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:45.335532 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 682/1370] 10.222.0.41 () {58 vars in 1008 bytes} [Fri Oct 29 16:07:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:45.491758 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86dff0-f814-4bd9-855e-a6b88c998c4d None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:45.506131 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86dff0-f814-4bd9-855e-a6b88c998c4d None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:45.511458 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfab3a3-c186-41af-b2ec-a8a4c28429b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:45.512093 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab3a3-c186-41af-b2ec-a8a4c28429b3 service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:45.512396 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab3a3-c186-41af-b2ec-a8a4c28429b3 service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:45.512671 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfab3a3-c186-41af-b2ec-a8a4c28429b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:45.521104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfab3a3-c186-41af-b2ec-a8a4c28429b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:45.522715 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfab3a3-c186-41af-b2ec-a8a4c28429b3 service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:45.531720 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 689/1371] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:07:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:07:46.922534 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62258b-4399-4840-b06d-d7de243f1b66 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:46.923078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62258b-4399-4840-b06d-d7de243f1b66 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:46.923078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d62258b-4399-4840-b06d-d7de243f1b66 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:46.924844 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 683/1372] 10.222.0.41 () {54 vars in 911 bytes} [Fri Oct 29 16:07:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:46.930715 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cd562-aa19-4497-babc-9e69b910f63d None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:46.931157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cd562-aa19-4497-babc-9e69b910f63d None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:46.931271 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323cd562-aa19-4497-babc-9e69b910f63d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:46.948771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-323cd562-aa19-4497-babc-9e69b910f63d None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:46.949962 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-323cd562-aa19-4497-babc-9e69b910f63d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:46.957728 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 690/1373] 10.222.0.41 () {58 vars in 1008 bytes} [Fri Oct 29 16:07:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:47.108180 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62258b-4399-4840-b06d-d7de243f1b66 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:47.122607 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d62258b-4399-4840-b06d-d7de243f1b66 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:47.127904 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8716d1-16d2-480f-a5b6-3d5d433f4682 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:47.128528 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8716d1-16d2-480f-a5b6-3d5d433f4682 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:47.128808 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8716d1-16d2-480f-a5b6-3d5d433f4682 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:47.129083 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8716d1-16d2-480f-a5b6-3d5d433f4682 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:47.136897 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8716d1-16d2-480f-a5b6-3d5d433f4682 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:47.138521 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8716d1-16d2-480f-a5b6-3d5d433f4682 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:47.148005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 684/1374] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:07:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:07:48.532567 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b868f9b-4e18-459d-8cdd-67af7e67f280 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:48.533149 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b868f9b-4e18-459d-8cdd-67af7e67f280 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:48.533149 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b868f9b-4e18-459d-8cdd-67af7e67f280 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:48.534915 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 691/1375] 10.222.0.41 () {54 vars in 911 bytes} [Fri Oct 29 16:07:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:07:48.540466 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ca7ef-c570-4fff-9be6-6a2cab8dcbbf None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:48.540846 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ca7ef-c570-4fff-9be6-6a2cab8dcbbf None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:48.541017 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21ca7ef-c570-4fff-9be6-6a2cab8dcbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:48.559650 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-b21ca7ef-c570-4fff-9be6-6a2cab8dcbbf None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:48.560851 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-b21ca7ef-c570-4fff-9be6-6a2cab8dcbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:48.569105 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 685/1376] 10.222.0.41 () {58 vars in 1008 bytes} [Fri Oct 29 16:07:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:07:48.720184 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b868f9b-4e18-459d-8cdd-67af7e67f280 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:48.734429 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b868f9b-4e18-459d-8cdd-67af7e67f280 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:48.740235 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7165ce60-b749-4c1c-846b-e7781ef1fbc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:48.740859 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165ce60-b749-4c1c-846b-e7781ef1fbc8 service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:48.741142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165ce60-b749-4c1c-846b-e7781ef1fbc8 service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:48.741415 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7165ce60-b749-4c1c-846b-e7781ef1fbc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:48.749005 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165ce60-b749-4c1c-846b-e7781ef1fbc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:48.750625 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7165ce60-b749-4c1c-846b-e7781ef1fbc8 service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:48.759594 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 692/1377] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:07:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:07:50.158866 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c39eb-afd8-46e7-8a7f-0fadf78bb503 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:50.159411 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c39eb-afd8-46e7-8a7f-0fadf78bb503 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:50.159411 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c39eb-afd8-46e7-8a7f-0fadf78bb503 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:50.161750 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 686/1378] 10.222.0.41 () {54 vars in 911 bytes} [Fri Oct 29 16:07:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:50.167223 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122d998-7f4d-4c81-9637-1f7ce9c8d6c2 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:50.167652 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122d998-7f4d-4c81-9637-1f7ce9c8d6c2 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:50.167777 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122d998-7f4d-4c81-9637-1f7ce9c8d6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:50.185813 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-f122d998-7f4d-4c81-9637-1f7ce9c8d6c2 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:50.187022 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f122d998-7f4d-4c81-9637-1f7ce9c8d6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:50.194567 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 693/1379] 10.222.0.41 () {58 vars in 1008 bytes} [Fri Oct 29 16:07:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:50.351840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c39eb-afd8-46e7-8a7f-0fadf78bb503 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:50.365732 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c39eb-afd8-46e7-8a7f-0fadf78bb503 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:50.371039 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7563f659-354f-437e-9390-ab8e19a82e32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:50.371660 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563f659-354f-437e-9390-ab8e19a82e32 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:50.371943 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563f659-354f-437e-9390-ab8e19a82e32 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:50.372218 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7563f659-354f-437e-9390-ab8e19a82e32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:50.381192 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563f659-354f-437e-9390-ab8e19a82e32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:50.382892 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7563f659-354f-437e-9390-ab8e19a82e32 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:50.392132 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 687/1380] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:07:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:07:51.772775 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6718ee-633c-4322-974e-7f1931c7e164 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:51.773300 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6718ee-633c-4322-974e-7f1931c7e164 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:51.773300 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6718ee-633c-4322-974e-7f1931c7e164 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:51.775111 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 694/1381] 10.222.0.41 () {54 vars in 911 bytes} [Fri Oct 29 16:07:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:51.780734 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d155c-34a1-4a53-8173-81dafc72d4d5 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:51.781135 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d155c-34a1-4a53-8173-81dafc72d4d5 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:51.781291 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604d155c-34a1-4a53-8173-81dafc72d4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:51.799041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-604d155c-34a1-4a53-8173-81dafc72d4d5 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:51.800226 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-604d155c-34a1-4a53-8173-81dafc72d4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:51.808683 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 688/1382] 10.222.0.41 () {58 vars in 1008 bytes} [Fri Oct 29 16:07:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:51.958187 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6718ee-633c-4322-974e-7f1931c7e164 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:51.972120 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6718ee-633c-4322-974e-7f1931c7e164 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:51.977902 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9bb9d-744f-4b6d-a499-9399778e0a5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:51.978552 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9bb9d-744f-4b6d-a499-9399778e0a5c service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:51.978835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9bb9d-744f-4b6d-a499-9399778e0a5c service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:51.979112 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9bb9d-744f-4b6d-a499-9399778e0a5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:51.986955 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9bb9d-744f-4b6d-a499-9399778e0a5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:51.989148 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9bb9d-744f-4b6d-a499-9399778e0a5c service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:51.998225 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 695/1383] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:07:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:07:54.133943 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48428c6f-f36f-4e60-aa5a-203dcec05a2e None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:54.134469 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48428c6f-f36f-4e60-aa5a-203dcec05a2e None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:54.134563 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48428c6f-f36f-4e60-aa5a-203dcec05a2e None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:54.136272 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 689/1384] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:07:54 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:54.142254 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591be11-55af-464a-b975-ddb2c309c013 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:54.142632 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591be11-55af-464a-b975-ddb2c309c013 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:54.142810 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4591be11-55af-464a-b975-ddb2c309c013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:54.160578 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-4591be11-55af-464a-b975-ddb2c309c013 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:54.161803 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4591be11-55af-464a-b975-ddb2c309c013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:54.169510 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 696/1385] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:07:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:54.210448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48428c6f-f36f-4e60-aa5a-203dcec05a2e None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:54.220671 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48428c6f-f36f-4e60-aa5a-203dcec05a2e None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:54.224123 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08cb67a-62b5-4390-abb0-d5a8d8446deb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:54.224745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cb67a-62b5-4390-abb0-d5a8d8446deb service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:54.225019 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cb67a-62b5-4390-abb0-d5a8d8446deb service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:54.225286 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cb67a-62b5-4390-abb0-d5a8d8446deb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:54.234801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cb67a-62b5-4390-abb0-d5a8d8446deb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:54.236251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08cb67a-62b5-4390-abb0-d5a8d8446deb service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:54.246670 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 690/1386] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:07:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:07:56.621380 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac5233-7e23-4011-8701-994c07a0b57e None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:56.621956 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac5233-7e23-4011-8701-994c07a0b57e None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:56.621956 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac5233-7e23-4011-8701-994c07a0b57e None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:56.623746 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 697/1387] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:07:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:07:56.630113 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc9523-3d2b-4f4f-b111-610ed10b739b None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:56.630516 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc9523-3d2b-4f4f-b111-610ed10b739b None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:56.630664 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc9523-3d2b-4f4f-b111-610ed10b739b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:56.648335 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-37fc9523-3d2b-4f4f-b111-610ed10b739b None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:56.649535 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-37fc9523-3d2b-4f4f-b111-610ed10b739b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:56.657382 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 691/1388] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:07:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:56.697777 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac5233-7e23-4011-8701-994c07a0b57e None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:56.708358 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac5233-7e23-4011-8701-994c07a0b57e None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:56.711847 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d94469-ac3d-4a3b-afc5-f0c0b68e72c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:56.712473 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94469-ac3d-4a3b-afc5-f0c0b68e72c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:56.712751 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94469-ac3d-4a3b-afc5-f0c0b68e72c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:56.713021 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d94469-ac3d-4a3b-afc5-f0c0b68e72c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:56.721510 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d94469-ac3d-4a3b-afc5-f0c0b68e72c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:56.722981 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d94469-ac3d-4a3b-afc5-f0c0b68e72c4 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:56.732024 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 698/1389] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:07:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:07:59.263649 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55af59-6638-46f2-9256-177bfb0a3ed0 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:59.264251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55af59-6638-46f2-9256-177bfb0a3ed0 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:59.264251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55af59-6638-46f2-9256-177bfb0a3ed0 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:59.266126 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 692/1390] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:07:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:07:59.272515 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c7096-5eb5-4f63-be49-ad8c576dbded None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:59.272973 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c7096-5eb5-4f63-be49-ad8c576dbded None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:59.273097 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c7096-5eb5-4f63-be49-ad8c576dbded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:59.290762 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-5a5c7096-5eb5-4f63-be49-ad8c576dbded None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:07:59.291956 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-5a5c7096-5eb5-4f63-be49-ad8c576dbded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:07:59.299624 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 699/1391] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:07:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:07:59.340277 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55af59-6638-46f2-9256-177bfb0a3ed0 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:07:59.350600 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55af59-6638-46f2-9256-177bfb0a3ed0 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:07:59.354077 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200234c-bdae-4af6-9c5e-3c639255e153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:07:59.354696 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200234c-bdae-4af6-9c5e-3c639255e153 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:07:59.354973 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200234c-bdae-4af6-9c5e-3c639255e153 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:07:59.355246 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200234c-bdae-4af6-9c5e-3c639255e153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:07:59.363880 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200234c-bdae-4af6-9c5e-3c639255e153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:07:59.365370 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200234c-bdae-4af6-9c5e-3c639255e153 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:07:59.374928 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 693/1392] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:07:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:08:01.747309 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884a47d-9fe1-417a-b2ca-4e55c8a11e1c None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:01.747849 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884a47d-9fe1-417a-b2ca-4e55c8a11e1c None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:01.747849 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884a47d-9fe1-417a-b2ca-4e55c8a11e1c None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:01.749601 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 700/1393] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:08:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:08:01.755357 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e00bef-5dd8-4a13-92a8-4f7e83ca5a4e None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:01.755774 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e00bef-5dd8-4a13-92a8-4f7e83ca5a4e None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:01.755907 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e00bef-5dd8-4a13-92a8-4f7e83ca5a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:01.773447 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-86e00bef-5dd8-4a13-92a8-4f7e83ca5a4e None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:08:01.774816 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-86e00bef-5dd8-4a13-92a8-4f7e83ca5a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:08:01.782693 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 694/1394] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:08:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:08:01.823291 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884a47d-9fe1-417a-b2ca-4e55c8a11e1c None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:08:01.834363 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884a47d-9fe1-417a-b2ca-4e55c8a11e1c None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:08:01.837896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f30c4-48db-4528-a46a-75f63ae6cfaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:08:01.838562 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f30c4-48db-4528-a46a-75f63ae6cfaf service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:01.838841 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f30c4-48db-4528-a46a-75f63ae6cfaf service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:01.839113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f30c4-48db-4528-a46a-75f63ae6cfaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:01.848478 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f30c4-48db-4528-a46a-75f63ae6cfaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:08:01.849905 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015f30c4-48db-4528-a46a-75f63ae6cfaf service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:08:01.859003 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 701/1395] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:08:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:08:04.150250 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f680d8b-c58d-4fb0-bc8b-11a3a881a49c None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:04.150800 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f680d8b-c58d-4fb0-bc8b-11a3a881a49c None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:04.150800 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f680d8b-c58d-4fb0-bc8b-11a3a881a49c None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:04.152561 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 695/1396] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:08:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:08:04.158595 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02021f40-a734-48e2-82be-779984c7b299 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:04.159014 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02021f40-a734-48e2-82be-779984c7b299 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:04.159192 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02021f40-a734-48e2-82be-779984c7b299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:04.178559 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-02021f40-a734-48e2-82be-779984c7b299 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:08:04.179752 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-02021f40-a734-48e2-82be-779984c7b299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:08:04.187507 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 702/1397] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:08:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:08:04.226780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f680d8b-c58d-4fb0-bc8b-11a3a881a49c None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:08:04.237052 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f680d8b-c58d-4fb0-bc8b-11a3a881a49c None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:08:04.241026 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cbb929-b122-41f5-98f6-98fc3bdeca03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:08:04.241644 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbb929-b122-41f5-98f6-98fc3bdeca03 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:04.241949 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbb929-b122-41f5-98f6-98fc3bdeca03 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:04.242220 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbb929-b122-41f5-98f6-98fc3bdeca03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:04.250791 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbb929-b122-41f5-98f6-98fc3bdeca03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:08:04.252194 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cbb929-b122-41f5-98f6-98fc3bdeca03 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:08:04.261729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 696/1398] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:08:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:08:06.566945 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7b784-77c1-4198-8aac-0deabb6dd0a5 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:06.567505 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7b784-77c1-4198-8aac-0deabb6dd0a5 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:06.567505 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7b784-77c1-4198-8aac-0deabb6dd0a5 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:06.569263 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 703/1399] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:08:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:08:06.575243 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5451d0-ff4e-4500-89cb-1026080b2565 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:06.575627 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5451d0-ff4e-4500-89cb-1026080b2565 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:06.575799 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5451d0-ff4e-4500-89cb-1026080b2565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:06.594212 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-6f5451d0-ff4e-4500-89cb-1026080b2565 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:08:06.595408 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-6f5451d0-ff4e-4500-89cb-1026080b2565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:08:06.603776 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 697/1400] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:08:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:08:06.642042 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7b784-77c1-4198-8aac-0deabb6dd0a5 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:08:06.653158 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7b784-77c1-4198-8aac-0deabb6dd0a5 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:08:06.656822 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f48349-66ab-40e4-bde2-bd3847d3a411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:08:06.657517 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f48349-66ab-40e4-bde2-bd3847d3a411 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:06.657796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f48349-66ab-40e4-bde2-bd3847d3a411 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:06.658111 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f48349-66ab-40e4-bde2-bd3847d3a411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:06.667493 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f48349-66ab-40e4-bde2-bd3847d3a411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:08:06.668947 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f48349-66ab-40e4-bde2-bd3847d3a411 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:08:06.678088 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 704/1401] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:08:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:08:08.944937 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558f8ac-7e2d-4bae-95e7-3f54151c49d8 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:08.945513 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558f8ac-7e2d-4bae-95e7-3f54151c49d8 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:08.945513 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0558f8ac-7e2d-4bae-95e7-3f54151c49d8 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:08.948003 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 698/1402] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:08:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:08:08.954321 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792fe20-54b8-44c3-9bc5-3325e13e94f0 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:08.954764 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792fe20-54b8-44c3-9bc5-3325e13e94f0 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:08.954867 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0792fe20-54b8-44c3-9bc5-3325e13e94f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:08.973522 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-0792fe20-54b8-44c3-9bc5-3325e13e94f0 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:08:08.974762 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-0792fe20-54b8-44c3-9bc5-3325e13e94f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:08:08.986308 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 705/1403] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:08:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:08:09.021549 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558f8ac-7e2d-4bae-95e7-3f54151c49d8 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:08:09.032533 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0558f8ac-7e2d-4bae-95e7-3f54151c49d8 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:08:09.036589 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79170fa9-4699-45da-9c58-4d50b0938806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:08:09.037260 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79170fa9-4699-45da-9c58-4d50b0938806 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:09.037551 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79170fa9-4699-45da-9c58-4d50b0938806 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:09.037825 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79170fa9-4699-45da-9c58-4d50b0938806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:09.046817 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79170fa9-4699-45da-9c58-4d50b0938806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:08:09.048246 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79170fa9-4699-45da-9c58-4d50b0938806 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:08:09.058594 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 699/1404] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:08:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:08:11.353930 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a24b7-1b96-4988-923e-7b0542ecd0e7 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:11.354495 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a24b7-1b96-4988-923e-7b0542ecd0e7 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:11.354495 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3a24b7-1b96-4988-923e-7b0542ecd0e7 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:11.356307 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 706/1405] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:08:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:08:11.362237 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a4d55-cc4b-489f-95ae-e7b7dc6015be None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:11.362647 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a4d55-cc4b-489f-95ae-e7b7dc6015be None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:11.362797 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9a4d55-cc4b-489f-95ae-e7b7dc6015be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:11.381122 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-3e9a4d55-cc4b-489f-95ae-e7b7dc6015be None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:08:11.382341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3e9a4d55-cc4b-489f-95ae-e7b7dc6015be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:08:11.389914 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 700/1406] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:08:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:08:11.428100 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a24b7-1b96-4988-923e-7b0542ecd0e7 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:08:11.438417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3a24b7-1b96-4988-923e-7b0542ecd0e7 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:08:11.442374 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc7491-90f4-4e66-a0e9-8109fd4af83b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:08:11.442996 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc7491-90f4-4e66-a0e9-8109fd4af83b service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:11.443277 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc7491-90f4-4e66-a0e9-8109fd4af83b service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:11.443547 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc7491-90f4-4e66-a0e9-8109fd4af83b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:11.452249 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc7491-90f4-4e66-a0e9-8109fd4af83b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:08:11.453670 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc7491-90f4-4e66-a0e9-8109fd4af83b service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:08:11.463209 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 707/1407] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:08:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:08:13.713708 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f51ffb-1dd8-42c2-835f-1f6361f861c4 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:13.714297 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f51ffb-1dd8-42c2-835f-1f6361f861c4 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:13.714297 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f51ffb-1dd8-42c2-835f-1f6361f861c4 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:13.716061 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 701/1408] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:08:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:08:13.721873 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a2193-fa93-4d1f-a65e-5beed33af17f None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:13.722376 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a2193-fa93-4d1f-a65e-5beed33af17f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:13.722477 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a2193-fa93-4d1f-a65e-5beed33af17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:13.739789 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-461a2193-fa93-4d1f-a65e-5beed33af17f None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:08:13.740909 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-461a2193-fa93-4d1f-a65e-5beed33af17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:08:13.748512 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 708/1409] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:08:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:08:13.787423 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f51ffb-1dd8-42c2-835f-1f6361f861c4 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:08:13.789093 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e9f51ffb-1dd8-42c2-835f-1f6361f861c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:08:13.801541 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f51ffb-1dd8-42c2-835f-1f6361f861c4 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:08:13.805030 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d709261-7127-4870-a456-fae0c71f81e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:08:13.805648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d709261-7127-4870-a456-fae0c71f81e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:13.805944 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d709261-7127-4870-a456-fae0c71f81e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:13.806232 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d709261-7127-4870-a456-fae0c71f81e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:13.814773 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d709261-7127-4870-a456-fae0c71f81e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:08:13.816677 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d709261-7127-4870-a456-fae0c71f81e3 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:08:13.825687 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 702/1410] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:08:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:08:16.068707 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbb5d5-b62b-4277-b275-4b827665998e None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:16.069257 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbb5d5-b62b-4277-b275-4b827665998e None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:16.069257 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bbb5d5-b62b-4277-b275-4b827665998e None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:16.070998 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 709/1411] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:08:16 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:08:16.077103 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d4fd-b5ae-4482-bb74-90cca37c87fa None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:16.077501 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d4fd-b5ae-4482-bb74-90cca37c87fa None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:16.077686 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5386d4fd-b5ae-4482-bb74-90cca37c87fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:16.095044 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-5386d4fd-b5ae-4482-bb74-90cca37c87fa None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:08:16.096236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-5386d4fd-b5ae-4482-bb74-90cca37c87fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:08:16.104388 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 703/1412] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:08:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:08:16.142139 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbb5d5-b62b-4277-b275-4b827665998e None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:08:16.153064 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bbb5d5-b62b-4277-b275-4b827665998e None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:08:16.156565 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51050577-f4e2-4c21-ab76-2a8126ad024e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:08:16.157195 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51050577-f4e2-4c21-ab76-2a8126ad024e service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:16.157478 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51050577-f4e2-4c21-ab76-2a8126ad024e service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:16.157754 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51050577-f4e2-4c21-ab76-2a8126ad024e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:16.167029 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51050577-f4e2-4c21-ab76-2a8126ad024e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:08:16.168452 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51050577-f4e2-4c21-ab76-2a8126ad024e service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:08:16.177557 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 710/1413] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:08:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:08:32.968320 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886bf61-9430-4fa2-bd2b-c851cb11e51d None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:32.968924 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886bf61-9430-4fa2-bd2b-c851cb11e51d None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:32.969030 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886bf61-9430-4fa2-bd2b-c851cb11e51d None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:32.970847 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 704/1414] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:08:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:08:32.978341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f782c-923b-4229-b314-dc41b1782560 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:32.978783 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f782c-923b-4229-b314-dc41b1782560 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:32.978908 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7f782c-923b-4229-b314-dc41b1782560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:32.996125 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-fe7f782c-923b-4229-b314-dc41b1782560 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:08:32.997322 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-fe7f782c-923b-4229-b314-dc41b1782560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:08:33.005555 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 711/1415] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:08:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:08:33.054486 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1323f-f22b-4f8c-b91d-fda99692b821 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:33.054778 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1323f-f22b-4f8c-b91d-fda99692b821 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:33.055060 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c1323f-f22b-4f8c-b91d-fda99692b821 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:33.056813 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 705/1416] 10.222.0.41 () {54 vars in 962 bytes} [Fri Oct 29 16:08:33 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:08:33.062002 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1594c-ba39-40d2-9220-483b363ab1eb None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:33.062285 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1594c-ba39-40d2-9220-483b363ab1eb None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:33.062556 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1594c-ba39-40d2-9220-483b363ab1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:33.083560 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-eae1594c-ba39-40d2-9220-483b363ab1eb None None] MFA Rules not processed for user `e27a0c9ae2bf40caa92e9dbceff8d68b`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:08:33.084724 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-eae1594c-ba39-40d2-9220-483b363ab1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:08:33.090961 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 712/1417] 10.222.0.41 () {58 vars in 1059 bytes} [Fri Oct 29 16:08:33 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:08:33.098433 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1323f-f22b-4f8c-b91d-fda99692b821 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:08:33.108730 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c1323f-f22b-4f8c-b91d-fda99692b821 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:08:33.112211 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5949b-7cd9-4132-8e5a-9279ed877900 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27a0c9ae2bf40caa92e9dbceff8d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:08:33.112855 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5949b-7cd9-4132-8e5a-9279ed877900 service glance] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:33.113138 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5949b-7cd9-4132-8e5a-9279ed877900 service glance] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:33.113414 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5949b-7cd9-4132-8e5a-9279ed877900 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:33.121978 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5949b-7cd9-4132-8e5a-9279ed877900 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:08:33.123388 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5949b-7cd9-4132-8e5a-9279ed877900 service glance] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:08:33.133086 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 706/1418] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:08:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:08:35.449215 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff2d8b-d5dd-48a2-9e22-bcf58d848607 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:35.449790 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff2d8b-d5dd-48a2-9e22-bcf58d848607 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:35.449790 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff2d8b-d5dd-48a2-9e22-bcf58d848607 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:35.451557 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 713/1419] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:08:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:08:35.458248 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4466807-bfc1-4039-bafa-a4a336f2bfda None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:35.458665 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4466807-bfc1-4039-bafa-a4a336f2bfda None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:35.458795 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4466807-bfc1-4039-bafa-a4a336f2bfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:35.475827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-e4466807-bfc1-4039-bafa-a4a336f2bfda None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:08:35.476993 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e4466807-bfc1-4039-bafa-a4a336f2bfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:08:35.484624 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 707/1420] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:08:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:08:35.508915 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff2d8b-d5dd-48a2-9e22-bcf58d848607 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:08:35.521584 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff2d8b-d5dd-48a2-9e22-bcf58d848607 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:08:35.526330 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d21b7-bad7-4c8c-8ab6-ef3356347b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:08:35.526971 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d21b7-bad7-4c8c-8ab6-ef3356347b27 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:35.527254 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d21b7-bad7-4c8c-8ab6-ef3356347b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:35.527528 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d21b7-bad7-4c8c-8ab6-ef3356347b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:35.528264 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d21b7-bad7-4c8c-8ab6-ef3356347b27 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:08:35.530166 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d21b7-bad7-4c8c-8ab6-ef3356347b27 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:08:35.548350 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 714/1421] 10.222.0.41 () {56 vars in 1108 bytes} [Fri Oct 29 16:08:35 2021] GET /identity/v3/projects => generated 2553 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:08:37.813693 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691e0ac-b450-4315-a91c-5b150ab6c4e4 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:37.814248 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691e0ac-b450-4315-a91c-5b150ab6c4e4 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:37.814356 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691e0ac-b450-4315-a91c-5b150ab6c4e4 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:37.816072 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 708/1422] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:08:37 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:08:37.821907 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6eb8-8b83-431a-bab6-fe729f77aa61 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:37.822329 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6eb8-8b83-431a-bab6-fe729f77aa61 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:37.822488 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6eb8-8b83-431a-bab6-fe729f77aa61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:37.840511 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-bcbd6eb8-8b83-431a-bab6-fe729f77aa61 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:08:37.841707 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-bcbd6eb8-8b83-431a-bab6-fe729f77aa61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:08:37.850503 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 715/1423] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:08:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:08:37.895364 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691e0ac-b450-4315-a91c-5b150ab6c4e4 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:08:37.910102 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691e0ac-b450-4315-a91c-5b150ab6c4e4 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:08:37.915392 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c8b7f-9ed8-4e08-b661-ffb35a8dd4da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:08:37.916017 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c8b7f-9ed8-4e08-b661-ffb35a8dd4da service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:37.916301 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c8b7f-9ed8-4e08-b661-ffb35a8dd4da service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:37.916577 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c8b7f-9ed8-4e08-b661-ffb35a8dd4da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:37.924400 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c8b7f-9ed8-4e08-b661-ffb35a8dd4da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:08:37.926001 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c8b7f-9ed8-4e08-b661-ffb35a8dd4da service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:08:37.935413 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 709/1424] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:08:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:08:40.348716 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23187d-edb1-4716-965d-a84d37e2594f None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:40.349282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23187d-edb1-4716-965d-a84d37e2594f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:40.349282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23187d-edb1-4716-965d-a84d37e2594f None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:40.351087 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 716/1425] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:08:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:08:40.356994 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc7517-c6cb-4fa3-a0ae-fdb7ba638344 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:40.357435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc7517-c6cb-4fa3-a0ae-fdb7ba638344 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:40.357574 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc7517-c6cb-4fa3-a0ae-fdb7ba638344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:40.374849 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-90cc7517-c6cb-4fa3-a0ae-fdb7ba638344 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:08:40.376067 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-90cc7517-c6cb-4fa3-a0ae-fdb7ba638344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:08:40.383709 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 710/1426] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:08:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:08:40.422258 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23187d-edb1-4716-965d-a84d37e2594f None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:08:40.432573 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23187d-edb1-4716-965d-a84d37e2594f None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:08:40.436060 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446513a5-93fe-4cc5-b330-369f84ce330f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:08:40.436694 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446513a5-93fe-4cc5-b330-369f84ce330f service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:40.436980 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446513a5-93fe-4cc5-b330-369f84ce330f service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:40.437272 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446513a5-93fe-4cc5-b330-369f84ce330f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:40.445833 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446513a5-93fe-4cc5-b330-369f84ce330f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:08:40.447299 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446513a5-93fe-4cc5-b330-369f84ce330f service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:08:40.457354 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 717/1427] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:08:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:08:42.756603 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff57f4-7a2b-4bb6-a66e-6ac44e59858c None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:42.757171 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff57f4-7a2b-4bb6-a66e-6ac44e59858c None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:42.757171 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff57f4-7a2b-4bb6-a66e-6ac44e59858c None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:42.758950 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 711/1428] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:08:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:08:42.764987 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701da3fd-e380-4a03-8d63-1756a6aaa649 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:42.765421 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701da3fd-e380-4a03-8d63-1756a6aaa649 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:42.765525 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701da3fd-e380-4a03-8d63-1756a6aaa649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:42.783058 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-701da3fd-e380-4a03-8d63-1756a6aaa649 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:08:42.784759 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-701da3fd-e380-4a03-8d63-1756a6aaa649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:08:42.792510 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 718/1429] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:08:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:08:42.832318 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff57f4-7a2b-4bb6-a66e-6ac44e59858c None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:08:42.842650 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff57f4-7a2b-4bb6-a66e-6ac44e59858c None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:08:42.846125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e509e-d75f-475b-8158-79637b7d1ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:08:42.847251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e509e-d75f-475b-8158-79637b7d1ecd service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:42.847530 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e509e-d75f-475b-8158-79637b7d1ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:42.847802 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e509e-d75f-475b-8158-79637b7d1ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:42.856293 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e509e-d75f-475b-8158-79637b7d1ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:08:42.857707 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e509e-d75f-475b-8158-79637b7d1ecd service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:08:42.867658 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 712/1430] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:08:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:08:45.197893 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b771e4-8621-4687-a4a6-c3096a413469 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:45.198470 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b771e4-8621-4687-a4a6-c3096a413469 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:45.198470 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b771e4-8621-4687-a4a6-c3096a413469 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:45.200307 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 719/1431] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:08:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:08:45.209630 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c725e7-a453-4746-8fea-fa272ddade40 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:45.210112 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c725e7-a453-4746-8fea-fa272ddade40 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:45.210463 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c725e7-a453-4746-8fea-fa272ddade40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:45.227959 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-03c725e7-a453-4746-8fea-fa272ddade40 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:08:45.229299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-03c725e7-a453-4746-8fea-fa272ddade40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:08:45.236915 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 713/1432] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:08:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:08:45.278373 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b771e4-8621-4687-a4a6-c3096a413469 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:08:45.288624 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b771e4-8621-4687-a4a6-c3096a413469 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:08:45.292132 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c0c68-fff8-48f0-81e1-a87e84e4e9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:08:45.292758 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c0c68-fff8-48f0-81e1-a87e84e4e9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:45.293041 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c0c68-fff8-48f0-81e1-a87e84e4e9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:45.293315 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c0c68-fff8-48f0-81e1-a87e84e4e9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:45.301819 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c0c68-fff8-48f0-81e1-a87e84e4e9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:08:45.303294 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c0c68-fff8-48f0-81e1-a87e84e4e9c6 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:08:45.312691 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 720/1433] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:08:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:08:47.765201 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565620d-008d-4dfa-a3b6-61b633877709 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:47.765703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565620d-008d-4dfa-a3b6-61b633877709 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:47.765703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565620d-008d-4dfa-a3b6-61b633877709 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:47.767469 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 714/1434] 10.222.0.41 () {54 vars in 926 bytes} [Fri Oct 29 16:08:47 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:08:47.774072 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87155a9a-a5d5-4404-bb09-dbb9b48ba234 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:47.774498 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87155a9a-a5d5-4404-bb09-dbb9b48ba234 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:47.774633 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87155a9a-a5d5-4404-bb09-dbb9b48ba234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:47.792472 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-87155a9a-a5d5-4404-bb09-dbb9b48ba234 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:08:47.793661 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-87155a9a-a5d5-4404-bb09-dbb9b48ba234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:08:47.801382 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 721/1435] 10.222.0.41 () {58 vars in 1023 bytes} [Fri Oct 29 16:08:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:08:47.841738 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565620d-008d-4dfa-a3b6-61b633877709 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:08:47.852820 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565620d-008d-4dfa-a3b6-61b633877709 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:08:47.856390 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190c7ec8-8cf2-4a36-872b-074df53ba3b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:08:47.857012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c7ec8-8cf2-4a36-872b-074df53ba3b9 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:08:47.857295 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c7ec8-8cf2-4a36-872b-074df53ba3b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:08:47.857570 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190c7ec8-8cf2-4a36-872b-074df53ba3b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:08:47.866257 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c7ec8-8cf2-4a36-872b-074df53ba3b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:08:47.867686 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190c7ec8-8cf2-4a36-872b-074df53ba3b9 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:08:47.876760 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 715/1436] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:08:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:09:56.255950 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294b6e1-0276-4a5a-a32d-cf3640a797de None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:09:56.256492 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294b6e1-0276-4a5a-a32d-cf3640a797de None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:09:56.256492 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294b6e1-0276-4a5a-a32d-cf3640a797de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:09:56.275502 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-d294b6e1-0276-4a5a-a32d-cf3640a797de None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:09:56.276677 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-d294b6e1-0276-4a5a-a32d-cf3640a797de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:09:56.284242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 722/1437] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:09:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:09:56.292264 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6ece7-1b85-4c9f-bc0d-a0e0eab48863 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:09:56.292740 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6ece7-1b85-4c9f-bc0d-a0e0eab48863 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:09:56.292856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6ece7-1b85-4c9f-bc0d-a0e0eab48863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:09:56.310343 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-42d6ece7-1b85-4c9f-bc0d-a0e0eab48863 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:09:56.311529 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-42d6ece7-1b85-4c9f-bc0d-a0e0eab48863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:09:56.319767 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 716/1438] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:09:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:09:56.324121 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294b6e1-0276-4a5a-a32d-cf3640a797de None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:09:56.334193 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294b6e1-0276-4a5a-a32d-cf3640a797de None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:09:56.338727 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d0693-04aa-4dff-9748-132bf67a2ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:09:56.339375 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d0693-04aa-4dff-9748-132bf67a2ccd admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:09:56.339656 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d0693-04aa-4dff-9748-132bf67a2ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:09:56.339931 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352d0693-04aa-4dff-9748-132bf67a2ccd admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:09:56.340660 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d0693-04aa-4dff-9748-132bf67a2ccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:09:56.340972 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d0693-04aa-4dff-9748-132bf67a2ccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:09:56.342613 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352d0693-04aa-4dff-9748-132bf67a2ccd admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:09:56.353576 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 723/1439] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:09:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:09:56.361449 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6ece7-1b85-4c9f-bc0d-a0e0eab48863 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:09:56.370243 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6ece7-1b85-4c9f-bc0d-a0e0eab48863 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:09:56.374693 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf8593-2787-4bb4-9c26-72709c11442b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:09:56.375320 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf8593-2787-4bb4-9c26-72709c11442b admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:09:56.375595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf8593-2787-4bb4-9c26-72709c11442b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:09:56.375872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf8593-2787-4bb4-9c26-72709c11442b admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:09:56.377073 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf8593-2787-4bb4-9c26-72709c11442b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:09:56.378980 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf8593-2787-4bb4-9c26-72709c11442b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:09:56.413546 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 717/1440] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:09:56 2021] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:09:56.417613 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d0693-04aa-4dff-9748-132bf67a2ccd admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:09:56.427268 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352d0693-04aa-4dff-9748-132bf67a2ccd admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:09:56.480535 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773ad44-20ff-438d-8cb6-eb527493d3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:09:56.481194 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773ad44-20ff-438d-8cb6-eb527493d3a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:09:56.481476 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773ad44-20ff-438d-8cb6-eb527493d3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:09:56.481749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773ad44-20ff-438d-8cb6-eb527493d3a2 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:09:56.482488 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773ad44-20ff-438d-8cb6-eb527493d3a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:09:56.484434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773ad44-20ff-438d-8cb6-eb527493d3a2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:09:56.504078 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 724/1441] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:09:56 2021] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:09:56.508183 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf8593-2787-4bb4-9c26-72709c11442b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:09:56.518682 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf8593-2787-4bb4-9c26-72709c11442b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:09:56.523130 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620af968-b473-447b-99ce-ed843206f239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:09:56.523809 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620af968-b473-447b-99ce-ed843206f239 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:09:56.524083 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620af968-b473-447b-99ce-ed843206f239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:09:56.524360 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620af968-b473-447b-99ce-ed843206f239 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:09:56.525095 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620af968-b473-447b-99ce-ed843206f239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:09:56.526764 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620af968-b473-447b-99ce-ed843206f239 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:09:56.540359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 718/1442] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:09:56 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:09:56.544175 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773ad44-20ff-438d-8cb6-eb527493d3a2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:09:56.553726 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773ad44-20ff-438d-8cb6-eb527493d3a2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:09:56.558224 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bba16a-5942-41f3-9cd9-144820972f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:09:56.558871 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bba16a-5942-41f3-9cd9-144820972f99 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:09:56.559155 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bba16a-5942-41f3-9cd9-144820972f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:09:56.559431 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bba16a-5942-41f3-9cd9-144820972f99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:09:56.560168 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bba16a-5942-41f3-9cd9-144820972f99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:09:56.561757 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bba16a-5942-41f3-9cd9-144820972f99 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:09:56.575045 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 725/1443] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:09:56 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:09:56.579801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620af968-b473-447b-99ce-ed843206f239 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:09:56.589285 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620af968-b473-447b-99ce-ed843206f239 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:09:56.593778 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384d120-c287-4687-bfa5-c1edabf36923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:09:56.594661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384d120-c287-4687-bfa5-c1edabf36923 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:09:56.594964 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384d120-c287-4687-bfa5-c1edabf36923 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:09:56.595232 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5384d120-c287-4687-bfa5-c1edabf36923 admin admin] PATH_INFO: `/v3/projects/48e6331622da4743bba5cd2b25ead788/users/605be41577ce4eb9acea990aee18a976/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:09:56.608773 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384d120-c287-4687-bfa5-c1edabf36923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e6331622da4743bba5cd2b25ead788, user_id=605be41577ce4eb9acea990aee18a976, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:09:56.611969 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5384d120-c287-4687-bfa5-c1edabf36923 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:09:56.624236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 719/1444] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:09:56 2021] PUT /identity/v3/projects/48e6331622da4743bba5cd2b25ead788/users/605be41577ce4eb9acea990aee18a976/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:09:56.636933 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce175eb6-b774-4c4a-b178-f548c82ed878 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:09:56.637226 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce175eb6-b774-4c4a-b178-f548c82ed878 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:09:56.637502 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce175eb6-b774-4c4a-b178-f548c82ed878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:09:56.665012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-ce175eb6-b774-4c4a-b178-f548c82ed878 None None] MFA Rules not processed for user `605be41577ce4eb9acea990aee18a976`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:09:56.666269 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ce175eb6-b774-4c4a-b178-f548c82ed878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:09:56.727292 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 726/1445] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:09:56 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:09:56.739494 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384d120-c287-4687-bfa5-c1edabf36923 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:09:56.806098 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5384d120-c287-4687-bfa5-c1edabf36923 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:09:56.811435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eff6dd-bff6-4d59-819f-e2891c81e54a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:09:56.812069 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eff6dd-bff6-4d59-819f-e2891c81e54a service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:09:56.812348 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eff6dd-bff6-4d59-819f-e2891c81e54a service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:09:56.812618 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eff6dd-bff6-4d59-819f-e2891c81e54a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:09:56.820745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eff6dd-bff6-4d59-819f-e2891c81e54a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:09:56.822373 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eff6dd-bff6-4d59-819f-e2891c81e54a service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:09:56.831278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 720/1446] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:09:56 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:09:56.898145 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb89ac-3e41-488f-bbb7-e1f310eaa804 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:09:56.898438 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb89ac-3e41-488f-bbb7-e1f310eaa804 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:09:56.898720 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bb89ac-3e41-488f-bbb7-e1f310eaa804 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:09:56.900422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 727/1447] 10.222.0.41 () {52 vars in 829 bytes} [Fri Oct 29 16:09:56 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:09:56.903974 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eff6dd-bff6-4d59-819f-e2891c81e54a service nova] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:09:56.962761 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eff6dd-bff6-4d59-819f-e2891c81e54a service nova] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:09:56.967230 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e4433-1d88-46d5-82b7-7ac636bc0ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:09:56.968066 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e4433-1d88-46d5-82b7-7ac636bc0ec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:09:56.968347 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e4433-1d88-46d5-82b7-7ac636bc0ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:09:56.968620 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e4433-1d88-46d5-82b7-7ac636bc0ec0 admin admin] PATH_INFO: `/v3/users/605be41577ce4eb9acea990aee18a976` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:09:56.970329 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e4433-1d88-46d5-82b7-7ac636bc0ec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=605be41577ce4eb9acea990aee18a976)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:09:56.971338 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING py.warnings [None req-573e4433-1d88-46d5-82b7-7ac636bc0ec0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:09:56.971338 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: warnings.warn(msg) Oct 29 16:09:56.971338 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: Oct 29 16:09:56.972538 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573e4433-1d88-46d5-82b7-7ac636bc0ec0 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:09:57.036571 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-573e4433-1d88-46d5-82b7-7ac636bc0ec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '605be41577ce4eb9acea990aee18a976'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:09:57.045485 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-573e4433-1d88-46d5-82b7-7ac636bc0ec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '605be41577ce4eb9acea990aee18a976'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:09:57.058231 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-573e4433-1d88-46d5-82b7-7ac636bc0ec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '605be41577ce4eb9acea990aee18a976'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:09:57.058890 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-573e4433-1d88-46d5-82b7-7ac636bc0ec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '605be41577ce4eb9acea990aee18a976'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:09:57.078966 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-573e4433-1d88-46d5-82b7-7ac636bc0ec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '605be41577ce4eb9acea990aee18a976'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:09:57.085110 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 721/1448] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:09:56 2021] DELETE /identity/v3/users/605be41577ce4eb9acea990aee18a976 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:09:57.089607 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5916f33-dc40-4bdc-bc64-0e59d1718f3c None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:09:57.089900 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5916f33-dc40-4bdc-bc64-0e59d1718f3c None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:09:57.090210 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5916f33-dc40-4bdc-bc64-0e59d1718f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:09:57.107598 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-b5916f33-dc40-4bdc-bc64-0e59d1718f3c None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:09:57.108784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b5916f33-dc40-4bdc-bc64-0e59d1718f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:09:57.163586 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 728/1449] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:09:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:09:57.174057 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e4433-1d88-46d5-82b7-7ac636bc0ec0 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:09:57.175454 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-573e4433-1d88-46d5-82b7-7ac636bc0ec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:09:57.229707 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e4433-1d88-46d5-82b7-7ac636bc0ec0 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:09:57.233344 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7435af-45c0-405a-9513-f62769ec18d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:09:57.234011 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7435af-45c0-405a-9513-f62769ec18d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:09:57.234301 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7435af-45c0-405a-9513-f62769ec18d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:09:57.234580 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7435af-45c0-405a-9513-f62769ec18d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:09:57.243856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7435af-45c0-405a-9513-f62769ec18d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:09:57.245284 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7435af-45c0-405a-9513-f62769ec18d1 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:09:57.255310 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 722/1450] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:09:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:09:57.566228 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5916f33-dc40-4bdc-bc64-0e59d1718f3c None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:09:57.567750 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b5916f33-dc40-4bdc-bc64-0e59d1718f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:09:57.580661 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5916f33-dc40-4bdc-bc64-0e59d1718f3c None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:09:57.585407 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3797876-579f-4d19-92cb-87e473ad0acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:09:57.586292 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3797876-579f-4d19-92cb-87e473ad0acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:09:57.586575 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3797876-579f-4d19-92cb-87e473ad0acf admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:09:57.586846 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3797876-579f-4d19-92cb-87e473ad0acf admin admin] PATH_INFO: `/v3/projects/48e6331622da4743bba5cd2b25ead788` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:09:57.588034 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3797876-579f-4d19-92cb-87e473ad0acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=48e6331622da4743bba5cd2b25ead788)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:09:57.595500 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING py.warnings [None req-d3797876-579f-4d19-92cb-87e473ad0acf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:09:57.595500 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: warnings.warn(msg) Oct 29 16:09:57.595500 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: Oct 29 16:09:57.596667 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3797876-579f-4d19-92cb-87e473ad0acf admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:09:57.655408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d3797876-579f-4d19-92cb-87e473ad0acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48e6331622da4743bba5cd2b25ead788', 'request_id': 'req-d3797876-579f-4d19-92cb-87e473ad0acf'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:09:57.661804 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d3797876-579f-4d19-92cb-87e473ad0acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48e6331622da4743bba5cd2b25ead788', 'request_id': 'req-d3797876-579f-4d19-92cb-87e473ad0acf'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:09:57.670387 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d3797876-579f-4d19-92cb-87e473ad0acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48e6331622da4743bba5cd2b25ead788', 'request_id': 'req-d3797876-579f-4d19-92cb-87e473ad0acf'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:09:57.688438 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d3797876-579f-4d19-92cb-87e473ad0acf admin admin] The token cache is being invalidate because project 48e6331622da4743bba5cd2b25ead788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:09:57.688724 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d3797876-579f-4d19-92cb-87e473ad0acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:09:57.689456 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d3797876-579f-4d19-92cb-87e473ad0acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:09:57.691049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 729/1451] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:09:57 2021] DELETE /identity/v3/projects/48e6331622da4743bba5cd2b25ead788 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:11:28.665625 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024afb87-5363-4962-af1b-1dc0ea0e6b0b None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:28.666236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024afb87-5363-4962-af1b-1dc0ea0e6b0b None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:28.666236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024afb87-5363-4962-af1b-1dc0ea0e6b0b None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:28.667976 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 723/1452] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 29 16:11:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:11:28.673340 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a416b1-6903-44ef-ae0f-7ff199ddf2d8 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:28.673800 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a416b1-6903-44ef-ae0f-7ff199ddf2d8 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:28.673899 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a416b1-6903-44ef-ae0f-7ff199ddf2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:28.692134 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-44a416b1-6903-44ef-ae0f-7ff199ddf2d8 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:11:28.693350 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-44a416b1-6903-44ef-ae0f-7ff199ddf2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:11:28.751200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 730/1453] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 29 16:11:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:11:28.877821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aff70-2c65-49be-8f22-25999013df9c None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:28.878206 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aff70-2c65-49be-8f22-25999013df9c None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:28.878503 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0aff70-2c65-49be-8f22-25999013df9c None None] PATH_INFO: `/v3` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:28.879694 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 724/1454] 10.222.0.53 () {54 vars in 925 bytes} [Fri Oct 29 16:11:28 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:11:28.911983 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa386a-e5ce-4dfb-85c1-13da8b171eb6 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:28.912274 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa386a-e5ce-4dfb-85c1-13da8b171eb6 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:28.912554 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa386a-e5ce-4dfb-85c1-13da8b171eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:28.917090 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0aff70-2c65-49be-8f22-25999013df9c None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:11:28.919115 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-6f0aff70-2c65-49be-8f22-25999013df9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:11:28.931506 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-7dfa386a-e5ce-4dfb-85c1-13da8b171eb6 None None] MFA Rules not processed for user `34c34efa8fd24230aa45e0f67209260e`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:11:28.932733 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-7dfa386a-e5ce-4dfb-85c1-13da8b171eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:11:28.994616 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0aff70-2c65-49be-8f22-25999013df9c None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:11:28.995168 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 731/1455] 10.222.0.53 () {58 vars in 1015 bytes} [Fri Oct 29 16:11:28 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:11:29.000224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493a552-53f6-40b8-ab8e-c1ff2e7acf04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:11:29.000939 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493a552-53f6-40b8-ab8e-c1ff2e7acf04 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:29.001224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493a552-53f6-40b8-ab8e-c1ff2e7acf04 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:29.001500 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493a552-53f6-40b8-ab8e-c1ff2e7acf04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:29.010139 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493a552-53f6-40b8-ab8e-c1ff2e7acf04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:11:29.011721 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493a552-53f6-40b8-ab8e-c1ff2e7acf04 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:11:29.021290 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 725/1456] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:11:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:11:30.448832 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822e300-e163-4dce-9bfb-3a258892328d None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:30.449413 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822e300-e163-4dce-9bfb-3a258892328d None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:30.449413 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3822e300-e163-4dce-9bfb-3a258892328d None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:30.451212 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 732/1457] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 29 16:11:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:11:30.456703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477fed7-a663-4356-aefe-c5f607599d82 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:30.457692 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477fed7-a663-4356-aefe-c5f607599d82 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:30.457883 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8477fed7-a663-4356-aefe-c5f607599d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:30.478261 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-8477fed7-a663-4356-aefe-c5f607599d82 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:11:30.479474 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8477fed7-a663-4356-aefe-c5f607599d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:11:30.487252 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 726/1458] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 29 16:11:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:11:30.638995 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822e300-e163-4dce-9bfb-3a258892328d None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:11:30.653882 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3822e300-e163-4dce-9bfb-3a258892328d None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:11:30.659245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e934792d-4ccc-42a3-9ec5-299187e69062 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:11:30.659893 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934792d-4ccc-42a3-9ec5-299187e69062 service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:30.660155 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934792d-4ccc-42a3-9ec5-299187e69062 service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:30.660699 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e934792d-4ccc-42a3-9ec5-299187e69062 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:30.668473 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934792d-4ccc-42a3-9ec5-299187e69062 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:11:30.670101 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e934792d-4ccc-42a3-9ec5-299187e69062 service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:11:30.680029 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 733/1459] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:11:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:11:32.715453 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cdb89-4c87-4b04-abcf-8f07d2042ad3 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:32.715907 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cdb89-4c87-4b04-abcf-8f07d2042ad3 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:32.716006 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4cdb89-4c87-4b04-abcf-8f07d2042ad3 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:32.717815 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 727/1460] 10.222.0.41 () {54 vars in 960 bytes} [Fri Oct 29 16:11:32 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:11:32.723808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295dfab-7b2a-404a-8e25-e80fb8e2904e None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:32.724237 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295dfab-7b2a-404a-8e25-e80fb8e2904e None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:32.724481 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295dfab-7b2a-404a-8e25-e80fb8e2904e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:32.742040 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-d295dfab-7b2a-404a-8e25-e80fb8e2904e None None] MFA Rules not processed for user `34c34efa8fd24230aa45e0f67209260e`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:11:32.743217 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-d295dfab-7b2a-404a-8e25-e80fb8e2904e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:11:32.751533 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 734/1461] 10.222.0.41 () {58 vars in 1057 bytes} [Fri Oct 29 16:11:32 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:11:32.759308 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4cdb89-4c87-4b04-abcf-8f07d2042ad3 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:11:32.773249 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4cdb89-4c87-4b04-abcf-8f07d2042ad3 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:11:32.778943 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980eb7d-b0e3-4e96-ae2e-374a4a4a143b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:11:32.779120 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980eb7d-b0e3-4e96-ae2e-374a4a4a143b service placement] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:32.779346 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980eb7d-b0e3-4e96-ae2e-374a4a4a143b service placement] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:32.779619 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980eb7d-b0e3-4e96-ae2e-374a4a4a143b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:32.788501 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980eb7d-b0e3-4e96-ae2e-374a4a4a143b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:11:32.790116 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980eb7d-b0e3-4e96-ae2e-374a4a4a143b service placement] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:11:32.799405 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 728/1462] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:11:32 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:11:42.518906 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133f779-7f31-4d3d-8eda-464c8381f3f2 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:42.519391 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133f779-7f31-4d3d-8eda-464c8381f3f2 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:42.519495 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133f779-7f31-4d3d-8eda-464c8381f3f2 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:42.521298 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 735/1463] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 29 16:11:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:11:42.526563 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3e9d5-bd91-444b-86c5-0b39accdd420 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:42.527017 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3e9d5-bd91-444b-86c5-0b39accdd420 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:42.527134 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3e9d5-bd91-444b-86c5-0b39accdd420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:42.544502 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-e9d3e9d5-bd91-444b-86c5-0b39accdd420 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:11:42.545679 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e9d3e9d5-bd91-444b-86c5-0b39accdd420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:11:42.553805 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 729/1464] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 29 16:11:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:11:42.709270 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133f779-7f31-4d3d-8eda-464c8381f3f2 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:11:42.724318 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2133f779-7f31-4d3d-8eda-464c8381f3f2 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:11:42.729701 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec35c8-ce68-472f-9712-76a71766e38b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:11:42.730397 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec35c8-ce68-472f-9712-76a71766e38b service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:42.730677 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec35c8-ce68-472f-9712-76a71766e38b service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:42.730944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec35c8-ce68-472f-9712-76a71766e38b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:42.740625 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec35c8-ce68-472f-9712-76a71766e38b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:11:42.742280 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec35c8-ce68-472f-9712-76a71766e38b service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:11:42.752967 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 736/1465] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:11:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:11:44.157438 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14e657-c016-4d8f-91c8-d6287520381f None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:44.158031 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14e657-c016-4d8f-91c8-d6287520381f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:44.158031 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf14e657-c016-4d8f-91c8-d6287520381f None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:44.160394 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 730/1466] 127.0.0.1 () {54 vars in 901 bytes} [Fri Oct 29 16:11:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:11:44.165725 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950925d-5b5e-44e5-897e-f5047ce89c3f None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:44.166144 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950925d-5b5e-44e5-897e-f5047ce89c3f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:44.166347 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950925d-5b5e-44e5-897e-f5047ce89c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:44.184567 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-d950925d-5b5e-44e5-897e-f5047ce89c3f None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:11:44.185760 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-d950925d-5b5e-44e5-897e-f5047ce89c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:11:44.193676 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 737/1467] 127.0.0.1 () {58 vars in 998 bytes} [Fri Oct 29 16:11:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:11:44.345856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14e657-c016-4d8f-91c8-d6287520381f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:11:44.360078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf14e657-c016-4d8f-91c8-d6287520381f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:11:44.365953 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9535d-7352-421c-84bb-dff30e41b47e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:11:44.366580 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9535d-7352-421c-84bb-dff30e41b47e service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:44.366857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9535d-7352-421c-84bb-dff30e41b47e service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:44.367127 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9535d-7352-421c-84bb-dff30e41b47e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:44.374805 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9535d-7352-421c-84bb-dff30e41b47e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:11:44.376357 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9535d-7352-421c-84bb-dff30e41b47e service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:11:44.385866 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 731/1468] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:11:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:11:48.698023 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f23257-2a40-4726-a373-0b22ff854ff2 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:48.698587 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f23257-2a40-4726-a373-0b22ff854ff2 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:48.698587 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f23257-2a40-4726-a373-0b22ff854ff2 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:48.700350 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 738/1469] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 29 16:11:48 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:11:48.707048 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa8d4c-d820-4770-82b9-5882eaa263f2 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:48.707465 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa8d4c-d820-4770-82b9-5882eaa263f2 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:48.707598 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fa8d4c-d820-4770-82b9-5882eaa263f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:48.725071 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-e2fa8d4c-d820-4770-82b9-5882eaa263f2 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:11:48.726317 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e2fa8d4c-d820-4770-82b9-5882eaa263f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:11:48.734111 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 732/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 29 16:11:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:11:48.772417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f23257-2a40-4726-a373-0b22ff854ff2 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:11:48.774135 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a0f23257-2a40-4726-a373-0b22ff854ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:11:48.828844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f23257-2a40-4726-a373-0b22ff854ff2 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:11:48.833260 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f3fcd-5305-435a-809c-f6192c5548b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:11:48.833904 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f3fcd-5305-435a-809c-f6192c5548b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:48.834219 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f3fcd-5305-435a-809c-f6192c5548b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:48.834499 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f3fcd-5305-435a-809c-f6192c5548b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:48.843126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f3fcd-5305-435a-809c-f6192c5548b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:11:48.844562 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f3fcd-5305-435a-809c-f6192c5548b3 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:11:48.853839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 739/1471] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:11:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:11:51.121058 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5992af2-c8fd-4c23-bd4b-877fa0d94557 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:51.121599 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5992af2-c8fd-4c23-bd4b-877fa0d94557 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:51.121599 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5992af2-c8fd-4c23-bd4b-877fa0d94557 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:51.123439 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 733/1472] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 29 16:11:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:11:51.129304 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6eaff-978d-4d07-850b-15fa5186a0ce None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:51.129734 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6eaff-978d-4d07-850b-15fa5186a0ce None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:51.129888 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6eaff-978d-4d07-850b-15fa5186a0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:51.147414 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e0a6eaff-978d-4d07-850b-15fa5186a0ce None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:11:51.148595 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e0a6eaff-978d-4d07-850b-15fa5186a0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:11:51.156398 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 740/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 29 16:11:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:11:51.193821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5992af2-c8fd-4c23-bd4b-877fa0d94557 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:11:51.204294 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5992af2-c8fd-4c23-bd4b-877fa0d94557 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:11:51.208103 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914a819-1f0e-4dda-968d-a7db510a14cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:11:51.208724 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914a819-1f0e-4dda-968d-a7db510a14cf service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:51.209006 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914a819-1f0e-4dda-968d-a7db510a14cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:51.209284 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914a819-1f0e-4dda-968d-a7db510a14cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:51.218030 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914a819-1f0e-4dda-968d-a7db510a14cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:11:51.219441 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914a819-1f0e-4dda-968d-a7db510a14cf service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:11:51.229025 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 734/1474] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:11:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:11:54.876740 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a0874-6249-46fa-97e0-91e1b5a6e502 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:54.877296 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a0874-6249-46fa-97e0-91e1b5a6e502 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:54.877409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958a0874-6249-46fa-97e0-91e1b5a6e502 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:54.879818 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 741/1475] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 29 16:11:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:11:54.885705 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364651cc-9b22-4daa-b2ba-2fe369ceaa69 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:54.886154 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364651cc-9b22-4daa-b2ba-2fe369ceaa69 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:54.886281 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364651cc-9b22-4daa-b2ba-2fe369ceaa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:54.904474 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-364651cc-9b22-4daa-b2ba-2fe369ceaa69 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:11:54.905655 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-364651cc-9b22-4daa-b2ba-2fe369ceaa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:11:54.913256 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 735/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 29 16:11:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:11:54.965124 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a0874-6249-46fa-97e0-91e1b5a6e502 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:11:54.966825 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-958a0874-6249-46fa-97e0-91e1b5a6e502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:11:55.021796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958a0874-6249-46fa-97e0-91e1b5a6e502 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:11:55.025303 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60798f-a66c-4c0f-b5ec-ff51069a206b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:11:55.025965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60798f-a66c-4c0f-b5ec-ff51069a206b service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:55.026254 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60798f-a66c-4c0f-b5ec-ff51069a206b service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:55.026528 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60798f-a66c-4c0f-b5ec-ff51069a206b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:55.035175 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60798f-a66c-4c0f-b5ec-ff51069a206b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:11:55.036547 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60798f-a66c-4c0f-b5ec-ff51069a206b service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:11:55.045664 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 742/1477] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:11:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:11:57.283122 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9c12a-87c3-461d-ade0-d85575df384d None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:57.283658 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9c12a-87c3-461d-ade0-d85575df384d None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:57.283658 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be9c12a-87c3-461d-ade0-d85575df384d None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:57.285448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 736/1478] 127.0.0.1 () {54 vars in 916 bytes} [Fri Oct 29 16:11:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:11:57.291126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6bd9-61df-4d85-969b-0ca446c8539a None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:57.291571 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6bd9-61df-4d85-969b-0ca446c8539a None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:57.291677 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a6bd9-61df-4d85-969b-0ca446c8539a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:57.309795 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e09a6bd9-61df-4d85-969b-0ca446c8539a None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:11:57.311012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e09a6bd9-61df-4d85-969b-0ca446c8539a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:11:57.319374 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 743/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Oct 29 16:11:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:11:57.370593 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660bd0b-7d0e-4f8b-8c08-7d8073a855c4 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:57.370879 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660bd0b-7d0e-4f8b-8c08-7d8073a855c4 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:57.371157 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4660bd0b-7d0e-4f8b-8c08-7d8073a855c4 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:57.372936 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 737/1480] 10.222.0.41 () {54 vars in 962 bytes} [Fri Oct 29 16:11:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:11:57.378961 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb79c33-c178-4780-b77b-234434474be1 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:57.379249 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb79c33-c178-4780-b77b-234434474be1 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:57.379544 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb79c33-c178-4780-b77b-234434474be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:57.397285 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-9cb79c33-c178-4780-b77b-234434474be1 None None] MFA Rules not processed for user `9652ec3b44ee410dba2491c8f9795e20`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:11:57.398489 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-9cb79c33-c178-4780-b77b-234434474be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:11:57.404792 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 744/1481] 10.222.0.41 () {58 vars in 1059 bytes} [Fri Oct 29 16:11:57 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:11:57.412664 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660bd0b-7d0e-4f8b-8c08-7d8073a855c4 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:11:57.422968 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4660bd0b-7d0e-4f8b-8c08-7d8073a855c4 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:11:57.427076 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f94da95-524c-4662-a9bc-21612d06fe4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:11:57.427688 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94da95-524c-4662-a9bc-21612d06fe4c service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:11:57.427966 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94da95-524c-4662-a9bc-21612d06fe4c service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:11:57.428236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f94da95-524c-4662-a9bc-21612d06fe4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:11:57.436774 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94da95-524c-4662-a9bc-21612d06fe4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:11:57.438231 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f94da95-524c-4662-a9bc-21612d06fe4c service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:11:57.448050 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 738/1482] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:11:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:19.019407 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02458c2-404a-447e-bdcf-4d1d3f48ef37 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.019995 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02458c2-404a-447e-bdcf-4d1d3f48ef37 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.019995 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02458c2-404a-447e-bdcf-4d1d3f48ef37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.043673 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e02458c2-404a-447e-bdcf-4d1d3f48ef37 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:19.044813 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e02458c2-404a-447e-bdcf-4d1d3f48ef37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:19.046427 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c229c-771c-4d1b-b956-70824659a13f None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.046900 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c229c-771c-4d1b-b956-70824659a13f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.046994 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c229c-771c-4d1b-b956-70824659a13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.057003 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 745/1483] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:19.066550 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b8e75-c82a-4482-aac6-035d395a8a17 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.066858 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b8e75-c82a-4482-aac6-035d395a8a17 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.067116 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b8e75-c82a-4482-aac6-035d395a8a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.079076 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-071c229c-771c-4d1b-b956-70824659a13f None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:19.080761 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-071c229c-771c-4d1b-b956-70824659a13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:19.097090 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 739/1484] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:13:19.098965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-c45b8e75-c82a-4482-aac6-035d395a8a17 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:19.100225 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c45b8e75-c82a-4482-aac6-035d395a8a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:19.106698 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fb7a9-b7ad-4b62-bc1f-5e4c82c27307 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.106993 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fb7a9-b7ad-4b62-bc1f-5e4c82c27307 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.107278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9fb7a9-b7ad-4b62-bc1f-5e4c82c27307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.120443 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 746/1485] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:13:19.125162 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b8e75-c82a-4482-aac6-035d395a8a17 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:19.139262 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-3f9fb7a9-b7ad-4b62-bc1f-5e4c82c27307 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:19.139477 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b8e75-c82a-4482-aac6-035d395a8a17 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:19.140511 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3f9fb7a9-b7ad-4b62-bc1f-5e4c82c27307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:19.153734 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279dec5-997d-430f-ac80-f4833df46651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:19.154462 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279dec5-997d-430f-ac80-f4833df46651 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.154858 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279dec5-997d-430f-ac80-f4833df46651 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.155234 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279dec5-997d-430f-ac80-f4833df46651 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.155847 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279dec5-997d-430f-ac80-f4833df46651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:13:19.156156 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279dec5-997d-430f-ac80-f4833df46651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:19.157703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 740/1486] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:19.157953 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279dec5-997d-430f-ac80-f4833df46651 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:19.162835 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fb7a9-b7ad-4b62-bc1f-5e4c82c27307 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:19.172839 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9fb7a9-b7ad-4b62-bc1f-5e4c82c27307 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:19.179926 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 747/1487] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:13:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:13:19.188294 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279dec5-997d-430f-ac80-f4833df46651 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:19.188460 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6365df-b911-4906-8150-cbb4dd2a305f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:19.189212 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6365df-b911-4906-8150-cbb4dd2a305f admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.189499 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6365df-b911-4906-8150-cbb4dd2a305f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.189777 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6365df-b911-4906-8150-cbb4dd2a305f admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.190725 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6365df-b911-4906-8150-cbb4dd2a305f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:13:19.191040 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6365df-b911-4906-8150-cbb4dd2a305f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:19.193839 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6365df-b911-4906-8150-cbb4dd2a305f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:19.210526 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279dec5-997d-430f-ac80-f4833df46651 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:19.213391 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 741/1488] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:13:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:13:19.223300 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6365df-b911-4906-8150-cbb4dd2a305f admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:19.229448 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81758bf-b9db-4296-9190-40c0927deb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:19.230172 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81758bf-b9db-4296-9190-40c0927deb04 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.230483 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81758bf-b9db-4296-9190-40c0927deb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.230749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81758bf-b9db-4296-9190-40c0927deb04 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.231466 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81758bf-b9db-4296-9190-40c0927deb04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:19.233420 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81758bf-b9db-4296-9190-40c0927deb04 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:19.237611 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6365df-b911-4906-8150-cbb4dd2a305f admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:19.248308 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cbd95-5d99-40bd-a1b1-f6ec467ae54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:19.248986 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cbd95-5d99-40bd-a1b1-f6ec467ae54a admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.249274 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cbd95-5d99-40bd-a1b1-f6ec467ae54a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.249558 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cbd95-5d99-40bd-a1b1-f6ec467ae54a admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.250330 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cbd95-5d99-40bd-a1b1-f6ec467ae54a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:19.252254 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cbd95-5d99-40bd-a1b1-f6ec467ae54a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:19.283779 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 748/1489] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:19.287899 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81758bf-b9db-4296-9190-40c0927deb04 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:19.306710 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 742/1490] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/projects => generated 379 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:13:19.314543 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cbd95-5d99-40bd-a1b1-f6ec467ae54a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:19.415596 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cbd95-5d99-40bd-a1b1-f6ec467ae54a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:19.416429 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81758bf-b9db-4296-9190-40c0927deb04 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:19.426734 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3613d4f-0713-4166-abf8-dda51bdfa881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:19.428326 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3613d4f-0713-4166-abf8-dda51bdfa881 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.428832 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3613d4f-0713-4166-abf8-dda51bdfa881 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.429344 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3613d4f-0713-4166-abf8-dda51bdfa881 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.430364 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3613d4f-0713-4166-abf8-dda51bdfa881 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:19.430584 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610cfa4-dc80-4c6e-87da-e39d519f458e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:19.431277 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610cfa4-dc80-4c6e-87da-e39d519f458e admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.431561 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610cfa4-dc80-4c6e-87da-e39d519f458e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.431837 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5610cfa4-dc80-4c6e-87da-e39d519f458e admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.432544 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610cfa4-dc80-4c6e-87da-e39d519f458e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:19.433906 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3613d4f-0713-4166-abf8-dda51bdfa881 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:19.434508 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5610cfa4-dc80-4c6e-87da-e39d519f458e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:19.478442 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 743/1491] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:13:19.480415 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61aa57f-3724-443a-94b4-9df5ccb5091b None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.480970 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61aa57f-3724-443a-94b4-9df5ccb5091b None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.481455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 749/1492] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:19.481715 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61aa57f-3724-443a-94b4-9df5ccb5091b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.490202 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610cfa4-dc80-4c6e-87da-e39d519f458e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:19.504347 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5610cfa4-dc80-4c6e-87da-e39d519f458e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:19.515713 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-c61aa57f-3724-443a-94b4-9df5ccb5091b None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:19.517538 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-c61aa57f-3724-443a-94b4-9df5ccb5091b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:19.518850 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348006f9-1f20-4987-8cc2-4cd9cc15c7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:19.519557 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348006f9-1f20-4987-8cc2-4cd9cc15c7ca admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.519844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348006f9-1f20-4987-8cc2-4cd9cc15c7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.520234 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348006f9-1f20-4987-8cc2-4cd9cc15c7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.521383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348006f9-1f20-4987-8cc2-4cd9cc15c7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:19.522997 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348006f9-1f20-4987-8cc2-4cd9cc15c7ca admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:19.536279 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 744/1493] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:19.537908 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61aa57f-3724-443a-94b4-9df5ccb5091b None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:19.544664 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 750/1494] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:19 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:19.549699 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348006f9-1f20-4987-8cc2-4cd9cc15c7ca admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:19.556938 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61aa57f-3724-443a-94b4-9df5ccb5091b None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:19.566534 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c12a42-5eba-40bb-b197-85ae3ef6b9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:19.567572 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c12a42-5eba-40bb-b197-85ae3ef6b9ff admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.568938 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c12a42-5eba-40bb-b197-85ae3ef6b9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.569410 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c12a42-5eba-40bb-b197-85ae3ef6b9ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.570449 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c12a42-5eba-40bb-b197-85ae3ef6b9ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:19.570967 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348006f9-1f20-4987-8cc2-4cd9cc15c7ca admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:19.572673 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c12a42-5eba-40bb-b197-85ae3ef6b9ff admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:19.588567 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef84cb6-c859-428c-a661-9a381f29ab6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:19.589265 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef84cb6-c859-428c-a661-9a381f29ab6b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.589596 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef84cb6-c859-428c-a661-9a381f29ab6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.589825 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef84cb6-c859-428c-a661-9a381f29ab6b admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.590610 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef84cb6-c859-428c-a661-9a381f29ab6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:19.593847 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef84cb6-c859-428c-a661-9a381f29ab6b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:19.598249 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 745/1495] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:19 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:19.599676 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705e14b-297c-4754-92df-2e8f818ad766 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.599965 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705e14b-297c-4754-92df-2e8f818ad766 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.600245 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705e14b-297c-4754-92df-2e8f818ad766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.616380 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 751/1496] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:19 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:19.617457 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef84cb6-c859-428c-a661-9a381f29ab6b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:19.632633 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-d705e14b-297c-4754-92df-2e8f818ad766 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:19.634076 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d705e14b-297c-4754-92df-2e8f818ad766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:19.639058 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef84cb6-c859-428c-a661-9a381f29ab6b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:19.651992 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 746/1497] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:19.651992 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79363916-33da-4dfc-8cf7-6974115cd51c None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.651992 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79363916-33da-4dfc-8cf7-6974115cd51c None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.652333 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abd477-f5cd-435e-99d7-173a58e8b92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:19.652668 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79363916-33da-4dfc-8cf7-6974115cd51c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.652858 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abd477-f5cd-435e-99d7-173a58e8b92b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.653147 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abd477-f5cd-435e-99d7-173a58e8b92b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.653420 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28abd477-f5cd-435e-99d7-173a58e8b92b admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.654251 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abd477-f5cd-435e-99d7-173a58e8b92b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:19.656002 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28abd477-f5cd-435e-99d7-173a58e8b92b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:19.673057 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 752/1498] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:19 2021] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:19.674203 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abd477-f5cd-435e-99d7-173a58e8b92b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:19.681144 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-79363916-33da-4dfc-8cf7-6974115cd51c None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:19.683216 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-79363916-33da-4dfc-8cf7-6974115cd51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:19.685970 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28abd477-f5cd-435e-99d7-173a58e8b92b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:19.690562 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4274da-2add-45f8-95e8-356299e8944e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:19.691500 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4274da-2add-45f8-95e8-356299e8944e admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.691771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4274da-2add-45f8-95e8-356299e8944e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.692059 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4274da-2add-45f8-95e8-356299e8944e admin admin] PATH_INFO: `/v3/projects/de51f8a7357a4ead9bd0ffa8beae355c/users/33143e95face4c81af346e9ca6991ae1/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.694329 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 747/1499] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:19.695735 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e10b6-9e69-4230-9d32-a481c51b6427 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.696030 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e10b6-9e69-4230-9d32-a481c51b6427 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.696305 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293e10b6-9e69-4230-9d32-a481c51b6427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.707902 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4274da-2add-45f8-95e8-356299e8944e admin admin] RBAC: Authorizing `identity:create_grant(project_id=de51f8a7357a4ead9bd0ffa8beae355c, user_id=33143e95face4c81af346e9ca6991ae1, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:19.711013 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4274da-2add-45f8-95e8-356299e8944e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:19.719050 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-293e10b6-9e69-4230-9d32-a481c51b6427 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:19.720281 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-293e10b6-9e69-4230-9d32-a481c51b6427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:19.725226 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 753/1500] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:19 2021] PUT /identity/v3/projects/de51f8a7357a4ead9bd0ffa8beae355c/users/33143e95face4c81af346e9ca6991ae1/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:19.726546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed65a7c-ccd3-4078-bb50-9f18664d1b4d None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.726827 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed65a7c-ccd3-4078-bb50-9f18664d1b4d None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.727096 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed65a7c-ccd3-4078-bb50-9f18664d1b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.745023 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-3ed65a7c-ccd3-4078-bb50-9f18664d1b4d None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:19.746251 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-3ed65a7c-ccd3-4078-bb50-9f18664d1b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:19.785111 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 748/1501] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:19.786063 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e10b6-9e69-4230-9d32-a481c51b6427 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:19.795866 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293e10b6-9e69-4230-9d32-a481c51b6427 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:19.801597 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cb1584-61b8-4452-98a8-8b151bc8f2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:19.802888 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb1584-61b8-4452-98a8-8b151bc8f2d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.803124 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb1584-61b8-4452-98a8-8b151bc8f2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.803392 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cb1584-61b8-4452-98a8-8b151bc8f2d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.804123 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb1584-61b8-4452-98a8-8b151bc8f2d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:13:19.804492 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb1584-61b8-4452-98a8-8b151bc8f2d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:19.806036 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cb1584-61b8-4452-98a8-8b151bc8f2d6 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:19.806796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 754/1502] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:19.808149 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26eb32-bd23-490e-9063-9e98c9fe5cae None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.808773 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26eb32-bd23-490e-9063-9e98c9fe5cae None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.808773 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e26eb32-bd23-490e-9063-9e98c9fe5cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.817952 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 749/1503] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:13:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:13:19.819267 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5050a4-6352-4479-9de4-6b3a44511518 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.819555 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5050a4-6352-4479-9de4-6b3a44511518 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.819828 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5050a4-6352-4479-9de4-6b3a44511518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.826617 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-5e26eb32-bd23-490e-9063-9e98c9fe5cae None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:19.827817 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-5e26eb32-bd23-490e-9063-9e98c9fe5cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:19.836087 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 755/1504] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:19.836889 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26eb32-bd23-490e-9063-9e98c9fe5cae None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:19.841784 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-3f5050a4-6352-4479-9de4-6b3a44511518 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:19.843333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3f5050a4-6352-4479-9de4-6b3a44511518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:19.845964 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e26eb32-bd23-490e-9063-9e98c9fe5cae None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:19.851024 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89fc0c-c28e-466e-9feb-4755190ae76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:19.851907 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89fc0c-c28e-466e-9feb-4755190ae76e admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.852074 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 750/1505] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:19.852187 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89fc0c-c28e-466e-9feb-4755190ae76e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.852569 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89fc0c-c28e-466e-9feb-4755190ae76e admin admin] PATH_INFO: `/v3/projects/18c4a05bdd89462084ca3087f652503c/users/543cc155b0b4438386263957f64d2164/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.853424 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35677d-6b40-49a4-9214-9c1711009e88 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.853762 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35677d-6b40-49a4-9214-9c1711009e88 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.854139 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35677d-6b40-49a4-9214-9c1711009e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.869130 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89fc0c-c28e-466e-9feb-4755190ae76e admin admin] RBAC: Authorizing `identity:create_grant(project_id=18c4a05bdd89462084ca3087f652503c, user_id=543cc155b0b4438386263957f64d2164, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:19.872039 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89fc0c-c28e-466e-9feb-4755190ae76e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:19.874076 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-2e35677d-6b40-49a4-9214-9c1711009e88 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:19.875942 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-2e35677d-6b40-49a4-9214-9c1711009e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:19.883840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 751/1506] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:19.894470 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 756/1507] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:19 2021] PUT /identity/v3/projects/18c4a05bdd89462084ca3087f652503c/users/543cc155b0b4438386263957f64d2164/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:19.894700 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b734e-e481-4b5c-97de-abc5e92a4118 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.894700 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b734e-e481-4b5c-97de-abc5e92a4118 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.894700 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b734e-e481-4b5c-97de-abc5e92a4118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.894975 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210b0f1-77e1-413a-844f-bee77dcae05c None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.894975 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210b0f1-77e1-413a-844f-bee77dcae05c None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.894975 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210b0f1-77e1-413a-844f-bee77dcae05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.912018 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-e86b734e-e481-4b5c-97de-abc5e92a4118 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:19.912256 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e210b0f1-77e1-413a-844f-bee77dcae05c None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:19.913238 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e86b734e-e481-4b5c-97de-abc5e92a4118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:19.913534 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e210b0f1-77e1-413a-844f-bee77dcae05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:19.970083 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 752/1508] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:19.970334 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 757/1509] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:19.971419 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd439c2b-4437-4c4f-af19-cab0024d480c None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.971703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd439c2b-4437-4c4f-af19-cab0024d480c None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.971981 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd439c2b-4437-4c4f-af19-cab0024d480c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.972422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210b0f1-77e1-413a-844f-bee77dcae05c None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:19.984521 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210b0f1-77e1-413a-844f-bee77dcae05c None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:19.989043 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64b6dd-5128-4040-8571-c5806dc967a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:19.990393 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64b6dd-5128-4040-8571-c5806dc967a1 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:19.990701 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64b6dd-5128-4040-8571-c5806dc967a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:19.990970 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64b6dd-5128-4040-8571-c5806dc967a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:19.991541 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-bd439c2b-4437-4c4f-af19-cab0024d480c None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:19.991712 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64b6dd-5128-4040-8571-c5806dc967a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:19.992741 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-bd439c2b-4437-4c4f-af19-cab0024d480c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:19.993602 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64b6dd-5128-4040-8571-c5806dc967a1 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.000720 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 753/1510] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:20.001996 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1a8e6-7e14-4a45-9762-51b148d33e08 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.002289 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1a8e6-7e14-4a45-9762-51b148d33e08 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.002565 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f1a8e6-7e14-4a45-9762-51b148d33e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.020408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 758/1511] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:13:19 2021] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:20.023107 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8a617-e2ca-478b-8705-0c41fff79a09 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.023566 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8a617-e2ca-478b-8705-0c41fff79a09 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.024030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa8a617-e2ca-478b-8705-0c41fff79a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.025777 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-45f1a8e6-7e14-4a45-9762-51b148d33e08 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:20.027038 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-45f1a8e6-7e14-4a45-9762-51b148d33e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:20.045064 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-3aa8a617-e2ca-478b-8705-0c41fff79a09 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:20.046319 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-3aa8a617-e2ca-478b-8705-0c41fff79a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:20.086403 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 754/1512] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:20.087256 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1a8e6-7e14-4a45-9762-51b148d33e08 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.096243 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f1a8e6-7e14-4a45-9762-51b148d33e08 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.101266 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75957b-70d2-4ecf-b938-47a9fa0522c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.101914 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75957b-70d2-4ecf-b938-47a9fa0522c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.102218 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75957b-70d2-4ecf-b938-47a9fa0522c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.102490 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75957b-70d2-4ecf-b938-47a9fa0522c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.103220 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75957b-70d2-4ecf-b938-47a9fa0522c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:13:20.103518 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75957b-70d2-4ecf-b938-47a9fa0522c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:20.105103 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75957b-70d2-4ecf-b938-47a9fa0522c9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.105364 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 759/1513] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:20.106733 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ca5a2-373d-4319-b019-201ff99286be None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.107017 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ca5a2-373d-4319-b019-201ff99286be None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.107291 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ca5a2-373d-4319-b019-201ff99286be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.120275 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 755/1514] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:13:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:13:20.121096 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75957b-70d2-4ecf-b938-47a9fa0522c9 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.132679 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75957b-70d2-4ecf-b938-47a9fa0522c9 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.132858 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-845ca5a2-373d-4319-b019-201ff99286be None None] MFA Rules not processed for user `543cc155b0b4438386263957f64d2164`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:20.133874 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-845ca5a2-373d-4319-b019-201ff99286be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:20.137416 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a760630-0509-4b60-8a06-a0d0db5fd329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.138094 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a760630-0509-4b60-8a06-a0d0db5fd329 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.138374 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a760630-0509-4b60-8a06-a0d0db5fd329 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.139104 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a760630-0509-4b60-8a06-a0d0db5fd329 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.139376 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a760630-0509-4b60-8a06-a0d0db5fd329 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:13:20.139676 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a760630-0509-4b60-8a06-a0d0db5fd329 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:20.141254 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a760630-0509-4b60-8a06-a0d0db5fd329 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.153380 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 756/1515] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:13:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:13:20.154202 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a760630-0509-4b60-8a06-a0d0db5fd329 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.155821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8a760630-0509-4b60-8a06-a0d0db5fd329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:20.196643 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 760/1516] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:20 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:20.197708 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ca5a2-373d-4319-b019-201ff99286be None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.210425 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a760630-0509-4b60-8a06-a0d0db5fd329 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.210638 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ca5a2-373d-4319-b019-201ff99286be None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.214074 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc652c-6d49-489d-b6db-70ff38d7da63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.214722 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc652c-6d49-489d-b6db-70ff38d7da63 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.215005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc652c-6d49-489d-b6db-70ff38d7da63 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.215113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824d820-a1a1-4550-9264-f6b4c027fe8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.215282 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fc652c-6d49-489d-b6db-70ff38d7da63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.215726 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824d820-a1a1-4550-9264-f6b4c027fe8a admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.216014 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824d820-a1a1-4550-9264-f6b4c027fe8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.216291 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824d820-a1a1-4550-9264-f6b4c027fe8a admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.217021 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824d820-a1a1-4550-9264-f6b4c027fe8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:13:20.217328 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824d820-a1a1-4550-9264-f6b4c027fe8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:20.218997 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824d820-a1a1-4550-9264-f6b4c027fe8a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.224836 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc652c-6d49-489d-b6db-70ff38d7da63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:20.226300 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fc652c-6d49-489d-b6db-70ff38d7da63 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.230766 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 761/1517] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:13:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:13:20.237887 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824d820-a1a1-4550-9264-f6b4c027fe8a admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.243542 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 757/1518] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:20.243740 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824d820-a1a1-4550-9264-f6b4c027fe8a admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.244422 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc652c-6d49-489d-b6db-70ff38d7da63 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.249254 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b040b-3b6f-423a-8e28-eb167b907fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.249778 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b040b-3b6f-423a-8e28-eb167b907fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.250175 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b040b-3b6f-423a-8e28-eb167b907fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.253424 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038b040b-3b6f-423a-8e28-eb167b907fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.254224 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b040b-3b6f-423a-8e28-eb167b907fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:20.256213 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038b040b-3b6f-423a-8e28-eb167b907fd8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.264450 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fc652c-6d49-489d-b6db-70ff38d7da63 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.284003 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700031f6-6d0f-467a-b320-a927d3312ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.284676 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700031f6-6d0f-467a-b320-a927d3312ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.284955 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700031f6-6d0f-467a-b320-a927d3312ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.285229 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700031f6-6d0f-467a-b320-a927d3312ea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.286187 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700031f6-6d0f-467a-b320-a927d3312ea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:13:20.286449 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700031f6-6d0f-467a-b320-a927d3312ea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:20.288852 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700031f6-6d0f-467a-b320-a927d3312ea2 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.296711 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 762/1519] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:13:20 2021] POST /identity/v3/users => generated 297 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:20.298604 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b040b-3b6f-423a-8e28-eb167b907fd8 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.307584 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 758/1520] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:13:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:13:20.308556 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700031f6-6d0f-467a-b320-a927d3312ea2 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.310145 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038b040b-3b6f-423a-8e28-eb167b907fd8 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.319158 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a12980-cc6b-4e9f-bd62-d9663656217c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.319574 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700031f6-6d0f-467a-b320-a927d3312ea2 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.320180 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a12980-cc6b-4e9f-bd62-d9663656217c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.320388 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a12980-cc6b-4e9f-bd62-d9663656217c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.320713 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a12980-cc6b-4e9f-bd62-d9663656217c admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.321717 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a12980-cc6b-4e9f-bd62-d9663656217c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:13:20.322488 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a12980-cc6b-4e9f-bd62-d9663656217c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:20.324842 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a12980-cc6b-4e9f-bd62-d9663656217c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.325464 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6cff9-d315-412e-905a-bbd6a2378d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.326227 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6cff9-d315-412e-905a-bbd6a2378d30 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.326588 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6cff9-d315-412e-905a-bbd6a2378d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.326936 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f6cff9-d315-412e-905a-bbd6a2378d30 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.327726 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6cff9-d315-412e-905a-bbd6a2378d30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:20.330193 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f6cff9-d315-412e-905a-bbd6a2378d30 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.354306 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 763/1521] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:13:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:13:20.355224 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a12980-cc6b-4e9f-bd62-d9663656217c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.366181 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a12980-cc6b-4e9f-bd62-d9663656217c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.370055 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 759/1522] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:13:20 2021] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:20.370888 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6cff9-d315-412e-905a-bbd6a2378d30 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.372318 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf00f2-6b1e-4bde-82be-7df52904b4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.373089 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf00f2-6b1e-4bde-82be-7df52904b4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.373479 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf00f2-6b1e-4bde-82be-7df52904b4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.373901 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf00f2-6b1e-4bde-82be-7df52904b4e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.374736 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf00f2-6b1e-4bde-82be-7df52904b4e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:20.376750 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf00f2-6b1e-4bde-82be-7df52904b4e1 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.411852 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 764/1523] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:13:20 2021] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:20.415896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf00f2-6b1e-4bde-82be-7df52904b4e1 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.454005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f6cff9-d315-412e-905a-bbd6a2378d30 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.491799 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf00f2-6b1e-4bde-82be-7df52904b4e1 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.497865 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d64ee-2bd7-4ea3-a213-e5462accda1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.498563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d64ee-2bd7-4ea3-a213-e5462accda1c admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.498848 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d64ee-2bd7-4ea3-a213-e5462accda1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.499127 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4d64ee-2bd7-4ea3-a213-e5462accda1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.499839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d64ee-2bd7-4ea3-a213-e5462accda1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:20.501758 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4d64ee-2bd7-4ea3-a213-e5462accda1c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.532444 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 765/1524] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:13:20 2021] POST /identity/v3/projects => generated 389 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:20.536712 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d64ee-2bd7-4ea3-a213-e5462accda1c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.543113 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc866fda-8e61-4006-a76a-e61d37cebac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.543818 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc866fda-8e61-4006-a76a-e61d37cebac6 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.544171 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc866fda-8e61-4006-a76a-e61d37cebac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.544529 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc866fda-8e61-4006-a76a-e61d37cebac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.545304 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc866fda-8e61-4006-a76a-e61d37cebac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:20.547444 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc866fda-8e61-4006-a76a-e61d37cebac6 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.578404 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 760/1525] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:13:20 2021] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:20.583075 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc866fda-8e61-4006-a76a-e61d37cebac6 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.612809 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4d64ee-2bd7-4ea3-a213-e5462accda1c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.665051 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc866fda-8e61-4006-a76a-e61d37cebac6 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.675909 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb752c-7308-408a-a628-3b8b4afceafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.677715 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb752c-7308-408a-a628-3b8b4afceafb admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.678505 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb752c-7308-408a-a628-3b8b4afceafb admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.679239 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fb752c-7308-408a-a628-3b8b4afceafb admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.680251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb752c-7308-408a-a628-3b8b4afceafb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:20.682481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fb752c-7308-408a-a628-3b8b4afceafb admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.685556 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f12d3-adba-4edd-8969-39498a50309b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.686507 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f12d3-adba-4edd-8969-39498a50309b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.687076 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f12d3-adba-4edd-8969-39498a50309b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.687516 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f12d3-adba-4edd-8969-39498a50309b admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.688255 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f12d3-adba-4edd-8969-39498a50309b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:20.689870 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f12d3-adba-4edd-8969-39498a50309b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.701482 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 766/1526] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:20 2021] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:20.702396 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f12d3-adba-4edd-8969-39498a50309b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.719740 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 761/1527] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:13:20 2021] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:20.719740 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb752c-7308-408a-a628-3b8b4afceafb admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.720370 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f12d3-adba-4edd-8969-39498a50309b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.788391 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fb752c-7308-408a-a628-3b8b4afceafb admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.791836 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8697d0c-6679-4c8b-b32b-3e1637e4f165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.792512 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8697d0c-6679-4c8b-b32b-3e1637e4f165 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.792792 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8697d0c-6679-4c8b-b32b-3e1637e4f165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.793068 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8697d0c-6679-4c8b-b32b-3e1637e4f165 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.793770 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8697d0c-6679-4c8b-b32b-3e1637e4f165 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:20.794032 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa44749-eca6-4d25-9c11-2be2b8faec13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.794801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa44749-eca6-4d25-9c11-2be2b8faec13 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.795156 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa44749-eca6-4d25-9c11-2be2b8faec13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.795455 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa44749-eca6-4d25-9c11-2be2b8faec13 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.796278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa44749-eca6-4d25-9c11-2be2b8faec13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:20.796984 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8697d0c-6679-4c8b-b32b-3e1637e4f165 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.798682 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa44749-eca6-4d25-9c11-2be2b8faec13 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.826863 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 762/1528] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:13:20 2021] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:20.826863 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa44749-eca6-4d25-9c11-2be2b8faec13 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.831651 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 767/1529] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:13:20 2021] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:20.832626 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8697d0c-6679-4c8b-b32b-3e1637e4f165 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.837564 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa44749-eca6-4d25-9c11-2be2b8faec13 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.904328 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd128420-1e65-4f6e-9470-66671f0feb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.905047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd128420-1e65-4f6e-9470-66671f0feb66 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.905345 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd128420-1e65-4f6e-9470-66671f0feb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.905606 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd128420-1e65-4f6e-9470-66671f0feb66 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.906494 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd128420-1e65-4f6e-9470-66671f0feb66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:20.908455 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd128420-1e65-4f6e-9470-66671f0feb66 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.909234 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8697d0c-6679-4c8b-b32b-3e1637e4f165 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.913945 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca33e8-5c33-4eb6-a622-f26cc4666b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.914636 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca33e8-5c33-4eb6-a622-f26cc4666b7c admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.914923 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca33e8-5c33-4eb6-a622-f26cc4666b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.915193 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca33e8-5c33-4eb6-a622-f26cc4666b7c admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.915895 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca33e8-5c33-4eb6-a622-f26cc4666b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:20.917897 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca33e8-5c33-4eb6-a622-f26cc4666b7c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.935760 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 763/1530] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:13:20 2021] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:20.936867 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd128420-1e65-4f6e-9470-66671f0feb66 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.941828 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 768/1531] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:13:20 2021] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:20.943773 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca33e8-5c33-4eb6-a622-f26cc4666b7c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.948845 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd128420-1e65-4f6e-9470-66671f0feb66 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.954073 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284ae34-9d36-45ba-98e7-ed064bd07d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.954837 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284ae34-9d36-45ba-98e7-ed064bd07d29 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.955383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284ae34-9d36-45ba-98e7-ed064bd07d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.955668 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284ae34-9d36-45ba-98e7-ed064bd07d29 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.956416 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284ae34-9d36-45ba-98e7-ed064bd07d29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:20.957469 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca33e8-5c33-4eb6-a622-f26cc4666b7c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.958401 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284ae34-9d36-45ba-98e7-ed064bd07d29 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.962875 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b9b40-6e6f-4615-b724-9fa188dd01ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.963681 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b9b40-6e6f-4615-b724-9fa188dd01ff admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:20.964080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b9b40-6e6f-4615-b724-9fa188dd01ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:20.964478 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b9b40-6e6f-4615-b724-9fa188dd01ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:20.965370 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b9b40-6e6f-4615-b724-9fa188dd01ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:20.967659 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b9b40-6e6f-4615-b724-9fa188dd01ff admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:20.982827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 764/1532] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:13:20 2021] POST /identity/v3/users => generated 295 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:20.983836 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284ae34-9d36-45ba-98e7-ed064bd07d29 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.987588 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 769/1533] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:20 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:20.987588 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b9b40-6e6f-4615-b724-9fa188dd01ff admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:20.994296 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284ae34-9d36-45ba-98e7-ed064bd07d29 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.996574 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b9b40-6e6f-4615-b724-9fa188dd01ff admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:20.999079 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55855064-661e-44ae-8efc-ac08a85da4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:20.999745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55855064-661e-44ae-8efc-ac08a85da4a6 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.000029 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55855064-661e-44ae-8efc-ac08a85da4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.000300 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55855064-661e-44ae-8efc-ac08a85da4a6 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.001023 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55855064-661e-44ae-8efc-ac08a85da4a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.002493 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df41ea7-4118-47b4-ba9b-1aa39f01363c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.003031 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55855064-661e-44ae-8efc-ac08a85da4a6 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.003355 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df41ea7-4118-47b4-ba9b-1aa39f01363c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.003852 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df41ea7-4118-47b4-ba9b-1aa39f01363c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.004103 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df41ea7-4118-47b4-ba9b-1aa39f01363c admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.004962 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df41ea7-4118-47b4-ba9b-1aa39f01363c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.007283 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df41ea7-4118-47b4-ba9b-1aa39f01363c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.022868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 770/1534] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:20 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:21.022868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df41ea7-4118-47b4-ba9b-1aa39f01363c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.030171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df41ea7-4118-47b4-ba9b-1aa39f01363c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.035135 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacd7b0-9bfa-4641-9916-d0724bb511a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.038687 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacd7b0-9bfa-4641-9916-d0724bb511a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.038687 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacd7b0-9bfa-4641-9916-d0724bb511a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.039029 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 765/1535] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:13:20 2021] POST /identity/v3/users => generated 290 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:21.039127 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eacd7b0-9bfa-4641-9916-d0724bb511a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.039224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55855064-661e-44ae-8efc-ac08a85da4a6 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.039308 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eacd7b0-9bfa-4641-9916-d0724bb511a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.039308 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eacd7b0-9bfa-4641-9916-d0724bb511a7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.050916 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55855064-661e-44ae-8efc-ac08a85da4a6 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.056608 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d73a1-a401-465f-9904-c3ea443dc390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.066860 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d73a1-a401-465f-9904-c3ea443dc390 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.067171 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d73a1-a401-465f-9904-c3ea443dc390 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.067419 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d73a1-a401-465f-9904-c3ea443dc390 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.068810 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d73a1-a401-465f-9904-c3ea443dc390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.070453 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9d73a1-a401-465f-9904-c3ea443dc390 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.074075 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 771/1536] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:13:21 2021] POST /identity/v3/users => generated 293 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:21.075200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacd7b0-9bfa-4641-9916-d0724bb511a7 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.088429 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eacd7b0-9bfa-4641-9916-d0724bb511a7 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.093461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 766/1537] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:21 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:21.094591 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d73a1-a401-465f-9904-c3ea443dc390 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.097604 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a869a6b-14d7-4213-996f-26d8f8b9ffa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.098490 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a869a6b-14d7-4213-996f-26d8f8b9ffa4 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.098942 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a869a6b-14d7-4213-996f-26d8f8b9ffa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.099324 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a869a6b-14d7-4213-996f-26d8f8b9ffa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.100381 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a869a6b-14d7-4213-996f-26d8f8b9ffa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.102550 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a869a6b-14d7-4213-996f-26d8f8b9ffa4 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.106663 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d73a1-a401-465f-9904-c3ea443dc390 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.113678 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf87edc-adb5-4e0d-9010-6c01a44a5d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.115415 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf87edc-adb5-4e0d-9010-6c01a44a5d3b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.115605 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf87edc-adb5-4e0d-9010-6c01a44a5d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.115878 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf87edc-adb5-4e0d-9010-6c01a44a5d3b admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.116633 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf87edc-adb5-4e0d-9010-6c01a44a5d3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.118711 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf87edc-adb5-4e0d-9010-6c01a44a5d3b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.119042 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 772/1538] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:21 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:21.120158 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a869a6b-14d7-4213-996f-26d8f8b9ffa4 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.131875 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 767/1539] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:21 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:21.132413 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a869a6b-14d7-4213-996f-26d8f8b9ffa4 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.132798 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf87edc-adb5-4e0d-9010-6c01a44a5d3b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.137965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577259d-d6a8-4674-925b-4f275f973163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.139069 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577259d-d6a8-4674-925b-4f275f973163 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.139491 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577259d-d6a8-4674-925b-4f275f973163 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.139870 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577259d-d6a8-4674-925b-4f275f973163 admin admin] PATH_INFO: `/v3/projects/2b90a2dbd833411d82a0838bb8b7d8d6/users/008bf02d56c44048a48f147490c7b073/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.143843 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf87edc-adb5-4e0d-9010-6c01a44a5d3b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.149811 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a000772-77e4-47f9-9db0-9227ed3eef53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.150872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a000772-77e4-47f9-9db0-9227ed3eef53 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.151181 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a000772-77e4-47f9-9db0-9227ed3eef53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.151615 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a000772-77e4-47f9-9db0-9227ed3eef53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.153403 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a000772-77e4-47f9-9db0-9227ed3eef53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.156462 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a000772-77e4-47f9-9db0-9227ed3eef53 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.158448 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577259d-d6a8-4674-925b-4f275f973163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b90a2dbd833411d82a0838bb8b7d8d6, user_id=008bf02d56c44048a48f147490c7b073, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.162360 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577259d-d6a8-4674-925b-4f275f973163 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.175799 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 768/1540] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:21 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:21.177826 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a000772-77e4-47f9-9db0-9227ed3eef53 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.183263 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 773/1541] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:21 2021] PUT /identity/v3/projects/2b90a2dbd833411d82a0838bb8b7d8d6/users/008bf02d56c44048a48f147490c7b073/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:21.184400 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577259d-d6a8-4674-925b-4f275f973163 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.191728 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a000772-77e4-47f9-9db0-9227ed3eef53 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.275795 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7089b8-27ef-44ef-99fb-808c0ab1baef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.276623 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7089b8-27ef-44ef-99fb-808c0ab1baef admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.277011 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7089b8-27ef-44ef-99fb-808c0ab1baef admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.277386 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7089b8-27ef-44ef-99fb-808c0ab1baef admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.278290 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7089b8-27ef-44ef-99fb-808c0ab1baef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.280743 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7089b8-27ef-44ef-99fb-808c0ab1baef admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.289979 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577259d-d6a8-4674-925b-4f275f973163 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.293383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 769/1542] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:21 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:21.295031 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7089b8-27ef-44ef-99fb-808c0ab1baef admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.295779 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa47de-9a2c-45eb-b6c7-32389eff3c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.296749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa47de-9a2c-45eb-b6c7-32389eff3c16 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.297230 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa47de-9a2c-45eb-b6c7-32389eff3c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.297651 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaa47de-9a2c-45eb-b6c7-32389eff3c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.298647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa47de-9a2c-45eb-b6c7-32389eff3c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.300480 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaa47de-9a2c-45eb-b6c7-32389eff3c16 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.309147 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7089b8-27ef-44ef-99fb-808c0ab1baef admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.312815 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 774/1543] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:21 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:21.313912 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa47de-9a2c-45eb-b6c7-32389eff3c16 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.317996 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213eaf88-8c73-4c38-b797-1367b507c0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.319104 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213eaf88-8c73-4c38-b797-1367b507c0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.319104 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213eaf88-8c73-4c38-b797-1367b507c0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.319549 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213eaf88-8c73-4c38-b797-1367b507c0c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.320402 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213eaf88-8c73-4c38-b797-1367b507c0c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.322424 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213eaf88-8c73-4c38-b797-1367b507c0c7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.332909 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaa47de-9a2c-45eb-b6c7-32389eff3c16 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.334775 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 770/1544] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:21 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:21.338840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213eaf88-8c73-4c38-b797-1367b507c0c7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.349511 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e946b-1678-48a2-ac31-b39fe0d6f8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.349741 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213eaf88-8c73-4c38-b797-1367b507c0c7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.350965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e946b-1678-48a2-ac31-b39fe0d6f8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.351345 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e946b-1678-48a2-ac31-b39fe0d6f8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.352804 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e946b-1678-48a2-ac31-b39fe0d6f8f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.353747 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e946b-1678-48a2-ac31-b39fe0d6f8f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.355929 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e946b-1678-48a2-ac31-b39fe0d6f8f8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.356069 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac5ec8-0a3f-4846-a83d-568dace1324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.357050 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac5ec8-0a3f-4846-a83d-568dace1324e admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.357433 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac5ec8-0a3f-4846-a83d-568dace1324e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.357891 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac5ec8-0a3f-4846-a83d-568dace1324e admin admin] PATH_INFO: `/v3/projects/98b500100ae94eafb0ddb0d923c71409/users/7d85d59c27504947b5c3196e30c7723f/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.370646 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 775/1545] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:21 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:21.371901 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e946b-1678-48a2-ac31-b39fe0d6f8f8 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.383798 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e946b-1678-48a2-ac31-b39fe0d6f8f8 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.387647 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac5ec8-0a3f-4846-a83d-568dace1324e admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b500100ae94eafb0ddb0d923c71409, user_id=7d85d59c27504947b5c3196e30c7723f, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.392126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2d08b-d9b6-45d7-b731-90bd5d662c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.393149 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2d08b-d9b6-45d7-b731-90bd5d662c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.393985 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2d08b-d9b6-45d7-b731-90bd5d662c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.394088 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac5ec8-0a3f-4846-a83d-568dace1324e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.394191 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2d08b-d9b6-45d7-b731-90bd5d662c92 admin admin] PATH_INFO: `/v3/projects/c4d66eb751f94402aad18ec86fa45541/users/0e89a7ae3a5440ff8f7bf4eda3e50173/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.414407 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2d08b-d9b6-45d7-b731-90bd5d662c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4d66eb751f94402aad18ec86fa45541, user_id=0e89a7ae3a5440ff8f7bf4eda3e50173, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.416530 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 771/1546] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:21 2021] PUT /identity/v3/projects/98b500100ae94eafb0ddb0d923c71409/users/7d85d59c27504947b5c3196e30c7723f/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:21.417120 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2d08b-d9b6-45d7-b731-90bd5d662c92 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.419739 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0bd04-2985-4a0e-b283-9ecdb73c63ae None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.420325 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0bd04-2985-4a0e-b283-9ecdb73c63ae None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.420941 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0bd04-2985-4a0e-b283-9ecdb73c63ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.438566 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 776/1547] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:21 2021] PUT /identity/v3/projects/c4d66eb751f94402aad18ec86fa45541/users/0e89a7ae3a5440ff8f7bf4eda3e50173/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:21.442894 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2d08b-d9b6-45d7-b731-90bd5d662c92 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.448308 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-bbd0bd04-2985-4a0e-b283-9ecdb73c63ae None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:21.451556 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-bbd0bd04-2985-4a0e-b283-9ecdb73c63ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:21.547342 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2d08b-d9b6-45d7-b731-90bd5d662c92 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.552845 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 772/1548] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:21.554163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0bd04-2985-4a0e-b283-9ecdb73c63ae None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.555170 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062e405-3dc9-49fb-9e19-ac0de9749c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.556242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062e405-3dc9-49fb-9e19-ac0de9749c59 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.556749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062e405-3dc9-49fb-9e19-ac0de9749c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.557232 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062e405-3dc9-49fb-9e19-ac0de9749c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.558849 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062e405-3dc9-49fb-9e19-ac0de9749c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.561663 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3062e405-3dc9-49fb-9e19-ac0de9749c59 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.564146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0bd04-2985-4a0e-b283-9ecdb73c63ae None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.569130 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b83e6-70fd-45ef-8135-595700de4c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.569858 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b83e6-70fd-45ef-8135-595700de4c42 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.570161 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b83e6-70fd-45ef-8135-595700de4c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.570969 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b83e6-70fd-45ef-8135-595700de4c42 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.571318 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b83e6-70fd-45ef-8135-595700de4c42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.572988 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b83e6-70fd-45ef-8135-595700de4c42 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.577904 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 777/1549] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:21 2021] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:21.579526 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062e405-3dc9-49fb-9e19-ac0de9749c59 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.588201 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 773/1550] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:21 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:21.589105 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b83e6-70fd-45ef-8135-595700de4c42 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.592933 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062e405-3dc9-49fb-9e19-ac0de9749c59 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.605709 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b83e6-70fd-45ef-8135-595700de4c42 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.608575 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49421c-32ba-4ea5-9983-2cb724e67947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.609500 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49421c-32ba-4ea5-9983-2cb724e67947 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.609777 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49421c-32ba-4ea5-9983-2cb724e67947 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.610084 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49421c-32ba-4ea5-9983-2cb724e67947 admin admin] PATH_INFO: `/v3/projects/2a2a4341ee2845b489f3aec21ea30c1d/users/490ef5431d12459187c90d2f377c91ba/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.618243 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ea855-6747-487e-958e-38f89e839ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.619248 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ea855-6747-487e-958e-38f89e839ed0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.619472 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ea855-6747-487e-958e-38f89e839ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.619754 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ea855-6747-487e-958e-38f89e839ed0 admin admin] PATH_INFO: `/v3/projects/cd477d4386d54c8c9bfaaf5ee2a5ddb5/users/16c47acc08ad42ec9f14cbad92726027/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.628555 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49421c-32ba-4ea5-9983-2cb724e67947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a2a4341ee2845b489f3aec21ea30c1d, user_id=490ef5431d12459187c90d2f377c91ba, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.631529 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b49421c-32ba-4ea5-9983-2cb724e67947 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.645209 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ea855-6747-487e-958e-38f89e839ed0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd477d4386d54c8c9bfaaf5ee2a5ddb5, user_id=16c47acc08ad42ec9f14cbad92726027, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.648826 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ea855-6747-487e-958e-38f89e839ed0 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.651364 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 778/1551] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:21 2021] PUT /identity/v3/projects/2a2a4341ee2845b489f3aec21ea30c1d/users/490ef5431d12459187c90d2f377c91ba/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:21.652619 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49421c-32ba-4ea5-9983-2cb724e67947 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.674409 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 774/1552] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:21 2021] PUT /identity/v3/projects/cd477d4386d54c8c9bfaaf5ee2a5ddb5/users/16c47acc08ad42ec9f14cbad92726027/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:21.680002 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a3db9-41fa-475b-b275-395b000310cd None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.680293 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a3db9-41fa-475b-b275-395b000310cd None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.680573 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a3db9-41fa-475b-b275-395b000310cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.711831 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-9b7a3db9-41fa-475b-b275-395b000310cd None None] MFA Rules not processed for user `0e89a7ae3a5440ff8f7bf4eda3e50173`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:21.713353 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-9b7a3db9-41fa-475b-b275-395b000310cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:21.745262 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b49421c-32ba-4ea5-9983-2cb724e67947 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.810691 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 775/1553] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:21 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:21.811655 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a3db9-41fa-475b-b275-395b000310cd None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.847945 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390486f-553a-4864-9c4a-b0b3ad9d4d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.849053 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390486f-553a-4864-9c4a-b0b3ad9d4d5e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.849946 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390486f-553a-4864-9c4a-b0b3ad9d4d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.850311 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390486f-553a-4864-9c4a-b0b3ad9d4d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.852053 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390486f-553a-4864-9c4a-b0b3ad9d4d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.854951 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390486f-553a-4864-9c4a-b0b3ad9d4d5e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.874409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 779/1554] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:21 2021] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:21.875930 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390486f-553a-4864-9c4a-b0b3ad9d4d5e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.890088 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390486f-553a-4864-9c4a-b0b3ad9d4d5e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.898171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754d4741-da83-4311-8376-6d0d5d248da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.899987 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d4741-da83-4311-8376-6d0d5d248da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.900484 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d4741-da83-4311-8376-6d0d5d248da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.900864 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754d4741-da83-4311-8376-6d0d5d248da0 admin admin] PATH_INFO: `/v3/projects/ac038ab1a550470794e72da5c1ac3951/users/e99687be627d4a07a72a2e531d186f2a/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.910226 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a3db9-41fa-475b-b275-395b000310cd None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.915048 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a70e27-8db1-461c-b869-58a0e73bbfd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:21.915781 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a70e27-8db1-461c-b869-58a0e73bbfd8 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.916112 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a70e27-8db1-461c-b869-58a0e73bbfd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.916389 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a70e27-8db1-461c-b869-58a0e73bbfd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.921013 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d4741-da83-4311-8376-6d0d5d248da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac038ab1a550470794e72da5c1ac3951, user_id=e99687be627d4a07a72a2e531d186f2a, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.924351 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754d4741-da83-4311-8376-6d0d5d248da0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.931496 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a70e27-8db1-461c-b869-58a0e73bbfd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:21.932954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a70e27-8db1-461c-b869-58a0e73bbfd8 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:21.946290 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 776/1555] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:21.947185 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a70e27-8db1-461c-b869-58a0e73bbfd8 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:21.947694 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 780/1556] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:21 2021] PUT /identity/v3/projects/ac038ab1a550470794e72da5c1ac3951/users/e99687be627d4a07a72a2e531d186f2a/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:21.949459 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43803b-cd44-4045-b9fd-217bf2895c22 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:21.949954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43803b-cd44-4045-b9fd-217bf2895c22 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:21.950442 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43803b-cd44-4045-b9fd-217bf2895c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:21.964202 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a70e27-8db1-461c-b869-58a0e73bbfd8 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:21.994366 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-ec43803b-cd44-4045-b9fd-217bf2895c22 None None] MFA Rules not processed for user `490ef5431d12459187c90d2f377c91ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:21.996739 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ec43803b-cd44-4045-b9fd-217bf2895c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:22.073129 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f30a8c-70d3-4156-acb2-290525937f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:22.081684 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f30a8c-70d3-4156-acb2-290525937f14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:22.081848 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f30a8c-70d3-4156-acb2-290525937f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:22.082033 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f30a8c-70d3-4156-acb2-290525937f14 admin admin] PATH_INFO: `/v3/projects/59d1f3bec3724b87a4fa8a01bbebd39b/users/63baa45ff6a84614ac4656f6c7c6be2a/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:22.118972 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f30a8c-70d3-4156-acb2-290525937f14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59d1f3bec3724b87a4fa8a01bbebd39b, user_id=63baa45ff6a84614ac4656f6c7c6be2a, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:22.121742 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f30a8c-70d3-4156-acb2-290525937f14 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:22.139563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 781/1557] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:21 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:22.139563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cebf0-c381-4663-a15a-82e6eb68de43 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:22.139563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cebf0-c381-4663-a15a-82e6eb68de43 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:22.140271 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927cebf0-c381-4663-a15a-82e6eb68de43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:22.157529 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 777/1558] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:21 2021] PUT /identity/v3/projects/59d1f3bec3724b87a4fa8a01bbebd39b/users/63baa45ff6a84614ac4656f6c7c6be2a/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:22.167508 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426d6ef-ddef-44c5-ae75-fbe887a2e98b None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:22.168132 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426d6ef-ddef-44c5-ae75-fbe887a2e98b None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:22.168758 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426d6ef-ddef-44c5-ae75-fbe887a2e98b None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:22.173084 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 778/1559] 10.222.0.41 () {54 vars in 960 bytes} [Fri Oct 29 16:13:22 2021] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:13:22.174022 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426d6ef-ddef-44c5-ae75-fbe887a2e98b None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:22.179972 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-927cebf0-c381-4663-a15a-82e6eb68de43 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:22.181952 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-927cebf0-c381-4663-a15a-82e6eb68de43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:22.279952 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426d6ef-ddef-44c5-ae75-fbe887a2e98b None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:22.285408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 782/1560] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:22.289437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55938a-fb0e-421e-b863-07209b3d2a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:22.289583 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f79ac-c47c-44fe-9cba-8968a91218ca None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:22.289583 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f79ac-c47c-44fe-9cba-8968a91218ca None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:22.289583 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33f79ac-c47c-44fe-9cba-8968a91218ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:22.289802 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55938a-fb0e-421e-b863-07209b3d2a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:22.289802 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55938a-fb0e-421e-b863-07209b3d2a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:22.290058 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55938a-fb0e-421e-b863-07209b3d2a11 admin admin] PATH_INFO: `/v3/projects/98b500100ae94eafb0ddb0d923c71409/users/7d85d59c27504947b5c3196e30c7723f/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:22.294339 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55938a-fb0e-421e-b863-07209b3d2a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98b500100ae94eafb0ddb0d923c71409, user_id=7d85d59c27504947b5c3196e30c7723f, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:22.300270 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55938a-fb0e-421e-b863-07209b3d2a11 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:22.311517 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e33f79ac-c47c-44fe-9cba-8968a91218ca None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:22.314024 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 779/1561] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:22 2021] PUT /identity/v3/projects/98b500100ae94eafb0ddb0d923c71409/users/7d85d59c27504947b5c3196e30c7723f/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:22.315317 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e33f79ac-c47c-44fe-9cba-8968a91218ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:22.315464 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8472c22-e4cb-44f8-a500-0ad962937508 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:22.315648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8472c22-e4cb-44f8-a500-0ad962937508 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:22.315925 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8472c22-e4cb-44f8-a500-0ad962937508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:22.350996 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-b8472c22-e4cb-44f8-a500-0ad962937508 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:22.352412 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-b8472c22-e4cb-44f8-a500-0ad962937508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:22.436630 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 780/1562] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:22.436630 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08ccd6-822d-48fe-9e4e-873509d34950 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:22.436630 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08ccd6-822d-48fe-9e4e-873509d34950 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:22.436630 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08ccd6-822d-48fe-9e4e-873509d34950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:22.438997 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 783/1563] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:22.440368 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be481ce9-b94a-4041-87d2-d517ead12db4 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:22.440663 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be481ce9-b94a-4041-87d2-d517ead12db4 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:22.440940 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be481ce9-b94a-4041-87d2-d517ead12db4 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:22.443452 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 784/1564] 10.222.0.41 () {54 vars in 960 bytes} [Fri Oct 29 16:13:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:13:22.444218 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be481ce9-b94a-4041-87d2-d517ead12db4 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:22.487605 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-bb08ccd6-822d-48fe-9e4e-873509d34950 None None] MFA Rules not processed for user `4f13d0e9f79a433c81759ecd819a6dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:22.490122 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-bb08ccd6-822d-48fe-9e4e-873509d34950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:22.567897 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be481ce9-b94a-4041-87d2-d517ead12db4 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:22.578028 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a361ba-ab20-4fe7-9477-1a945209acd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:22.578827 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a361ba-ab20-4fe7-9477-1a945209acd3 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:22.579189 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a361ba-ab20-4fe7-9477-1a945209acd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:22.579544 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a361ba-ab20-4fe7-9477-1a945209acd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:22.595040 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a361ba-ab20-4fe7-9477-1a945209acd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:22.597331 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a361ba-ab20-4fe7-9477-1a945209acd3 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:22.609094 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 785/1565] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:22.610963 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae2ecc-17c8-47ee-bf58-58ff7e7a48a0 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:22.611342 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae2ecc-17c8-47ee-bf58-58ff7e7a48a0 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:22.611697 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ae2ecc-17c8-47ee-bf58-58ff7e7a48a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:22.657824 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-c3ae2ecc-17c8-47ee-bf58-58ff7e7a48a0 None None] MFA Rules not processed for user `7d85d59c27504947b5c3196e30c7723f`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:22.659267 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c3ae2ecc-17c8-47ee-bf58-58ff7e7a48a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:22.676448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 781/1566] 10.222.0.41 () {58 vars in 1057 bytes} [Fri Oct 29 16:13:22 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:22.677477 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08ccd6-822d-48fe-9e4e-873509d34950 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:22.687354 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08ccd6-822d-48fe-9e4e-873509d34950 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:22.691904 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1f2f21-525e-4213-a83f-3cb5db6de0e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:22.692100 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f2f21-525e-4213-a83f-3cb5db6de0e0 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:22.692274 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f2f21-525e-4213-a83f-3cb5db6de0e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:22.692552 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1f2f21-525e-4213-a83f-3cb5db6de0e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:22.704072 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f2f21-525e-4213-a83f-3cb5db6de0e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:22.705840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1f2f21-525e-4213-a83f-3cb5db6de0e0 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:22.720345 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 782/1567] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:22.722085 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac75f67-2dd6-4a49-be38-618d295b0c72 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:22.722582 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac75f67-2dd6-4a49-be38-618d295b0c72 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:22.722880 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac75f67-2dd6-4a49-be38-618d295b0c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:22.758811 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 786/1568] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:22 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:22.760544 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-cac75f67-2dd6-4a49-be38-618d295b0c72 None None] MFA Rules not processed for user `4f13d0e9f79a433c81759ecd819a6dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:22.766443 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae2ecc-17c8-47ee-bf58-58ff7e7a48a0 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:22.769728 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-cac75f67-2dd6-4a49-be38-618d295b0c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:22.789944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ae2ecc-17c8-47ee-bf58-58ff7e7a48a0 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:22.794197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 783/1569] 10.222.0.41 () {58 vars in 1057 bytes} [Fri Oct 29 16:13:22 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:22.795152 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac75f67-2dd6-4a49-be38-618d295b0c72 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:22.800284 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac48e80-58c5-41b5-bff3-a825f7fe4602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:22.801974 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac48e80-58c5-41b5-bff3-a825f7fe4602 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:22.802227 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac48e80-58c5-41b5-bff3-a825f7fe4602 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:22.802475 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac48e80-58c5-41b5-bff3-a825f7fe4602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:22.807596 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac75f67-2dd6-4a49-be38-618d295b0c72 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:22.815610 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248c380-4e05-4fee-97a1-fa753cd8eb3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:22.815823 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac48e80-58c5-41b5-bff3-a825f7fe4602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:22.816130 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248c380-4e05-4fee-97a1-fa753cd8eb3d service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:22.816412 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248c380-4e05-4fee-97a1-fa753cd8eb3d service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:22.816685 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7248c380-4e05-4fee-97a1-fa753cd8eb3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:22.818565 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac48e80-58c5-41b5-bff3-a825f7fe4602 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:22.836337 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 787/1570] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:22.837756 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac48e80-58c5-41b5-bff3-a825f7fe4602 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:22.890020 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248c380-4e05-4fee-97a1-fa753cd8eb3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:22.892472 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7248c380-4e05-4fee-97a1-fa753cd8eb3d service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:22.913504 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 784/1571] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:22 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:22.915217 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248c380-4e05-4fee-97a1-fa753cd8eb3d service nova] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:22.931609 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac48e80-58c5-41b5-bff3-a825f7fe4602 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:22.932432 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7248c380-4e05-4fee-97a1-fa753cd8eb3d service nova] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:22.940539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64759712-cf46-40a1-91c2-f6acba5ff1ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:22.941449 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64759712-cf46-40a1-91c2-f6acba5ff1ab service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:22.941821 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64759712-cf46-40a1-91c2-f6acba5ff1ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:22.943644 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64759712-cf46-40a1-91c2-f6acba5ff1ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:22.945083 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9d706-5863-4309-96ba-836482827120 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:22.946149 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9d706-5863-4309-96ba-836482827120 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:22.946271 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9d706-5863-4309-96ba-836482827120 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:22.946550 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9d706-5863-4309-96ba-836482827120 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:22.978781 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64759712-cf46-40a1-91c2-f6acba5ff1ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:22.980546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64759712-cf46-40a1-91c2-f6acba5ff1ab service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:22.998159 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 788/1572] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:22 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:23.021248 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9d706-5863-4309-96ba-836482827120 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:23.023372 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e9d706-5863-4309-96ba-836482827120 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:23.035295 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 785/1573] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:22 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:23.562551 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f946b-c90c-4edb-b923-dfaea4834b72 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:23.563105 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f946b-c90c-4edb-b923-dfaea4834b72 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:23.563105 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f946b-c90c-4edb-b923-dfaea4834b72 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:23.565200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 789/1574] 10.222.0.41 () {54 vars in 912 bytes} [Fri Oct 29 16:13:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:13:23.571056 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc5347-5813-49a2-9555-b17fea64714a None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:23.571542 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc5347-5813-49a2-9555-b17fea64714a None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:23.571784 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc5347-5813-49a2-9555-b17fea64714a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:23.578089 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336ef11-c455-4921-a4a9-20de38ab71c9 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:23.578389 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336ef11-c455-4921-a4a9-20de38ab71c9 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:23.578667 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9336ef11-c455-4921-a4a9-20de38ab71c9 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:23.586971 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 790/1575] 10.222.0.41 () {54 vars in 912 bytes} [Fri Oct 29 16:13:23 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:13:23.590866 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336ef11-c455-4921-a4a9-20de38ab71c9 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:23.619333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-2afc5347-5813-49a2-9555-b17fea64714a None None] MFA Rules not processed for user `4f13d0e9f79a433c81759ecd819a6dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:23.620688 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-2afc5347-5813-49a2-9555-b17fea64714a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:23.626730 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9336ef11-c455-4921-a4a9-20de38ab71c9 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:23.632965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf2a7a9-901f-419d-988b-203410e84cb8 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d85d59c27504947b5c3196e30c7723f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98b500100ae94eafb0ddb0d923c71409', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:23.633728 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2a7a9-901f-419d-988b-203410e84cb8 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:23.634100 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2a7a9-901f-419d-988b-203410e84cb8 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:23.634553 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf2a7a9-901f-419d-988b-203410e84cb8 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:23.635656 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2a7a9-901f-419d-988b-203410e84cb8 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:13:23.636008 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2a7a9-901f-419d-988b-203410e84cb8 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:23.637834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf2a7a9-901f-419d-988b-203410e84cb8 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:23.656165 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 791/1576] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:13:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:13:23.657805 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39cd0e-d022-4845-a317-15c298ca30f9 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:23.658169 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39cd0e-d022-4845-a317-15c298ca30f9 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:23.658468 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39cd0e-d022-4845-a317-15c298ca30f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:23.683136 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 786/1577] 10.222.0.41 () {58 vars in 1009 bytes} [Fri Oct 29 16:13:23 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:23.684009 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc5347-5813-49a2-9555-b17fea64714a None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:23.684545 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-eb39cd0e-d022-4845-a317-15c298ca30f9 None None] MFA Rules not processed for user `4f13d0e9f79a433c81759ecd819a6dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:23.685993 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-eb39cd0e-d022-4845-a317-15c298ca30f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:23.697260 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 792/1578] 10.222.0.41 () {58 vars in 1009 bytes} [Fri Oct 29 16:13:23 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:23.698191 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39cd0e-d022-4845-a317-15c298ca30f9 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:23.713414 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39cd0e-d022-4845-a317-15c298ca30f9 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:23.718257 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf6366-82b3-43b2-b8ca-2755f4221900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:23.719048 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf6366-82b3-43b2-b8ca-2755f4221900 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:23.719341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf6366-82b3-43b2-b8ca-2755f4221900 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:23.719625 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bf6366-82b3-43b2-b8ca-2755f4221900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:23.742354 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc5347-5813-49a2-9555-b17fea64714a None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:23.742791 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf6366-82b3-43b2-b8ca-2755f4221900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:23.742791 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bf6366-82b3-43b2-b8ca-2755f4221900 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:23.744251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6bae8-2025-497b-8353-dd562059a3c8 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d85d59c27504947b5c3196e30c7723f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98b500100ae94eafb0ddb0d923c71409', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:23.744991 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6bae8-2025-497b-8353-dd562059a3c8 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:23.745215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6bae8-2025-497b-8353-dd562059a3c8 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:23.745605 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e6bae8-2025-497b-8353-dd562059a3c8 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:23.746303 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6bae8-2025-497b-8353-dd562059a3c8 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:23.750476 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e6bae8-2025-497b-8353-dd562059a3c8 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:23.756928 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 793/1579] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:23 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:23.758880 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf6366-82b3-43b2-b8ca-2755f4221900 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:23.783460 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bf6366-82b3-43b2-b8ca-2755f4221900 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:23.788450 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79188fc-7e23-4623-80fe-fa0f019d390e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:23.789369 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79188fc-7e23-4623-80fe-fa0f019d390e service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:23.789819 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79188fc-7e23-4623-80fe-fa0f019d390e service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:23.790278 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79188fc-7e23-4623-80fe-fa0f019d390e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:23.802555 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79188fc-7e23-4623-80fe-fa0f019d390e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:23.804440 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79188fc-7e23-4623-80fe-fa0f019d390e service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:23.819857 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 794/1580] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:23 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:23.863328 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 787/1581] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:13:23 2021] POST /identity/v3/projects => generated 354 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:23.864958 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79188fc-7e23-4623-80fe-fa0f019d390e service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:23.897551 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79188fc-7e23-4623-80fe-fa0f019d390e service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:24.072019 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be7cf5-4725-46c6-91d4-15cbee043f95 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d85d59c27504947b5c3196e30c7723f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98b500100ae94eafb0ddb0d923c71409', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:24.073909 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6bae8-2025-497b-8353-dd562059a3c8 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:24.074696 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be7cf5-4725-46c6-91d4-15cbee043f95 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:24.075012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be7cf5-4725-46c6-91d4-15cbee043f95 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:24.078556 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be7cf5-4725-46c6-91d4-15cbee043f95 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:24.087368 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be7cf5-4725-46c6-91d4-15cbee043f95 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:13:24.087758 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be7cf5-4725-46c6-91d4-15cbee043f95 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:24.089956 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be7cf5-4725-46c6-91d4-15cbee043f95 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:24.128416 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 795/1582] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:13:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:13:24.221004 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be7cf5-4725-46c6-91d4-15cbee043f95 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:24.233595 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be7cf5-4725-46c6-91d4-15cbee043f95 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:24.257497 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527db26-77d2-4f21-a876-bff2f8d6fe37 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7d85d59c27504947b5c3196e30c7723f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '98b500100ae94eafb0ddb0d923c71409', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:24.259749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527db26-77d2-4f21-a876-bff2f8d6fe37 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:24.260046 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527db26-77d2-4f21-a876-bff2f8d6fe37 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:24.260331 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b527db26-77d2-4f21-a876-bff2f8d6fe37 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] PATH_INFO: `/v3/projects/c282ff91131f4aae89456aa27a73aaad` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:24.264533 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527db26-77d2-4f21-a876-bff2f8d6fe37 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c282ff91131f4aae89456aa27a73aaad)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:24.273039 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b527db26-77d2-4f21-a876-bff2f8d6fe37 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:24.279567 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e6bae8-2025-497b-8353-dd562059a3c8 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:24.291597 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00243819-6cb6-487c-971a-bacfc2c269ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:24.294084 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00243819-6cb6-487c-971a-bacfc2c269ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:24.294504 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00243819-6cb6-487c-971a-bacfc2c269ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:24.294821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00243819-6cb6-487c-971a-bacfc2c269ee admin admin] PATH_INFO: `/v3/users/0e89a7ae3a5440ff8f7bf4eda3e50173` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:24.298790 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00243819-6cb6-487c-971a-bacfc2c269ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e89a7ae3a5440ff8f7bf4eda3e50173)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:24.303193 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00243819-6cb6-487c-971a-bacfc2c269ee admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:24.428100 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-00243819-6cb6-487c-971a-bacfc2c269ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e89a7ae3a5440ff8f7bf4eda3e50173'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:24.442896 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-00243819-6cb6-487c-971a-bacfc2c269ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e89a7ae3a5440ff8f7bf4eda3e50173'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:24.452465 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b527db26-77d2-4f21-a876-bff2f8d6fe37 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c282ff91131f4aae89456aa27a73aaad', 'request_id': 'req-b527db26-77d2-4f21-a876-bff2f8d6fe37'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:24.459267 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-00243819-6cb6-487c-971a-bacfc2c269ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e89a7ae3a5440ff8f7bf4eda3e50173'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:24.461475 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-00243819-6cb6-487c-971a-bacfc2c269ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e89a7ae3a5440ff8f7bf4eda3e50173'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:24.477644 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b527db26-77d2-4f21-a876-bff2f8d6fe37 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c282ff91131f4aae89456aa27a73aaad', 'request_id': 'req-b527db26-77d2-4f21-a876-bff2f8d6fe37'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:24.495481 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b527db26-77d2-4f21-a876-bff2f8d6fe37 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c282ff91131f4aae89456aa27a73aaad', 'request_id': 'req-b527db26-77d2-4f21-a876-bff2f8d6fe37'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:24.498882 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-00243819-6cb6-487c-971a-bacfc2c269ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e89a7ae3a5440ff8f7bf4eda3e50173'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:24.516296 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 788/1583] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:13:24 2021] DELETE /identity/v3/users/0e89a7ae3a5440ff8f7bf4eda3e50173 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:24.518155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22043211-e058-4e22-bf73-e165bcc6e55a None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:24.518453 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22043211-e058-4e22-bf73-e165bcc6e55a None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:24.518740 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22043211-e058-4e22-bf73-e165bcc6e55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:24.527469 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b527db26-77d2-4f21-a876-bff2f8d6fe37 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] The token cache is being invalidate because project c282ff91131f4aae89456aa27a73aaad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:13:24.529999 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b527db26-77d2-4f21-a876-bff2f8d6fe37 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:24.534106 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b527db26-77d2-4f21-a876-bff2f8d6fe37 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:24.543548 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 796/1584] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:13:24 2021] DELETE /identity/v3/projects/c282ff91131f4aae89456aa27a73aaad => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:24.571033 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-22043211-e058-4e22-bf73-e165bcc6e55a None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:24.574737 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-22043211-e058-4e22-bf73-e165bcc6e55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:24.723184 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 789/1585] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:13:24.740181 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527db26-77d2-4f21-a876-bff2f8d6fe37 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:24.741613 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b527db26-77d2-4f21-a876-bff2f8d6fe37 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:24.899546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b527db26-77d2-4f21-a876-bff2f8d6fe37 tempest-VolumeQuotaClassesTest-15224186 tempest-VolumeQuotaClassesTest-15224186-project-admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:25.024581 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e18c2-e401-48d4-a048-bad495f4e0f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:25.027573 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e18c2-e401-48d4-a048-bad495f4e0f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:25.027887 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e18c2-e401-48d4-a048-bad495f4e0f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:25.028559 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e18c2-e401-48d4-a048-bad495f4e0f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:25.058054 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e18c2-e401-48d4-a048-bad495f4e0f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:25.060965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e18c2-e401-48d4-a048-bad495f4e0f6 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:25.092377 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 797/1586] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:25.103674 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22043211-e058-4e22-bf73-e165bcc6e55a None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:25.115925 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-22043211-e058-4e22-bf73-e165bcc6e55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:25.137474 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22043211-e058-4e22-bf73-e165bcc6e55a None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:25.149782 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd552851-573a-4ce3-9d1b-825208689f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:25.152005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd552851-573a-4ce3-9d1b-825208689f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:25.152150 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd552851-573a-4ce3-9d1b-825208689f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:25.152429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd552851-573a-4ce3-9d1b-825208689f02 admin admin] PATH_INFO: `/v3/users/543cc155b0b4438386263957f64d2164` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:25.158180 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd552851-573a-4ce3-9d1b-825208689f02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=543cc155b0b4438386263957f64d2164)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:25.165655 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd552851-573a-4ce3-9d1b-825208689f02 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:25.282516 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-fd552851-573a-4ce3-9d1b-825208689f02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '543cc155b0b4438386263957f64d2164'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:25.297946 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-fd552851-573a-4ce3-9d1b-825208689f02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '543cc155b0b4438386263957f64d2164'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:25.313402 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-fd552851-573a-4ce3-9d1b-825208689f02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '543cc155b0b4438386263957f64d2164'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:25.314394 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-fd552851-573a-4ce3-9d1b-825208689f02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '543cc155b0b4438386263957f64d2164'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:25.355068 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-fd552851-573a-4ce3-9d1b-825208689f02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '543cc155b0b4438386263957f64d2164'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:25.371749 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 790/1587] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:13:25 2021] DELETE /identity/v3/users/543cc155b0b4438386263957f64d2164 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:25.376468 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eb4e1-5b07-477b-ab19-412047703c93 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:25.376829 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eb4e1-5b07-477b-ab19-412047703c93 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:25.377072 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4eb4e1-5b07-477b-ab19-412047703c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:25.405859 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-fd4eb4e1-5b07-477b-ab19-412047703c93 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:25.408333 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-fd4eb4e1-5b07-477b-ab19-412047703c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:25.578843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 798/1588] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:25.608833 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd552851-573a-4ce3-9d1b-825208689f02 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:25.611048 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-fd552851-573a-4ce3-9d1b-825208689f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:25.741348 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd552851-573a-4ce3-9d1b-825208689f02 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:25.745199 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772cd7a-3e16-48c6-bedf-c6b39708ea9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:25.745869 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772cd7a-3e16-48c6-bedf-c6b39708ea9b service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:25.746178 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772cd7a-3e16-48c6-bedf-c6b39708ea9b service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:25.746463 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772cd7a-3e16-48c6-bedf-c6b39708ea9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:25.774215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772cd7a-3e16-48c6-bedf-c6b39708ea9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:25.775991 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3772cd7a-3e16-48c6-bedf-c6b39708ea9b service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:25.811218 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 791/1589] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:25.935900 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ef9c-92e6-4ebc-881a-5b88b7ddf646 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:25.937204 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ef9c-92e6-4ebc-881a-5b88b7ddf646 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:25.937204 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c26ef9c-92e6-4ebc-881a-5b88b7ddf646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:25.996417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-5c26ef9c-92e6-4ebc-881a-5b88b7ddf646 None None] MFA Rules not processed for user `e99687be627d4a07a72a2e531d186f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:25.997711 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-5c26ef9c-92e6-4ebc-881a-5b88b7ddf646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:26.235784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 799/1590] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:25 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:26.240846 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d3dc7-b5bf-4b42-a9b4-89dc2e2978bc None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:26.241137 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d3dc7-b5bf-4b42-a9b4-89dc2e2978bc None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:26.241463 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d3dc7-b5bf-4b42-a9b4-89dc2e2978bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:26.278654 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-646d3dc7-b5bf-4b42-a9b4-89dc2e2978bc None None] MFA Rules not processed for user `e99687be627d4a07a72a2e531d186f2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:26.279914 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-646d3dc7-b5bf-4b42-a9b4-89dc2e2978bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:26.301350 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 792/1591] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:26 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:26.313207 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26ef9c-92e6-4ebc-881a-5b88b7ddf646 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:26.314705 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-5c26ef9c-92e6-4ebc-881a-5b88b7ddf646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:26.367479 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0508f2-4529-49c2-b4f8-0cc5829a96d6 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:26.367820 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0508f2-4529-49c2-b4f8-0cc5829a96d6 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:26.368111 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0508f2-4529-49c2-b4f8-0cc5829a96d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:26.412578 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-ca0508f2-4529-49c2-b4f8-0cc5829a96d6 None None] MFA Rules not processed for user `63baa45ff6a84614ac4656f6c7c6be2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:26.414114 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-ca0508f2-4529-49c2-b4f8-0cc5829a96d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:26.533240 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c26ef9c-92e6-4ebc-881a-5b88b7ddf646 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:26.549911 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14e7bf-1a9a-401f-b509-e45ac73e61f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:26.550618 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14e7bf-1a9a-401f-b509-e45ac73e61f0 service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:26.551036 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14e7bf-1a9a-401f-b509-e45ac73e61f0 service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:26.551336 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14e7bf-1a9a-401f-b509-e45ac73e61f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:26.576195 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 793/1592] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:26 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:26.580303 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff8ed0-91eb-4cde-ac4f-db3cc9a2842b None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:26.580769 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff8ed0-91eb-4cde-ac4f-db3cc9a2842b None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:26.581109 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff8ed0-91eb-4cde-ac4f-db3cc9a2842b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:26.597425 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14e7bf-1a9a-401f-b509-e45ac73e61f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:26.599699 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14e7bf-1a9a-401f-b509-e45ac73e61f0 service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:26.643544 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 800/1593] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:26 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:13:26.647584 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-8fff8ed0-91eb-4cde-ac4f-db3cc9a2842b None None] MFA Rules not processed for user `63baa45ff6a84614ac4656f6c7c6be2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:26.648842 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8fff8ed0-91eb-4cde-ac4f-db3cc9a2842b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:26.679576 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 794/1594] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:26 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:27.065683 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14e7bf-1a9a-401f-b509-e45ac73e61f0 service nova] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:27.068090 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-9c14e7bf-1a9a-401f-b509-e45ac73e61f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:27.105170 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14e7bf-1a9a-401f-b509-e45ac73e61f0 service nova] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:27.114661 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ed13b-fd6a-4d03-b505-ef67dad2f9e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:27.115596 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed13b-fd6a-4d03-b505-ef67dad2f9e7 service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:27.115809 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed13b-fd6a-4d03-b505-ef67dad2f9e7 service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:27.115923 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ed13b-fd6a-4d03-b505-ef67dad2f9e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:27.137123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ed13b-fd6a-4d03-b505-ef67dad2f9e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:27.138921 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ed13b-fd6a-4d03-b505-ef67dad2f9e7 service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:27.186404 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 801/1595] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:27 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:27.496924 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff8ed0-91eb-4cde-ac4f-db3cc9a2842b None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:27.501668 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8fff8ed0-91eb-4cde-ac4f-db3cc9a2842b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:27.553317 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff8ed0-91eb-4cde-ac4f-db3cc9a2842b None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:27.568916 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897bfb2-40dc-4c05-a4c7-0b66dbc77e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:27.569819 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897bfb2-40dc-4c05-a4c7-0b66dbc77e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:27.570150 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897bfb2-40dc-4c05-a4c7-0b66dbc77e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:27.570468 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897bfb2-40dc-4c05-a4c7-0b66dbc77e9a admin admin] PATH_INFO: `/v3/projects/c4d66eb751f94402aad18ec86fa45541` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:27.572003 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897bfb2-40dc-4c05-a4c7-0b66dbc77e9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4d66eb751f94402aad18ec86fa45541)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:27.574656 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING py.warnings [None req-c897bfb2-40dc-4c05-a4c7-0b66dbc77e9a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:13:27.574656 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: warnings.warn(msg) Oct 29 16:13:27.574656 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: Oct 29 16:13:27.576706 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897bfb2-40dc-4c05-a4c7-0b66dbc77e9a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:27.741122 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece098d3-320f-4902-b869-0fbcbd6d9d92 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:27.741428 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece098d3-320f-4902-b869-0fbcbd6d9d92 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:27.742212 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece098d3-320f-4902-b869-0fbcbd6d9d92 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:27.742445 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c897bfb2-40dc-4c05-a4c7-0b66dbc77e9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4d66eb751f94402aad18ec86fa45541', 'request_id': 'req-c897bfb2-40dc-4c05-a4c7-0b66dbc77e9a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:27.745177 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 802/1596] 10.222.0.41 () {54 vars in 912 bytes} [Fri Oct 29 16:13:27 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 29 16:13:27.750015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c897bfb2-40dc-4c05-a4c7-0b66dbc77e9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4d66eb751f94402aad18ec86fa45541', 'request_id': 'req-c897bfb2-40dc-4c05-a4c7-0b66dbc77e9a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:27.750727 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44180b02-d3ea-4aec-88d4-c1368a5d98a1 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:27.751021 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44180b02-d3ea-4aec-88d4-c1368a5d98a1 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:27.751400 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44180b02-d3ea-4aec-88d4-c1368a5d98a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:27.761465 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c897bfb2-40dc-4c05-a4c7-0b66dbc77e9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4d66eb751f94402aad18ec86fa45541', 'request_id': 'req-c897bfb2-40dc-4c05-a4c7-0b66dbc77e9a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:27.822341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c897bfb2-40dc-4c05-a4c7-0b66dbc77e9a admin admin] The token cache is being invalidate because project c4d66eb751f94402aad18ec86fa45541 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:13:27.823448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c897bfb2-40dc-4c05-a4c7-0b66dbc77e9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:27.826078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c897bfb2-40dc-4c05-a4c7-0b66dbc77e9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:27.843465 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 795/1597] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:13:27 2021] DELETE /identity/v3/projects/c4d66eb751f94402aad18ec86fa45541 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:27.846490 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9f67c-a687-427f-ace4-6bacaf00f84f None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:27.847517 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9f67c-a687-427f-ace4-6bacaf00f84f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:27.848699 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c9f67c-a687-427f-ace4-6bacaf00f84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:27.864327 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-44180b02-d3ea-4aec-88d4-c1368a5d98a1 None None] MFA Rules not processed for user `3bb8aa43328d4be08455441d0ffa4e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:27.866909 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-44180b02-d3ea-4aec-88d4-c1368a5d98a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:27.877989 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-85c9f67c-a687-427f-ace4-6bacaf00f84f None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:27.880920 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-85c9f67c-a687-427f-ace4-6bacaf00f84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:28.015987 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 803/1598] 10.222.0.41 () {58 vars in 1009 bytes} [Fri Oct 29 16:13:27 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:28.017018 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44180b02-d3ea-4aec-88d4-c1368a5d98a1 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:28.025657 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-44180b02-d3ea-4aec-88d4-c1368a5d98a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:28.042855 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 796/1599] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:28.051595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfebf2e-fa82-44a0-a68d-05ddeaa5a9a2 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:28.053954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfebf2e-fa82-44a0-a68d-05ddeaa5a9a2 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:28.054516 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44180b02-d3ea-4aec-88d4-c1368a5d98a1 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:28.054957 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfebf2e-fa82-44a0-a68d-05ddeaa5a9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:28.065196 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2018a5d-af14-4dbc-93b0-46f4bf593263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:28.068413 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2018a5d-af14-4dbc-93b0-46f4bf593263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:28.069129 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2018a5d-af14-4dbc-93b0-46f4bf593263 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:28.070222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2018a5d-af14-4dbc-93b0-46f4bf593263 admin admin] PATH_INFO: `/v3/projects/18c4a05bdd89462084ca3087f652503c` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:28.072131 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2018a5d-af14-4dbc-93b0-46f4bf593263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18c4a05bdd89462084ca3087f652503c)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:28.077314 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2018a5d-af14-4dbc-93b0-46f4bf593263 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:28.092733 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-ebfebf2e-fa82-44a0-a68d-05ddeaa5a9a2 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:28.095832 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-ebfebf2e-fa82-44a0-a68d-05ddeaa5a9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:28.116465 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 797/1600] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:28.119849 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfebf2e-fa82-44a0-a68d-05ddeaa5a9a2 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:28.131971 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfebf2e-fa82-44a0-a68d-05ddeaa5a9a2 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:28.147586 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960d3a8-c5e2-43fd-be66-1c9de1b610a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:28.151020 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960d3a8-c5e2-43fd-be66-1c9de1b610a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:28.151575 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960d3a8-c5e2-43fd-be66-1c9de1b610a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:28.152093 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960d3a8-c5e2-43fd-be66-1c9de1b610a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:28.154022 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960d3a8-c5e2-43fd-be66-1c9de1b610a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:13:28.154795 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960d3a8-c5e2-43fd-be66-1c9de1b610a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:28.158073 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960d3a8-c5e2-43fd-be66-1c9de1b610a8 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:28.185189 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 798/1601] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:13:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:13:28.191067 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960d3a8-c5e2-43fd-be66-1c9de1b610a8 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:28.195590 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f2018a5d-af14-4dbc-93b0-46f4bf593263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18c4a05bdd89462084ca3087f652503c', 'request_id': 'req-f2018a5d-af14-4dbc-93b0-46f4bf593263'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:28.202065 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960d3a8-c5e2-43fd-be66-1c9de1b610a8 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:28.208218 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f2018a5d-af14-4dbc-93b0-46f4bf593263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18c4a05bdd89462084ca3087f652503c', 'request_id': 'req-f2018a5d-af14-4dbc-93b0-46f4bf593263'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:28.232682 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f2018a5d-af14-4dbc-93b0-46f4bf593263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18c4a05bdd89462084ca3087f652503c', 'request_id': 'req-f2018a5d-af14-4dbc-93b0-46f4bf593263'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:28.250083 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f2018a5d-af14-4dbc-93b0-46f4bf593263 admin admin] The token cache is being invalidate because project 18c4a05bdd89462084ca3087f652503c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:13:28.250381 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f2018a5d-af14-4dbc-93b0-46f4bf593263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:28.256277 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f2018a5d-af14-4dbc-93b0-46f4bf593263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:28.263613 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 804/1602] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:13:28 2021] DELETE /identity/v3/projects/18c4a05bdd89462084ca3087f652503c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:28.264601 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2018a5d-af14-4dbc-93b0-46f4bf593263 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:28.268352 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f2018a5d-af14-4dbc-93b0-46f4bf593263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:28.270279 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4147b07-3fc2-4f65-9f60-3302cfe10276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:28.271649 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4147b07-3fc2-4f65-9f60-3302cfe10276 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:28.272268 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4147b07-3fc2-4f65-9f60-3302cfe10276 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:28.272552 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4147b07-3fc2-4f65-9f60-3302cfe10276 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:28.273278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4147b07-3fc2-4f65-9f60-3302cfe10276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:28.275873 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4147b07-3fc2-4f65-9f60-3302cfe10276 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:28.299582 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2018a5d-af14-4dbc-93b0-46f4bf593263 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:28.321747 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447450c-0b01-484b-a25c-9ee173b41525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:28.323031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447450c-0b01-484b-a25c-9ee173b41525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:28.323691 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447450c-0b01-484b-a25c-9ee173b41525 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:28.324176 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447450c-0b01-484b-a25c-9ee173b41525 admin admin] PATH_INFO: `/v3/users/7d85d59c27504947b5c3196e30c7723f` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:28.327510 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447450c-0b01-484b-a25c-9ee173b41525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d85d59c27504947b5c3196e30c7723f)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:28.328898 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING py.warnings [None req-a447450c-0b01-484b-a25c-9ee173b41525 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 29 16:13:28.328898 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: warnings.warn(msg) Oct 29 16:13:28.328898 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: Oct 29 16:13:28.332765 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447450c-0b01-484b-a25c-9ee173b41525 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:28.334785 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 799/1603] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:13:28 2021] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:28.336140 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4147b07-3fc2-4f65-9f60-3302cfe10276 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:28.343477 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-f4147b07-3fc2-4f65-9f60-3302cfe10276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:28.495217 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a447450c-0b01-484b-a25c-9ee173b41525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d85d59c27504947b5c3196e30c7723f'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:28.496940 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a447450c-0b01-484b-a25c-9ee173b41525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d85d59c27504947b5c3196e30c7723f'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:28.511487 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4147b07-3fc2-4f65-9f60-3302cfe10276 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:28.518895 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b77ca-a28e-4b36-88b5-ab8722984039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:28.519899 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b77ca-a28e-4b36-88b5-ab8722984039 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:28.520303 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b77ca-a28e-4b36-88b5-ab8722984039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:28.521254 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b77ca-a28e-4b36-88b5-ab8722984039 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:28.522142 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b77ca-a28e-4b36-88b5-ab8722984039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:28.526015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b77ca-a28e-4b36-88b5-ab8722984039 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:28.556283 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a447450c-0b01-484b-a25c-9ee173b41525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d85d59c27504947b5c3196e30c7723f'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:28.562210 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a447450c-0b01-484b-a25c-9ee173b41525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d85d59c27504947b5c3196e30c7723f'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:28.569435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 800/1604] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:13:28 2021] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:28.569435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b77ca-a28e-4b36-88b5-ab8722984039 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:28.574437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e59b77ca-a28e-4b36-88b5-ab8722984039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:28.583628 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a447450c-0b01-484b-a25c-9ee173b41525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d85d59c27504947b5c3196e30c7723f'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:28.621015 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 805/1605] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:13:28 2021] DELETE /identity/v3/users/7d85d59c27504947b5c3196e30c7723f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:28.627940 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76ca8d-537a-4a75-8509-a0ffe23813f4 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:28.629276 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76ca8d-537a-4a75-8509-a0ffe23813f4 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:28.629727 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb76ca8d-537a-4a75-8509-a0ffe23813f4 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:28.639152 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 806/1606] 10.222.0.41 () {54 vars in 912 bytes} [Fri Oct 29 16:13:28 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:13:28.640370 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76ca8d-537a-4a75-8509-a0ffe23813f4 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:28.642554 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-eb76ca8d-537a-4a75-8509-a0ffe23813f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:28.697149 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b77ca-a28e-4b36-88b5-ab8722984039 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:28.840910 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb76ca8d-537a-4a75-8509-a0ffe23813f4 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:28.847868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dda433-6b13-4f96-902d-a92aac0a9715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:28.850102 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dda433-6b13-4f96-902d-a92aac0a9715 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:28.851293 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dda433-6b13-4f96-902d-a92aac0a9715 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:28.852312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dda433-6b13-4f96-902d-a92aac0a9715 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:28.860595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1755f-f787-44e2-b02a-8418eb5f65bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:28.861869 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1755f-f787-44e2-b02a-8418eb5f65bf service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:28.865402 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1755f-f787-44e2-b02a-8418eb5f65bf service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:28.866706 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1755f-f787-44e2-b02a-8418eb5f65bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:28.873381 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a0b1755f-f787-44e2-b02a-8418eb5f65bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:28.874165 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dda433-6b13-4f96-902d-a92aac0a9715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:28.878590 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dda433-6b13-4f96-902d-a92aac0a9715 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:28.896859 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 807/1607] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:28 2021] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:28.896859 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cd50f-d1ee-41ea-90fd-ad6d5ae421ae None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:28.896859 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cd50f-d1ee-41ea-90fd-ad6d5ae421ae None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:28.897953 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86cd50f-d1ee-41ea-90fd-ad6d5ae421ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:28.901772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1755f-f787-44e2-b02a-8418eb5f65bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:28.904433 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1755f-f787-44e2-b02a-8418eb5f65bf service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:28.925872 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-a86cd50f-d1ee-41ea-90fd-ad6d5ae421ae None None] MFA Rules not processed for user `3bb8aa43328d4be08455441d0ffa4e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:28.929216 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 801/1608] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:28 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:28.930016 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1755f-f787-44e2-b02a-8418eb5f65bf service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:28.930564 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a86cd50f-d1ee-41ea-90fd-ad6d5ae421ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:28.939146 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 808/1609] 10.222.0.41 () {58 vars in 1009 bytes} [Fri Oct 29 16:13:28 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:28.946827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1755f-f787-44e2-b02a-8418eb5f65bf service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:28.953018 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f86c80-3b3f-4b5a-81ac-6989d3e48f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:28.953911 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f86c80-3b3f-4b5a-81ac-6989d3e48f63 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:28.954403 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f86c80-3b3f-4b5a-81ac-6989d3e48f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:28.954801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f86c80-3b3f-4b5a-81ac-6989d3e48f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:28.956554 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f86c80-3b3f-4b5a-81ac-6989d3e48f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:28.959038 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f86c80-3b3f-4b5a-81ac-6989d3e48f63 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:28.968878 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cd50f-d1ee-41ea-90fd-ad6d5ae421ae None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:28.971799 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a86cd50f-d1ee-41ea-90fd-ad6d5ae421ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:28.979741 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 802/1610] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:28 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:28.984263 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f86c80-3b3f-4b5a-81ac-6989d3e48f63 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:29.002594 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86cd50f-d1ee-41ea-90fd-ad6d5ae421ae None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:29.008599 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f86c80-3b3f-4b5a-81ac-6989d3e48f63 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:29.012552 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e72f38-487e-4f38-a048-8247f700395a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:29.013460 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e72f38-487e-4f38-a048-8247f700395a service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:29.013587 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e72f38-487e-4f38-a048-8247f700395a service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:29.014163 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e72f38-487e-4f38-a048-8247f700395a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:29.021322 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b962367-cea8-4428-a206-27caa1c0f1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:29.022286 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b962367-cea8-4428-a206-27caa1c0f1e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:29.022563 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b962367-cea8-4428-a206-27caa1c0f1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:29.022835 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b962367-cea8-4428-a206-27caa1c0f1e7 admin admin] PATH_INFO: `/v3/projects/de01a0e8df844c4288d6b89123c5bab2/users/2698c6fbef99458b8ea98b3ec87376d7/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:29.030811 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e72f38-487e-4f38-a048-8247f700395a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:29.032095 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e72f38-487e-4f38-a048-8247f700395a service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:29.046774 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b962367-cea8-4428-a206-27caa1c0f1e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de01a0e8df844c4288d6b89123c5bab2, user_id=2698c6fbef99458b8ea98b3ec87376d7, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:29.050573 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b962367-cea8-4428-a206-27caa1c0f1e7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:29.057894 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 809/1611] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:28 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:29.077449 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 803/1612] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:28 2021] PUT /identity/v3/projects/de01a0e8df844c4288d6b89123c5bab2/users/2698c6fbef99458b8ea98b3ec87376d7/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:29.091419 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcfa9c-fd3e-4609-bd4f-7966d579034d None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:29.092659 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcfa9c-fd3e-4609-bd4f-7966d579034d None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:29.093296 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fcfa9c-fd3e-4609-bd4f-7966d579034d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:29.133306 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-78fcfa9c-fd3e-4609-bd4f-7966d579034d None None] MFA Rules not processed for user `2698c6fbef99458b8ea98b3ec87376d7`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:29.134763 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-78fcfa9c-fd3e-4609-bd4f-7966d579034d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:29.213274 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 810/1613] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:29 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:29.214828 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b962367-cea8-4428-a206-27caa1c0f1e7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:29.344341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b962367-cea8-4428-a206-27caa1c0f1e7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:29.358096 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989bc5f-84c3-4898-b4b5-14613dcff83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:29.359409 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989bc5f-84c3-4898-b4b5-14613dcff83e admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:29.359720 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989bc5f-84c3-4898-b4b5-14613dcff83e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:29.362124 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3989bc5f-84c3-4898-b4b5-14613dcff83e admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:29.362934 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989bc5f-84c3-4898-b4b5-14613dcff83e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:29.372522 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3989bc5f-84c3-4898-b4b5-14613dcff83e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:29.451139 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 804/1614] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:13:29 2021] POST /identity/v3/projects => generated 379 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:29.455304 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcfa9c-fd3e-4609-bd4f-7966d579034d None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:29.479074 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fcfa9c-fd3e-4609-bd4f-7966d579034d None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:29.609328 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8096e5f-31fa-4960-aef5-788123440e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:29.610531 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8096e5f-31fa-4960-aef5-788123440e3e admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:29.611192 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8096e5f-31fa-4960-aef5-788123440e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:29.611700 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8096e5f-31fa-4960-aef5-788123440e3e admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:29.612784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8096e5f-31fa-4960-aef5-788123440e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:29.617639 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8096e5f-31fa-4960-aef5-788123440e3e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:29.653746 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 811/1615] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:13:29 2021] POST /identity/v3/users => generated 296 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:29.658529 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989bc5f-84c3-4898-b4b5-14613dcff83e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:29.714550 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3989bc5f-84c3-4898-b4b5-14613dcff83e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:29.721317 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e93a6-ecb7-4422-809e-f36f9033b9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:29.722477 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e93a6-ecb7-4422-809e-f36f9033b9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:29.722963 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e93a6-ecb7-4422-809e-f36f9033b9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:29.723417 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e93a6-ecb7-4422-809e-f36f9033b9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:29.724574 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e93a6-ecb7-4422-809e-f36f9033b9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:29.726493 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e93a6-ecb7-4422-809e-f36f9033b9f0 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:29.758293 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 805/1616] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:29 2021] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:29.760123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8096e5f-31fa-4960-aef5-788123440e3e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:29.771321 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8096e5f-31fa-4960-aef5-788123440e3e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:29.795677 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ab07a-4fd1-4f5b-993d-519a74612262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:29.811976 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ab07a-4fd1-4f5b-993d-519a74612262 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:29.812517 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ab07a-4fd1-4f5b-993d-519a74612262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:29.813020 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902ab07a-4fd1-4f5b-993d-519a74612262 admin admin] PATH_INFO: `/v3/projects/162685b3bd594485be7045efcd043ae3/users/1ee16613ac1b49598b5a0a860f256ed5/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:29.844143 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e93a6-ecb7-4422-809e-f36f9033b9f0 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:29.846815 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-b78e93a6-ecb7-4422-809e-f36f9033b9f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:29.878776 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ab07a-4fd1-4f5b-993d-519a74612262 admin admin] RBAC: Authorizing `identity:create_grant(project_id=162685b3bd594485be7045efcd043ae3, user_id=1ee16613ac1b49598b5a0a860f256ed5, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:29.883370 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902ab07a-4fd1-4f5b-993d-519a74612262 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:29.913833 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 812/1617] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:29 2021] PUT /identity/v3/projects/162685b3bd594485be7045efcd043ae3/users/1ee16613ac1b49598b5a0a860f256ed5/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:29.917466 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ab07a-4fd1-4f5b-993d-519a74612262 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:30.086548 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e93a6-ecb7-4422-809e-f36f9033b9f0 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:30.115224 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902ab07a-4fd1-4f5b-993d-519a74612262 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:30.135908 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2890ed-851a-4d88-b2ce-be059c05c6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:30.136697 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2890ed-851a-4d88-b2ce-be059c05c6b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:30.138406 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2890ed-851a-4d88-b2ce-be059c05c6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:30.138763 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2890ed-851a-4d88-b2ce-be059c05c6b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:30.139598 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2890ed-851a-4d88-b2ce-be059c05c6b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:30.145548 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2890ed-851a-4d88-b2ce-be059c05c6b9 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:30.191113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 813/1618] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:29 2021] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:13:30.196399 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2890ed-851a-4d88-b2ce-be059c05c6b9 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:30.256625 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2890ed-851a-4d88-b2ce-be059c05c6b9 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:30.276029 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08acb929-d9d7-405b-80da-32ca6915b3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:30.277244 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acb929-d9d7-405b-80da-32ca6915b3d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:30.281169 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acb929-d9d7-405b-80da-32ca6915b3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:30.281855 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08acb929-d9d7-405b-80da-32ca6915b3d1 admin admin] PATH_INFO: `/v3/projects/162685b3bd594485be7045efcd043ae3/users/1ee16613ac1b49598b5a0a860f256ed5/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:30.293354 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acb929-d9d7-405b-80da-32ca6915b3d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=162685b3bd594485be7045efcd043ae3, user_id=1ee16613ac1b49598b5a0a860f256ed5, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:30.319856 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08acb929-d9d7-405b-80da-32ca6915b3d1 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:30.355979 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 814/1619] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:30 2021] PUT /identity/v3/projects/162685b3bd594485be7045efcd043ae3/users/1ee16613ac1b49598b5a0a860f256ed5/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:30.356894 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb910e3b-e309-482a-a25e-cde71a5c7f19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:30.357753 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb910e3b-e309-482a-a25e-cde71a5c7f19 service placement] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:30.358254 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb910e3b-e309-482a-a25e-cde71a5c7f19 service placement] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:30.360949 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb910e3b-e309-482a-a25e-cde71a5c7f19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:30.367177 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0f9e6-95d0-4d0a-b57b-528735ddcc5c None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:30.367491 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0f9e6-95d0-4d0a-b57b-528735ddcc5c None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:30.367776 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0f9e6-95d0-4d0a-b57b-528735ddcc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:30.367961 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-fb910e3b-e309-482a-a25e-cde71a5c7f19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:30.402194 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb910e3b-e309-482a-a25e-cde71a5c7f19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:30.403886 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb910e3b-e309-482a-a25e-cde71a5c7f19 service placement] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:30.422112 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-7ed0f9e6-95d0-4d0a-b57b-528735ddcc5c None None] MFA Rules not processed for user `1ee16613ac1b49598b5a0a860f256ed5`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:30.423322 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-7ed0f9e6-95d0-4d0a-b57b-528735ddcc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:30.423844 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 806/1620] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:29 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:30.603870 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 815/1621] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:30 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:13:30.605052 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb910e3b-e309-482a-a25e-cde71a5c7f19 service placement] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:30.621409 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb910e3b-e309-482a-a25e-cde71a5c7f19 service placement] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:30.805242 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6111f9-7426-45f2-9853-4ec7a9f73620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:30.807212 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6111f9-7426-45f2-9853-4ec7a9f73620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:30.807726 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6111f9-7426-45f2-9853-4ec7a9f73620 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:30.808718 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6111f9-7426-45f2-9853-4ec7a9f73620 admin admin] PATH_INFO: `/v3/users/2698c6fbef99458b8ea98b3ec87376d7` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:30.811552 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6111f9-7426-45f2-9853-4ec7a9f73620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2698c6fbef99458b8ea98b3ec87376d7)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:30.818111 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6111f9-7426-45f2-9853-4ec7a9f73620 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:30.943916 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0c6111f9-7426-45f2-9853-4ec7a9f73620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2698c6fbef99458b8ea98b3ec87376d7'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:30.963438 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0c6111f9-7426-45f2-9853-4ec7a9f73620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2698c6fbef99458b8ea98b3ec87376d7'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:30.980737 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0c6111f9-7426-45f2-9853-4ec7a9f73620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2698c6fbef99458b8ea98b3ec87376d7'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:30.983966 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0c6111f9-7426-45f2-9853-4ec7a9f73620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2698c6fbef99458b8ea98b3ec87376d7'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:31.054412 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0c6111f9-7426-45f2-9853-4ec7a9f73620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2698c6fbef99458b8ea98b3ec87376d7'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:31.062611 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0f9e6-95d0-4d0a-b57b-528735ddcc5c None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:31.065254 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-7ed0f9e6-95d0-4d0a-b57b-528735ddcc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:31.078340 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 807/1622] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:13:30 2021] DELETE /identity/v3/users/2698c6fbef99458b8ea98b3ec87376d7 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:31.080218 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170526a-2150-431e-9b21-3859bea067f9 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:31.080509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170526a-2150-431e-9b21-3859bea067f9 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:31.080787 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170526a-2150-431e-9b21-3859bea067f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:31.108522 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-6170526a-2150-431e-9b21-3859bea067f9 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:31.110829 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-6170526a-2150-431e-9b21-3859bea067f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:31.122404 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0f9e6-95d0-4d0a-b57b-528735ddcc5c None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:31.350998 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0763f87-3f81-46aa-a684-8fb724bbed36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:31.367909 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 808/1623] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:31.372615 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0763f87-3f81-46aa-a684-8fb724bbed36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:31.373075 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0763f87-3f81-46aa-a684-8fb724bbed36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:31.373509 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0763f87-3f81-46aa-a684-8fb724bbed36 admin admin] PATH_INFO: `/v3/projects/98b500100ae94eafb0ddb0d923c71409` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:31.374758 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66b963-514e-4923-ab91-1c362f13d818 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:31.375053 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66b963-514e-4923-ab91-1c362f13d818 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:31.381307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66b963-514e-4923-ab91-1c362f13d818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:31.385453 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0763f87-3f81-46aa-a684-8fb724bbed36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98b500100ae94eafb0ddb0d923c71409)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:31.387941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0763f87-3f81-46aa-a684-8fb724bbed36 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:31.471041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-fd66b963-514e-4923-ab91-1c362f13d818 None None] MFA Rules not processed for user `33143e95face4c81af346e9ca6991ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:31.472816 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-fd66b963-514e-4923-ab91-1c362f13d818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:31.485478 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-c0763f87-3f81-46aa-a684-8fb724bbed36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98b500100ae94eafb0ddb0d923c71409', 'request_id': 'req-c0763f87-3f81-46aa-a684-8fb724bbed36'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:31.503668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-c0763f87-3f81-46aa-a684-8fb724bbed36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98b500100ae94eafb0ddb0d923c71409', 'request_id': 'req-c0763f87-3f81-46aa-a684-8fb724bbed36'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:31.523019 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-c0763f87-3f81-46aa-a684-8fb724bbed36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98b500100ae94eafb0ddb0d923c71409', 'request_id': 'req-c0763f87-3f81-46aa-a684-8fb724bbed36'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:31.543064 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-c0763f87-3f81-46aa-a684-8fb724bbed36 admin admin] The token cache is being invalidate because project 98b500100ae94eafb0ddb0d923c71409 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:13:31.543727 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-c0763f87-3f81-46aa-a684-8fb724bbed36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:31.547417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-c0763f87-3f81-46aa-a684-8fb724bbed36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:31.550637 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 816/1624] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:13:31 2021] DELETE /identity/v3/projects/98b500100ae94eafb0ddb0d923c71409 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:31.551968 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0763f87-3f81-46aa-a684-8fb724bbed36 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:31.554956 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c0763f87-3f81-46aa-a684-8fb724bbed36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:31.640135 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0763f87-3f81-46aa-a684-8fb724bbed36 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:31.644291 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 809/1625] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:31 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:31.646505 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78434873-2bff-43fe-891b-14340e669947 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:31.646797 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78434873-2bff-43fe-891b-14340e669947 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:31.647068 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78434873-2bff-43fe-891b-14340e669947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:31.655734 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582fbea-1a16-42dd-9cec-58d620d39338 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:31.656707 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582fbea-1a16-42dd-9cec-58d620d39338 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:31.657287 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582fbea-1a16-42dd-9cec-58d620d39338 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:31.657900 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582fbea-1a16-42dd-9cec-58d620d39338 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:31.679560 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-9582fbea-1a16-42dd-9cec-58d620d39338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:31.698091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-78434873-2bff-43fe-891b-14340e669947 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:31.699749 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-78434873-2bff-43fe-891b-14340e669947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:31.839839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582fbea-1a16-42dd-9cec-58d620d39338 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:31.844256 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582fbea-1a16-42dd-9cec-58d620d39338 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:31.859305 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 817/1626] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:31.860813 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582fbea-1a16-42dd-9cec-58d620d39338 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:31.863017 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-9582fbea-1a16-42dd-9cec-58d620d39338 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:31.940634 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 810/1627] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:31.942280 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e650c-65cd-4e5f-b620-aad05af78851 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:31.943234 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e650c-65cd-4e5f-b620-aad05af78851 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:31.943696 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2e650c-65cd-4e5f-b620-aad05af78851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:31.956318 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582fbea-1a16-42dd-9cec-58d620d39338 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:31.963978 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db52f7a-63e0-4fd5-beda-229787075662 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:31.964990 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db52f7a-63e0-4fd5-beda-229787075662 service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:31.965441 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db52f7a-63e0-4fd5-beda-229787075662 service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:31.965865 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db52f7a-63e0-4fd5-beda-229787075662 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:31.976565 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db52f7a-63e0-4fd5-beda-229787075662 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:31.978894 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db52f7a-63e0-4fd5-beda-229787075662 service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:32.007149 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 818/1628] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:31 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:32.011232 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-cb2e650c-65cd-4e5f-b620-aad05af78851 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:32.012513 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-cb2e650c-65cd-4e5f-b620-aad05af78851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:32.040211 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 811/1629] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:32.041487 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db52f7a-63e0-4fd5-beda-229787075662 service nova] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:32.058702 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db52f7a-63e0-4fd5-beda-229787075662 service nova] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:32.070564 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a7780-79bf-4138-b78e-4e0e06d151c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:32.071259 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a7780-79bf-4138-b78e-4e0e06d151c6 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:32.071548 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a7780-79bf-4138-b78e-4e0e06d151c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:32.071881 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3a7780-79bf-4138-b78e-4e0e06d151c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:32.076007 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a7780-79bf-4138-b78e-4e0e06d151c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:13:32.076519 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a7780-79bf-4138-b78e-4e0e06d151c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:32.080776 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3a7780-79bf-4138-b78e-4e0e06d151c6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:32.110261 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 819/1630] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:13:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:13:32.113716 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e650c-65cd-4e5f-b620-aad05af78851 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:32.130505 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2e650c-65cd-4e5f-b620-aad05af78851 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:32.153115 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7be9ee-d0b1-4d6c-870f-ebe9c7a7013c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:32.154371 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7be9ee-d0b1-4d6c-870f-ebe9c7a7013c admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:32.154718 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7be9ee-d0b1-4d6c-870f-ebe9c7a7013c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:32.155089 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7be9ee-d0b1-4d6c-870f-ebe9c7a7013c admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:32.155869 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7be9ee-d0b1-4d6c-870f-ebe9c7a7013c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:32.180264 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7be9ee-d0b1-4d6c-870f-ebe9c7a7013c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:32.238913 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 812/1631] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:13:32 2021] POST /identity/v3/projects => generated 401 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:32.243465 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a7780-79bf-4138-b78e-4e0e06d151c6 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:32.257150 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3a7780-79bf-4138-b78e-4e0e06d151c6 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:32.424859 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a0a17-75cb-4cc6-9116-906031e6c506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:32.425663 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a0a17-75cb-4cc6-9116-906031e6c506 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:32.426031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a0a17-75cb-4cc6-9116-906031e6c506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:32.427874 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a0a17-75cb-4cc6-9116-906031e6c506 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:32.430328 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a0a17-75cb-4cc6-9116-906031e6c506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:32.434483 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a0a17-75cb-4cc6-9116-906031e6c506 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:32.506292 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 820/1632] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:13:32 2021] POST /identity/v3/users => generated 301 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:13:32.509383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7be9ee-d0b1-4d6c-870f-ebe9c7a7013c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:32.532251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7be9ee-d0b1-4d6c-870f-ebe9c7a7013c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:32.546798 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4986ca-2e0e-4a1e-b98a-e9154bed3ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:32.547517 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4986ca-2e0e-4a1e-b98a-e9154bed3ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:32.547805 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4986ca-2e0e-4a1e-b98a-e9154bed3ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:32.548086 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4986ca-2e0e-4a1e-b98a-e9154bed3ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:32.548858 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4986ca-2e0e-4a1e-b98a-e9154bed3ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:32.550622 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4986ca-2e0e-4a1e-b98a-e9154bed3ab6 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:32.578305 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 813/1633] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:32 2021] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:32.582974 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a0a17-75cb-4cc6-9116-906031e6c506 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:32.612926 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a0a17-75cb-4cc6-9116-906031e6c506 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:32.629874 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51c93b-bef6-45b7-89e2-d24057d5ad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:32.631174 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51c93b-bef6-45b7-89e2-d24057d5ad2b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:32.631650 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51c93b-bef6-45b7-89e2-d24057d5ad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:32.634049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51c93b-bef6-45b7-89e2-d24057d5ad2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:32.634850 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51c93b-bef6-45b7-89e2-d24057d5ad2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:32.641150 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51c93b-bef6-45b7-89e2-d24057d5ad2b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:32.682167 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 821/1634] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:32 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:32.684857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4986ca-2e0e-4a1e-b98a-e9154bed3ab6 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:32.701744 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4986ca-2e0e-4a1e-b98a-e9154bed3ab6 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:32.713801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c9750-d005-4e87-bd35-74e3e7bcb2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:32.715552 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c9750-d005-4e87-bd35-74e3e7bcb2da admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:32.715826 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c9750-d005-4e87-bd35-74e3e7bcb2da admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:32.718784 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c9750-d005-4e87-bd35-74e3e7bcb2da admin admin] PATH_INFO: `/v3/projects/3ce26b6227214329abc88943cbf5d865/users/b487b09f07be4449ab5d659e6f879721/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:32.758770 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c9750-d005-4e87-bd35-74e3e7bcb2da admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce26b6227214329abc88943cbf5d865, user_id=b487b09f07be4449ab5d659e6f879721, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:32.769669 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c9750-d005-4e87-bd35-74e3e7bcb2da admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:32.846078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 814/1635] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:32 2021] PUT /identity/v3/projects/3ce26b6227214329abc88943cbf5d865/users/b487b09f07be4449ab5d659e6f879721/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:13:32.934198 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacf441-741e-4f26-a7e8-5fc1790b4cb5 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:32.934483 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacf441-741e-4f26-a7e8-5fc1790b4cb5 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:32.934814 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacf441-741e-4f26-a7e8-5fc1790b4cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:33.012659 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-ecacf441-741e-4f26-a7e8-5fc1790b4cb5 None None] MFA Rules not processed for user `b487b09f07be4449ab5d659e6f879721`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:33.020007 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ecacf441-741e-4f26-a7e8-5fc1790b4cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:33.238211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 822/1636] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:32 2021] POST /identity/v3/auth/tokens => generated 3421 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:33.243812 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c9750-d005-4e87-bd35-74e3e7bcb2da admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:33.519502 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c9750-d005-4e87-bd35-74e3e7bcb2da admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:33.534028 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2bef3-64b4-4c6f-8d3f-3c9a2b9797ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:33.534734 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2bef3-64b4-4c6f-8d3f-3c9a2b9797ee admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:33.535018 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2bef3-64b4-4c6f-8d3f-3c9a2b9797ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:33.535301 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2bef3-64b4-4c6f-8d3f-3c9a2b9797ee admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:33.536103 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2bef3-64b4-4c6f-8d3f-3c9a2b9797ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:33.540997 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2bef3-64b4-4c6f-8d3f-3c9a2b9797ee admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:33.610294 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 815/1637] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:13:33 2021] POST /identity/v3/projects => generated 401 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:13:33.614950 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacf441-741e-4f26-a7e8-5fc1790b4cb5 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:33.629053 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2bef3-64b4-4c6f-8d3f-3c9a2b9797ee admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:33.634581 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-19a2bef3-64b4-4c6f-8d3f-3c9a2b9797ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:33.643987 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacf441-741e-4f26-a7e8-5fc1790b4cb5 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:33.870637 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78f5c2-eff6-488a-830f-d2e25d9b495b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:33.871351 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78f5c2-eff6-488a-830f-d2e25d9b495b admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:33.871631 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78f5c2-eff6-488a-830f-d2e25d9b495b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:33.871906 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b78f5c2-eff6-488a-830f-d2e25d9b495b admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:33.872637 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78f5c2-eff6-488a-830f-d2e25d9b495b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:33.874706 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b78f5c2-eff6-488a-830f-d2e25d9b495b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:33.922634 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 823/1638] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:13:33 2021] POST /identity/v3/users => generated 307 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:33.923774 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78f5c2-eff6-488a-830f-d2e25d9b495b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:33.926940 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2bef3-64b4-4c6f-8d3f-3c9a2b9797ee admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:33.942940 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb229701-1980-413a-a5ca-096c119564b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:33.944098 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb229701-1980-413a-a5ca-096c119564b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:33.944558 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb229701-1980-413a-a5ca-096c119564b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:33.944992 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb229701-1980-413a-a5ca-096c119564b7 admin admin] PATH_INFO: `/v3/users/490ef5431d12459187c90d2f377c91ba` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:33.948060 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb229701-1980-413a-a5ca-096c119564b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=490ef5431d12459187c90d2f377c91ba)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:33.950932 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb229701-1980-413a-a5ca-096c119564b7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:33.952594 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b78f5c2-eff6-488a-830f-d2e25d9b495b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:33.966242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa603fec-5509-4b88-817a-fef58923aeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:33.967562 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa603fec-5509-4b88-817a-fef58923aeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:33.967562 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa603fec-5509-4b88-817a-fef58923aeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:33.967562 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa603fec-5509-4b88-817a-fef58923aeb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:33.983053 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa603fec-5509-4b88-817a-fef58923aeb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:33.991581 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa603fec-5509-4b88-817a-fef58923aeb7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:34.019153 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 824/1639] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:33 2021] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:34.020460 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa603fec-5509-4b88-817a-fef58923aeb7 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:34.035375 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa603fec-5509-4b88-817a-fef58923aeb7 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:34.045077 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88050579-77e4-4738-bb34-005435a9c205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:34.046891 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88050579-77e4-4738-bb34-005435a9c205 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:34.047578 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88050579-77e4-4738-bb34-005435a9c205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:34.048182 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88050579-77e4-4738-bb34-005435a9c205 admin admin] PATH_INFO: `/v3/projects/fc9051e832574db8bf7006047c115738/users/85579b904819495d9d8e3a541378ad62/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:34.076201 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88050579-77e4-4738-bb34-005435a9c205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc9051e832574db8bf7006047c115738, user_id=85579b904819495d9d8e3a541378ad62, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:34.080805 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88050579-77e4-4738-bb34-005435a9c205 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:34.100353 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-fb229701-1980-413a-a5ca-096c119564b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490ef5431d12459187c90d2f377c91ba'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:34.120718 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 825/1640] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:34 2021] PUT /identity/v3/projects/fc9051e832574db8bf7006047c115738/users/85579b904819495d9d8e3a541378ad62/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:34.122146 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88050579-77e4-4738-bb34-005435a9c205 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:34.126052 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-fb229701-1980-413a-a5ca-096c119564b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490ef5431d12459187c90d2f377c91ba'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:34.152901 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-fb229701-1980-413a-a5ca-096c119564b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490ef5431d12459187c90d2f377c91ba'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:34.155392 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-fb229701-1980-413a-a5ca-096c119564b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490ef5431d12459187c90d2f377c91ba'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:34.203157 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-fb229701-1980-413a-a5ca-096c119564b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490ef5431d12459187c90d2f377c91ba'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:34.228800 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 816/1641] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:13:33 2021] DELETE /identity/v3/users/490ef5431d12459187c90d2f377c91ba => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:34.229853 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb229701-1980-413a-a5ca-096c119564b7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:34.244187 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-fb229701-1980-413a-a5ca-096c119564b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:34.391325 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88050579-77e4-4738-bb34-005435a9c205 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:34.501862 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb229701-1980-413a-a5ca-096c119564b7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:34.516160 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb9ca8-a3e8-4212-9c20-c8224418b302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:34.516842 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb9ca8-a3e8-4212-9c20-c8224418b302 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:34.517124 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb9ca8-a3e8-4212-9c20-c8224418b302 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:34.524727 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb9ca8-a3e8-4212-9c20-c8224418b302 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:34.527128 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb9ca8-a3e8-4212-9c20-c8224418b302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:34.527907 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523d9bf-6971-49f6-aeef-61ec9a8b415e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:34.528794 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523d9bf-6971-49f6-aeef-61ec9a8b415e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:34.529053 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523d9bf-6971-49f6-aeef-61ec9a8b415e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:34.529327 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523d9bf-6971-49f6-aeef-61ec9a8b415e admin admin] PATH_INFO: `/v3/projects/de01a0e8df844c4288d6b89123c5bab2` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:34.530921 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb9ca8-a3e8-4212-9c20-c8224418b302 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:34.535406 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523d9bf-6971-49f6-aeef-61ec9a8b415e admin admin] RBAC: Authorizing `identity:delete_project(project_id=de01a0e8df844c4288d6b89123c5bab2)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:34.537526 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523d9bf-6971-49f6-aeef-61ec9a8b415e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:34.556061 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 826/1642] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:34 2021] GET /identity/v3/roles => generated 1420 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:34.558021 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107b4b3-0559-4c25-92d3-dd9e4e9f14eb None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:34.558319 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107b4b3-0559-4c25-92d3-dd9e4e9f14eb None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:34.558761 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107b4b3-0559-4c25-92d3-dd9e4e9f14eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:34.581362 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-0107b4b3-0559-4c25-92d3-dd9e4e9f14eb None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:34.582682 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-0107b4b3-0559-4c25-92d3-dd9e4e9f14eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:34.599178 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 827/1643] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:34.600807 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b63d40-8c98-4b34-86c4-7e446c4630a2 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:34.602111 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b63d40-8c98-4b34-86c4-7e446c4630a2 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:34.602400 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b63d40-8c98-4b34-86c4-7e446c4630a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:34.631762 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-f9b63d40-8c98-4b34-86c4-7e446c4630a2 None None] MFA Rules not processed for user `10b4daa146fa4b638d90ea1e9a4878eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:34.633222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f9b63d40-8c98-4b34-86c4-7e446c4630a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:34.672994 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a523d9bf-6971-49f6-aeef-61ec9a8b415e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de01a0e8df844c4288d6b89123c5bab2', 'request_id': 'req-a523d9bf-6971-49f6-aeef-61ec9a8b415e'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:34.693383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a523d9bf-6971-49f6-aeef-61ec9a8b415e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de01a0e8df844c4288d6b89123c5bab2', 'request_id': 'req-a523d9bf-6971-49f6-aeef-61ec9a8b415e'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:34.711194 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a523d9bf-6971-49f6-aeef-61ec9a8b415e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de01a0e8df844c4288d6b89123c5bab2', 'request_id': 'req-a523d9bf-6971-49f6-aeef-61ec9a8b415e'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:34.729154 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 828/1644] 10.222.0.41 () {58 vars in 1009 bytes} [Fri Oct 29 16:13:34 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:34.730076 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b63d40-8c98-4b34-86c4-7e446c4630a2 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:34.734171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f9b63d40-8c98-4b34-86c4-7e446c4630a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:34.744988 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a523d9bf-6971-49f6-aeef-61ec9a8b415e admin admin] The token cache is being invalidate because project de01a0e8df844c4288d6b89123c5bab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:13:34.745281 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a523d9bf-6971-49f6-aeef-61ec9a8b415e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:34.749254 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a523d9bf-6971-49f6-aeef-61ec9a8b415e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:34.753780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 817/1645] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:13:34 2021] DELETE /identity/v3/projects/de01a0e8df844c4288d6b89123c5bab2 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:34.754798 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523d9bf-6971-49f6-aeef-61ec9a8b415e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:34.757641 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a523d9bf-6971-49f6-aeef-61ec9a8b415e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:34.895737 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523d9bf-6971-49f6-aeef-61ec9a8b415e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:34.908649 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefe047-289d-498c-a5aa-772430280b47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:34.909275 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefe047-289d-498c-a5aa-772430280b47 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:34.909751 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefe047-289d-498c-a5aa-772430280b47 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:34.910322 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefe047-289d-498c-a5aa-772430280b47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:34.913912 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b63d40-8c98-4b34-86c4-7e446c4630a2 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:34.917873 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-aeefe047-289d-498c-a5aa-772430280b47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:34.919791 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1af4a-4e05-45ef-9b9d-15c9a4c31f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:34.920906 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1af4a-4e05-45ef-9b9d-15c9a4c31f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:34.921187 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1af4a-4e05-45ef-9b9d-15c9a4c31f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:34.921459 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1af4a-4e05-45ef-9b9d-15c9a4c31f9e admin admin] PATH_INFO: `/v3/projects/fc9051e832574db8bf7006047c115738/users/85579b904819495d9d8e3a541378ad62/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:34.925294 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1af4a-4e05-45ef-9b9d-15c9a4c31f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc9051e832574db8bf7006047c115738, user_id=85579b904819495d9d8e3a541378ad62, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:34.929342 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c1af4a-4e05-45ef-9b9d-15c9a4c31f9e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:34.948461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefe047-289d-498c-a5aa-772430280b47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:34.952605 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefe047-289d-498c-a5aa-772430280b47 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:34.955490 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 829/1646] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:34 2021] PUT /identity/v3/projects/fc9051e832574db8bf7006047c115738/users/85579b904819495d9d8e3a541378ad62/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:34.957082 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1af4a-4e05-45ef-9b9d-15c9a4c31f9e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:34.959056 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c3c1af4a-4e05-45ef-9b9d-15c9a4c31f9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:34.982235 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 818/1647] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:34.983880 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1753e-adb5-4a6e-b969-abddac96a6f2 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:34.984354 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1753e-adb5-4a6e-b969-abddac96a6f2 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:34.984803 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1753e-adb5-4a6e-b969-abddac96a6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:35.055869 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-60d1753e-adb5-4a6e-b969-abddac96a6f2 None None] MFA Rules not processed for user `85579b904819495d9d8e3a541378ad62`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:35.057364 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-60d1753e-adb5-4a6e-b969-abddac96a6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:35.060701 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1af4a-4e05-45ef-9b9d-15c9a4c31f9e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:35.067340 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331b549-e10d-40d1-a691-883646e2b9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:35.068586 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331b549-e10d-40d1-a691-883646e2b9f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:35.068944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331b549-e10d-40d1-a691-883646e2b9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:35.069294 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4331b549-e10d-40d1-a691-883646e2b9f0 admin admin] PATH_INFO: `/v3/users/1ee16613ac1b49598b5a0a860f256ed5` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:35.070781 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331b549-e10d-40d1-a691-883646e2b9f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ee16613ac1b49598b5a0a860f256ed5)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:35.073147 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4331b549-e10d-40d1-a691-883646e2b9f0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:35.191769 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4331b549-e10d-40d1-a691-883646e2b9f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ee16613ac1b49598b5a0a860f256ed5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:35.193497 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4331b549-e10d-40d1-a691-883646e2b9f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ee16613ac1b49598b5a0a860f256ed5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:35.216072 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4331b549-e10d-40d1-a691-883646e2b9f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ee16613ac1b49598b5a0a860f256ed5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:35.216825 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4331b549-e10d-40d1-a691-883646e2b9f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ee16613ac1b49598b5a0a860f256ed5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:35.229488 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4331b549-e10d-40d1-a691-883646e2b9f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ee16613ac1b49598b5a0a860f256ed5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:35.238955 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 819/1648] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:34 2021] POST /identity/v3/auth/tokens => generated 3488 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:35.238955 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1753e-adb5-4a6e-b969-abddac96a6f2 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:35.238955 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-60d1753e-adb5-4a6e-b969-abddac96a6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:35.261941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 830/1649] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:13:34 2021] DELETE /identity/v3/users/1ee16613ac1b49598b5a0a860f256ed5 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:35.262693 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331b549-e10d-40d1-a691-883646e2b9f0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:35.265322 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4331b549-e10d-40d1-a691-883646e2b9f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:35.386800 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4331b549-e10d-40d1-a691-883646e2b9f0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:35.391894 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1753e-adb5-4a6e-b969-abddac96a6f2 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:35.392528 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f4b84-24e3-4c4f-9f87-e01a64c92bf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:35.392870 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f4b84-24e3-4c4f-9f87-e01a64c92bf5 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:35.393312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f4b84-24e3-4c4f-9f87-e01a64c92bf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:35.393816 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431f4b84-24e3-4c4f-9f87-e01a64c92bf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:35.398226 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-431f4b84-24e3-4c4f-9f87-e01a64c92bf5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:35.531124 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07c2bf5-8af6-4cbf-abbd-b61ec4b6ef8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f518ae309c4b4f7eacca882b58e58bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:35.532942 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f4b84-24e3-4c4f-9f87-e01a64c92bf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:35.533114 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c2bf5-8af6-4cbf-abbd-b61ec4b6ef8e service swift] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:35.533548 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c2bf5-8af6-4cbf-abbd-b61ec4b6ef8e service swift] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:35.534197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07c2bf5-8af6-4cbf-abbd-b61ec4b6ef8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:35.534720 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431f4b84-24e3-4c4f-9f87-e01a64c92bf5 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:35.538143 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d07c2bf5-8af6-4cbf-abbd-b61ec4b6ef8e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:35.556487 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 831/1650] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:35 2021] GET /identity/v3/auth/tokens => generated 3488 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:35.703156 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c2bf5-8af6-4cbf-abbd-b61ec4b6ef8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:35.705780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07c2bf5-8af6-4cbf-abbd-b61ec4b6ef8e service swift] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:35.712901 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f4b84-24e3-4c4f-9f87-e01a64c92bf5 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:35.723801 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431f4b84-24e3-4c4f-9f87-e01a64c92bf5 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:35.732882 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01ac42-9a88-41a4-aeff-b435bf041597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:35.736423 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 820/1651] 10.222.0.41 () {60 vars in 1384 bytes} [Fri Oct 29 16:13:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 16:13:35.738034 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01ac42-9a88-41a4-aeff-b435bf041597 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:35.744082 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01ac42-9a88-41a4-aeff-b435bf041597 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:35.748621 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01ac42-9a88-41a4-aeff-b435bf041597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:35.753654 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-1a01ac42-9a88-41a4-aeff-b435bf041597 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:35.968400 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01ac42-9a88-41a4-aeff-b435bf041597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:35.970960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01ac42-9a88-41a4-aeff-b435bf041597 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:35.995810 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 832/1652] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:35 2021] GET /identity/v3/auth/tokens => generated 3421 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:36.338452 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15941e61-6fdb-4207-814b-aa4bee98c61b None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:36.338883 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15941e61-6fdb-4207-814b-aa4bee98c61b None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:36.339303 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15941e61-6fdb-4207-814b-aa4bee98c61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:36.426010 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-15941e61-6fdb-4207-814b-aa4bee98c61b None None] MFA Rules not processed for user `008bf02d56c44048a48f147490c7b073`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:36.429754 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-15941e61-6fdb-4207-814b-aa4bee98c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:36.756080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7a3f3-8f41-4349-a129-14974ecbc3aa None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:36.757227 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7a3f3-8f41-4349-a129-14974ecbc3aa None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:36.757227 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c7a3f3-8f41-4349-a129-14974ecbc3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:36.778561 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 821/1653] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:36 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 441 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:36.783601 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e5c7a3f3-8f41-4349-a129-14974ecbc3aa None None] MFA Rules not processed for user `008bf02d56c44048a48f147490c7b073`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:36.785406 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e5c7a3f3-8f41-4349-a129-14974ecbc3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:36.811916 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 833/1654] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:36 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:36.813845 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15941e61-6fdb-4207-814b-aa4bee98c61b None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:36.816202 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-15941e61-6fdb-4207-814b-aa4bee98c61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:37.117870 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15941e61-6fdb-4207-814b-aa4bee98c61b None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:37.143229 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae52dc26-4d16-4c7c-a952-14de95500350 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:37.154741 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52dc26-4d16-4c7c-a952-14de95500350 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:37.155156 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52dc26-4d16-4c7c-a952-14de95500350 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:37.155322 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52dc26-4d16-4c7c-a952-14de95500350 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:37.178518 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52dc26-4d16-4c7c-a952-14de95500350 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:37.181155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae52dc26-4d16-4c7c-a952-14de95500350 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:37.215424 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 822/1655] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:36 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:38.451129 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7a3f3-8f41-4349-a129-14974ecbc3aa None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:38.454688 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e5c7a3f3-8f41-4349-a129-14974ecbc3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:38.473257 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555117e-00d2-4d6e-82bf-0ab2eb860c44 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:38.474316 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555117e-00d2-4d6e-82bf-0ab2eb860c44 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:38.474403 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b555117e-00d2-4d6e-82bf-0ab2eb860c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:38.558497 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-b555117e-00d2-4d6e-82bf-0ab2eb860c44 None None] MFA Rules not processed for user `3bb8aa43328d4be08455441d0ffa4e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:38.565045 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-b555117e-00d2-4d6e-82bf-0ab2eb860c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:38.671100 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c7a3f3-8f41-4349-a129-14974ecbc3aa None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:38.701844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729d2a9-e85e-411b-bb82-e95a06baead8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:38.706227 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729d2a9-e85e-411b-bb82-e95a06baead8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:38.706817 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729d2a9-e85e-411b-bb82-e95a06baead8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:38.707299 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c729d2a9-e85e-411b-bb82-e95a06baead8 admin admin] PATH_INFO: `/v3/projects/2a2a4341ee2845b489f3aec21ea30c1d` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:38.709058 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729d2a9-e85e-411b-bb82-e95a06baead8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a2a4341ee2845b489f3aec21ea30c1d)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:38.711671 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c729d2a9-e85e-411b-bb82-e95a06baead8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:38.842922 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-c729d2a9-e85e-411b-bb82-e95a06baead8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a2a4341ee2845b489f3aec21ea30c1d', 'request_id': 'req-c729d2a9-e85e-411b-bb82-e95a06baead8'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:38.856542 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-c729d2a9-e85e-411b-bb82-e95a06baead8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a2a4341ee2845b489f3aec21ea30c1d', 'request_id': 'req-c729d2a9-e85e-411b-bb82-e95a06baead8'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:38.874783 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-c729d2a9-e85e-411b-bb82-e95a06baead8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a2a4341ee2845b489f3aec21ea30c1d', 'request_id': 'req-c729d2a9-e85e-411b-bb82-e95a06baead8'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:38.887856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 823/1656] 10.222.0.53 () {58 vars in 1015 bytes} [Fri Oct 29 16:13:38 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:38.899384 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-c729d2a9-e85e-411b-bb82-e95a06baead8 admin admin] The token cache is being invalidate because project 2a2a4341ee2845b489f3aec21ea30c1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:13:38.899694 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-c729d2a9-e85e-411b-bb82-e95a06baead8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:38.901390 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-c729d2a9-e85e-411b-bb82-e95a06baead8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:38.910547 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72e928-a373-4ad4-aa39-f5e3a9155b53 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:38.910972 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 834/1657] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:13:38 2021] DELETE /identity/v3/projects/2a2a4341ee2845b489f3aec21ea30c1d => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:38.911839 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72e928-a373-4ad4-aa39-f5e3a9155b53 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:38.912258 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72e928-a373-4ad4-aa39-f5e3a9155b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:38.942530 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729d2a9-e85e-411b-bb82-e95a06baead8 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:38.944094 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c729d2a9-e85e-411b-bb82-e95a06baead8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:38.975074 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-ba72e928-a373-4ad4-aa39-f5e3a9155b53 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:38.976344 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-ba72e928-a373-4ad4-aa39-f5e3a9155b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:39.112304 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c729d2a9-e85e-411b-bb82-e95a06baead8 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:39.139208 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52189265-d01b-4c95-8d9f-12351652f53e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:39.140343 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52189265-d01b-4c95-8d9f-12351652f53e service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:39.140834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52189265-d01b-4c95-8d9f-12351652f53e service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:39.141300 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52189265-d01b-4c95-8d9f-12351652f53e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:39.149898 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-52189265-d01b-4c95-8d9f-12351652f53e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:39.165015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 824/1658] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:39.178265 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bdaa4-e3ce-40d5-9077-9131b64dec27 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:39.179057 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bdaa4-e3ce-40d5-9077-9131b64dec27 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:39.179591 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bdaa4-e3ce-40d5-9077-9131b64dec27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:39.196928 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52189265-d01b-4c95-8d9f-12351652f53e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:39.198641 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52189265-d01b-4c95-8d9f-12351652f53e service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:39.214462 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 835/1659] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:38 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:13:39.233367 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-fa6bdaa4-e3ce-40d5-9077-9131b64dec27 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:39.237642 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-fa6bdaa4-e3ce-40d5-9077-9131b64dec27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:39.264782 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 825/1660] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:13:39.269411 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52189265-d01b-4c95-8d9f-12351652f53e service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:39.289094 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52189265-d01b-4c95-8d9f-12351652f53e service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:39.295928 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc2560-9840-459e-b9df-38e084c8c355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:39.296598 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc2560-9840-459e-b9df-38e084c8c355 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:39.296884 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc2560-9840-459e-b9df-38e084c8c355 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:39.297161 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bc2560-9840-459e-b9df-38e084c8c355 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:39.297933 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc2560-9840-459e-b9df-38e084c8c355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:13:39.298355 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc2560-9840-459e-b9df-38e084c8c355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:39.300272 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bc2560-9840-459e-b9df-38e084c8c355 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:39.321700 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 836/1661] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:13:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:13:39.326203 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bdaa4-e3ce-40d5-9077-9131b64dec27 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:39.344081 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bdaa4-e3ce-40d5-9077-9131b64dec27 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:39.358889 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25749c6-738b-4491-acfd-b72cc20ec6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:39.359657 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25749c6-738b-4491-acfd-b72cc20ec6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:39.360050 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25749c6-738b-4491-acfd-b72cc20ec6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:39.360340 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25749c6-738b-4491-acfd-b72cc20ec6d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:39.368579 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25749c6-738b-4491-acfd-b72cc20ec6d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:39.373143 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25749c6-738b-4491-acfd-b72cc20ec6d1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:39.448231 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 826/1662] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:13:39 2021] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:39.449707 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc2560-9840-459e-b9df-38e084c8c355 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:39.472037 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bc2560-9840-459e-b9df-38e084c8c355 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:39.713254 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9d16f-74b6-4030-b29a-06671fc76e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:39.717011 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9d16f-74b6-4030-b29a-06671fc76e10 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:39.718534 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9d16f-74b6-4030-b29a-06671fc76e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:39.718983 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f9d16f-74b6-4030-b29a-06671fc76e10 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:39.723033 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9d16f-74b6-4030-b29a-06671fc76e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:39.739955 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f9d16f-74b6-4030-b29a-06671fc76e10 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:39.823067 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 837/1663] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:13:39 2021] POST /identity/v3/users => generated 284 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:39.827518 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25749c6-738b-4491-acfd-b72cc20ec6d1 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:39.868871 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25749c6-738b-4491-acfd-b72cc20ec6d1 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:39.894020 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae93ab5-8ee3-4cd8-9a7e-2fbf15f1fa17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:39.894735 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae93ab5-8ee3-4cd8-9a7e-2fbf15f1fa17 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:39.906354 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae93ab5-8ee3-4cd8-9a7e-2fbf15f1fa17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:39.906771 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae93ab5-8ee3-4cd8-9a7e-2fbf15f1fa17 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:39.907655 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae93ab5-8ee3-4cd8-9a7e-2fbf15f1fa17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:39.921976 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae93ab5-8ee3-4cd8-9a7e-2fbf15f1fa17 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:39.971548 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 827/1664] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:39 2021] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:39.975971 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9d16f-74b6-4030-b29a-06671fc76e10 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:39.995851 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f9d16f-74b6-4030-b29a-06671fc76e10 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:40.004540 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea33a179-9c7d-48a1-b36b-72daf55a4aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:40.008843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33a179-9c7d-48a1-b36b-72daf55a4aca admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:40.009312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33a179-9c7d-48a1-b36b-72daf55a4aca admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:40.009815 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33a179-9c7d-48a1-b36b-72daf55a4aca admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:40.010988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33a179-9c7d-48a1-b36b-72daf55a4aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:40.012982 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea33a179-9c7d-48a1-b36b-72daf55a4aca admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:40.029044 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 838/1665] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:39 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:40.033044 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae93ab5-8ee3-4cd8-9a7e-2fbf15f1fa17 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:40.059892 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae93ab5-8ee3-4cd8-9a7e-2fbf15f1fa17 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:40.072830 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcd6d6-9774-4a5d-a881-7a4419053ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:40.074786 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcd6d6-9774-4a5d-a881-7a4419053ae2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:40.075286 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcd6d6-9774-4a5d-a881-7a4419053ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:40.075800 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcd6d6-9774-4a5d-a881-7a4419053ae2 admin admin] PATH_INFO: `/v3/projects/4b4a2861cfa64a7d8eff54cda724c405/users/07e5ee67b60c41ba9de20c92d6f56409/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:40.127492 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdcd6d6-9774-4a5d-a881-7a4419053ae2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b4a2861cfa64a7d8eff54cda724c405, user_id=07e5ee67b60c41ba9de20c92d6f56409, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:40.133688 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdcd6d6-9774-4a5d-a881-7a4419053ae2 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:40.154342 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 828/1666] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:40 2021] PUT /identity/v3/projects/4b4a2861cfa64a7d8eff54cda724c405/users/07e5ee67b60c41ba9de20c92d6f56409/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:40.165497 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02e8dc-4239-4dc3-af5b-ffd24c888be6 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:40.165839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02e8dc-4239-4dc3-af5b-ffd24c888be6 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:40.166198 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02e8dc-4239-4dc3-af5b-ffd24c888be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:40.279843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-ea02e8dc-4239-4dc3-af5b-ffd24c888be6 None None] MFA Rules not processed for user `07e5ee67b60c41ba9de20c92d6f56409`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:40.281493 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ea02e8dc-4239-4dc3-af5b-ffd24c888be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:40.458386 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcd6d6-9774-4a5d-a881-7a4419053ae2 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:40.461467 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-6fdcd6d6-9774-4a5d-a881-7a4419053ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:40.670075 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 839/1667] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:40 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:40.690297 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02e8dc-4239-4dc3-af5b-ffd24c888be6 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:40.693180 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ea02e8dc-4239-4dc3-af5b-ffd24c888be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:40.843132 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcd6d6-9774-4a5d-a881-7a4419053ae2 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:40.850735 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce773d-c2d4-49f7-8027-2aaa12391d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:40.852036 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce773d-c2d4-49f7-8027-2aaa12391d5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:40.852642 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce773d-c2d4-49f7-8027-2aaa12391d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:40.853219 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce773d-c2d4-49f7-8027-2aaa12391d5d admin admin] PATH_INFO: `/v3/projects/162685b3bd594485be7045efcd043ae3` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:40.855215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce773d-c2d4-49f7-8027-2aaa12391d5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=162685b3bd594485be7045efcd043ae3)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:40.856388 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02e8dc-4239-4dc3-af5b-ffd24c888be6 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:40.871465 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02156c6-d521-482a-bcb2-37e79e495849 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:40.873702 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02156c6-d521-482a-bcb2-37e79e495849 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:40.875535 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02156c6-d521-482a-bcb2-37e79e495849 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:40.875910 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce773d-c2d4-49f7-8027-2aaa12391d5d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:40.876253 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02156c6-d521-482a-bcb2-37e79e495849 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:40.921017 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02156c6-d521-482a-bcb2-37e79e495849 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:40.936606 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02156c6-d521-482a-bcb2-37e79e495849 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:40.969035 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 840/1668] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:40 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:13:41.134800 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-afce773d-c2d4-49f7-8027-2aaa12391d5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '162685b3bd594485be7045efcd043ae3', 'request_id': 'req-afce773d-c2d4-49f7-8027-2aaa12391d5d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:41.152466 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-afce773d-c2d4-49f7-8027-2aaa12391d5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '162685b3bd594485be7045efcd043ae3', 'request_id': 'req-afce773d-c2d4-49f7-8027-2aaa12391d5d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:41.185103 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-afce773d-c2d4-49f7-8027-2aaa12391d5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '162685b3bd594485be7045efcd043ae3', 'request_id': 'req-afce773d-c2d4-49f7-8027-2aaa12391d5d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:41.230836 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-afce773d-c2d4-49f7-8027-2aaa12391d5d admin admin] The token cache is being invalidate because project 162685b3bd594485be7045efcd043ae3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:13:41.231131 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-afce773d-c2d4-49f7-8027-2aaa12391d5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:41.233738 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-afce773d-c2d4-49f7-8027-2aaa12391d5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:41.251373 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 829/1669] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:13:40 2021] DELETE /identity/v3/projects/162685b3bd594485be7045efcd043ae3 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:13:41.300939 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f5663-7db5-4182-af8f-e00d8edbc1cc None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:41.301420 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f5663-7db5-4182-af8f-e00d8edbc1cc None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:41.301718 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f5663-7db5-4182-af8f-e00d8edbc1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:41.341722 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-090f5663-7db5-4182-af8f-e00d8edbc1cc None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:41.343492 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-090f5663-7db5-4182-af8f-e00d8edbc1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:41.564264 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 841/1670] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:41.573330 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfc28f-b562-40ff-959f-50a8241afdcf None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:41.573663 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfc28f-b562-40ff-959f-50a8241afdcf None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:41.573972 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edfc28f-b562-40ff-959f-50a8241afdcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:41.635792 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-4edfc28f-b562-40ff-959f-50a8241afdcf None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:41.646137 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-4edfc28f-b562-40ff-959f-50a8241afdcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:41.708637 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 830/1671] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:41.708744 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f5663-7db5-4182-af8f-e00d8edbc1cc None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:41.724716 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f5663-7db5-4182-af8f-e00d8edbc1cc None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:41.736910 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6f82c-dfe3-4ba6-8e9a-9d6603d3f28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:41.737317 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6f82c-dfe3-4ba6-8e9a-9d6603d3f28b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:41.737550 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6f82c-dfe3-4ba6-8e9a-9d6603d3f28b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:41.737794 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca6f82c-dfe3-4ba6-8e9a-9d6603d3f28b admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:41.738640 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6f82c-dfe3-4ba6-8e9a-9d6603d3f28b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:13:41.739472 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6f82c-dfe3-4ba6-8e9a-9d6603d3f28b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:41.754584 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca6f82c-dfe3-4ba6-8e9a-9d6603d3f28b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:41.791204 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 842/1672] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:13:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:13:41.795456 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfc28f-b562-40ff-959f-50a8241afdcf None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:41.811594 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edfc28f-b562-40ff-959f-50a8241afdcf None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:41.825275 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022fa61-cd46-4bcd-abfb-3dc61b9a00c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:41.825996 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022fa61-cd46-4bcd-abfb-3dc61b9a00c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:41.826448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022fa61-cd46-4bcd-abfb-3dc61b9a00c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:41.826877 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022fa61-cd46-4bcd-abfb-3dc61b9a00c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:41.827768 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022fa61-cd46-4bcd-abfb-3dc61b9a00c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:41.829865 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7022fa61-cd46-4bcd-abfb-3dc61b9a00c4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:41.898119 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 831/1673] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:13:41 2021] POST /identity/v3/projects => generated 407 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:13:41.901726 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6f82c-dfe3-4ba6-8e9a-9d6603d3f28b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:41.915459 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca6f82c-dfe3-4ba6-8e9a-9d6603d3f28b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:42.118465 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08fb8b-b428-43fe-a25d-9d9faa9dbbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:42.119170 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08fb8b-b428-43fe-a25d-9d9faa9dbbd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:42.119457 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08fb8b-b428-43fe-a25d-9d9faa9dbbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:42.119733 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08fb8b-b428-43fe-a25d-9d9faa9dbbd6 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:42.120485 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08fb8b-b428-43fe-a25d-9d9faa9dbbd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:42.122702 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e08fb8b-b428-43fe-a25d-9d9faa9dbbd6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:42.169828 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 843/1674] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:13:41 2021] POST /identity/v3/users => generated 304 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:42.173792 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022fa61-cd46-4bcd-abfb-3dc61b9a00c4 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:42.189314 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022fa61-cd46-4bcd-abfb-3dc61b9a00c4 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:42.206140 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0a438-14a5-4e8b-b0fb-ed9e460d5a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:42.209246 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0a438-14a5-4e8b-b0fb-ed9e460d5a97 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:42.209600 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0a438-14a5-4e8b-b0fb-ed9e460d5a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:42.209883 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0a438-14a5-4e8b-b0fb-ed9e460d5a97 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:42.212190 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0a438-14a5-4e8b-b0fb-ed9e460d5a97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:42.218448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0a438-14a5-4e8b-b0fb-ed9e460d5a97 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:42.242814 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 832/1675] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:42 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:13:42.246815 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08fb8b-b428-43fe-a25d-9d9faa9dbbd6 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:42.265838 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e08fb8b-b428-43fe-a25d-9d9faa9dbbd6 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:42.278691 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a90c5a-814e-4b88-b5bd-6ad84e984924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:42.282838 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a90c5a-814e-4b88-b5bd-6ad84e984924 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:42.282838 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a90c5a-814e-4b88-b5bd-6ad84e984924 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:42.283471 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a90c5a-814e-4b88-b5bd-6ad84e984924 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:42.288543 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a90c5a-814e-4b88-b5bd-6ad84e984924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:42.293659 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a90c5a-814e-4b88-b5bd-6ad84e984924 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:42.331096 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 844/1676] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:42 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:42.336438 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0a438-14a5-4e8b-b0fb-ed9e460d5a97 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:42.360523 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0a438-14a5-4e8b-b0fb-ed9e460d5a97 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:42.368103 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22932597-537b-43c2-a450-3ad9103b17b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:42.369676 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22932597-537b-43c2-a450-3ad9103b17b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:42.370137 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22932597-537b-43c2-a450-3ad9103b17b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:42.370497 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22932597-537b-43c2-a450-3ad9103b17b8 admin admin] PATH_INFO: `/v3/projects/36c08f19a18a4e69969a259803ad214f/users/38e9e167c25b4498a02cd2576107d350/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:42.400681 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a90c5a-814e-4b88-b5bd-6ad84e984924 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:42.403231 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-04a90c5a-814e-4b88-b5bd-6ad84e984924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:42.414914 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22932597-537b-43c2-a450-3ad9103b17b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36c08f19a18a4e69969a259803ad214f, user_id=38e9e167c25b4498a02cd2576107d350, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:42.426211 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22932597-537b-43c2-a450-3ad9103b17b8 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:42.445220 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a90c5a-814e-4b88-b5bd-6ad84e984924 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:42.475788 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00eb2e-26ca-4d3b-ac9a-ec09c07bd2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:42.482373 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00eb2e-26ca-4d3b-ac9a-ec09c07bd2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:42.482684 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00eb2e-26ca-4d3b-ac9a-ec09c07bd2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:42.484245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00eb2e-26ca-4d3b-ac9a-ec09c07bd2cb admin admin] PATH_INFO: `/v3/users/b487b09f07be4449ab5d659e6f879721` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:42.487284 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00eb2e-26ca-4d3b-ac9a-ec09c07bd2cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b487b09f07be4449ab5d659e6f879721)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:42.492570 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 833/1677] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:42 2021] PUT /identity/v3/projects/36c08f19a18a4e69969a259803ad214f/users/38e9e167c25b4498a02cd2576107d350/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:13:42.493457 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00eb2e-26ca-4d3b-ac9a-ec09c07bd2cb admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:42.505404 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a00b3-d188-4bc4-9b23-ae295191b8be None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:42.506129 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a00b3-d188-4bc4-9b23-ae295191b8be None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:42.506696 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2a00b3-d188-4bc4-9b23-ae295191b8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:42.600686 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-9c2a00b3-d188-4bc4-9b23-ae295191b8be None None] MFA Rules not processed for user `38e9e167c25b4498a02cd2576107d350`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:42.606598 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-9c2a00b3-d188-4bc4-9b23-ae295191b8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:42.680079 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7f00eb2e-26ca-4d3b-ac9a-ec09c07bd2cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b487b09f07be4449ab5d659e6f879721'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:42.683581 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7f00eb2e-26ca-4d3b-ac9a-ec09c07bd2cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b487b09f07be4449ab5d659e6f879721'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:42.758205 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7f00eb2e-26ca-4d3b-ac9a-ec09c07bd2cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b487b09f07be4449ab5d659e6f879721'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:42.760386 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7f00eb2e-26ca-4d3b-ac9a-ec09c07bd2cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b487b09f07be4449ab5d659e6f879721'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:42.782374 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7f00eb2e-26ca-4d3b-ac9a-ec09c07bd2cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b487b09f07be4449ab5d659e6f879721'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:42.806267 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 834/1678] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:42 2021] POST /identity/v3/auth/tokens => generated 3427 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:42.812380 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a00b3-d188-4bc4-9b23-ae295191b8be None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:42.814363 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-9c2a00b3-d188-4bc4-9b23-ae295191b8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:42.852454 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 845/1679] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:13:42 2021] DELETE /identity/v3/users/b487b09f07be4449ab5d659e6f879721 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:42.857382 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2e93f-454b-4a52-963d-06c00d24afbb None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:42.857717 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2e93f-454b-4a52-963d-06c00d24afbb None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:42.865181 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c2e93f-454b-4a52-963d-06c00d24afbb None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:42.867422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 846/1680] 10.222.0.41 () {54 vars in 921 bytes} [Fri Oct 29 16:13:42 2021] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:13:42.876248 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ae2a8-cafe-4e32-8862-506c83a7c246 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:42.876524 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ae2a8-cafe-4e32-8862-506c83a7c246 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:42.876874 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300ae2a8-cafe-4e32-8862-506c83a7c246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:42.924756 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2a00b3-d188-4bc4-9b23-ae295191b8be None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:42.948634 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-300ae2a8-cafe-4e32-8862-506c83a7c246 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:42.950796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-300ae2a8-cafe-4e32-8862-506c83a7c246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:43.053652 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ea629-2dce-4858-8b04-b13ae946f187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:43.054523 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ea629-2dce-4858-8b04-b13ae946f187 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:43.054924 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ea629-2dce-4858-8b04-b13ae946f187 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:43.055277 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679ea629-2dce-4858-8b04-b13ae946f187 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:43.056908 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ea629-2dce-4858-8b04-b13ae946f187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:43.064250 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679ea629-2dce-4858-8b04-b13ae946f187 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:43.131043 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 847/1681] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:43.131043 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f2fd1-bdd9-4caa-977f-644fb39a26b1 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:43.131043 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f2fd1-bdd9-4caa-977f-644fb39a26b1 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:43.131043 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f2fd1-bdd9-4caa-977f-644fb39a26b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:43.169438 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 835/1682] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:13:42 2021] POST /identity/v3/projects => generated 405 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:13:43.174544 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ea629-2dce-4858-8b04-b13ae946f187 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:43.241152 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-772f2fd1-bdd9-4caa-977f-644fb39a26b1 None None] MFA Rules not processed for user `4f13d0e9f79a433c81759ecd819a6dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:43.244196 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-772f2fd1-bdd9-4caa-977f-644fb39a26b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:43.418902 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 848/1683] 10.222.0.41 () {58 vars in 1018 bytes} [Fri Oct 29 16:13:43 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:43.419812 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f2fd1-bdd9-4caa-977f-644fb39a26b1 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:43.421353 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-772f2fd1-bdd9-4caa-977f-644fb39a26b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:43.434722 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679ea629-2dce-4858-8b04-b13ae946f187 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:43.454538 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07d057-3671-4a89-846d-55ccc918ffa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:43.455535 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07d057-3671-4a89-846d-55ccc918ffa8 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:43.455821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07d057-3671-4a89-846d-55ccc918ffa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:43.456097 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07d057-3671-4a89-846d-55ccc918ffa8 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:43.456833 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07d057-3671-4a89-846d-55ccc918ffa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:43.469304 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c07d057-3671-4a89-846d-55ccc918ffa8 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:43.562093 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 836/1684] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:13:43 2021] POST /identity/v3/users => generated 309 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:43.563156 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07d057-3671-4a89-846d-55ccc918ffa8 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:43.599046 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f2fd1-bdd9-4caa-977f-644fb39a26b1 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:43.610340 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07d057-3671-4a89-846d-55ccc918ffa8 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:43.614941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c77796-6ce3-4695-afa7-627bbcff1bee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:43.615619 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c77796-6ce3-4695-afa7-627bbcff1bee service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:43.615900 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c77796-6ce3-4695-afa7-627bbcff1bee service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:43.616176 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c77796-6ce3-4695-afa7-627bbcff1bee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:43.641453 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb99f6-6e68-4016-89e2-34f067ae47fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:43.647307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb99f6-6e68-4016-89e2-34f067ae47fc admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:43.647307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb99f6-6e68-4016-89e2-34f067ae47fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:43.647307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb99f6-6e68-4016-89e2-34f067ae47fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:43.647307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb99f6-6e68-4016-89e2-34f067ae47fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:43.647307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cb99f6-6e68-4016-89e2-34f067ae47fc admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:43.667834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c77796-6ce3-4695-afa7-627bbcff1bee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:43.670943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c77796-6ce3-4695-afa7-627bbcff1bee service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:43.723309 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 837/1685] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:43 2021] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:43.724826 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f48e87-69c4-427b-ad21-1a8c6d0fc43b None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:43.725113 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f48e87-69c4-427b-ad21-1a8c6d0fc43b None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:43.731803 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f48e87-69c4-427b-ad21-1a8c6d0fc43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:43.742278 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 849/1686] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:43.745016 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c77796-6ce3-4695-afa7-627bbcff1bee service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:43.826940 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c77796-6ce3-4695-afa7-627bbcff1bee service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:43.858642 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88244119-2cfc-4a29-81bc-0ef6daeb391c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:43.859955 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88244119-2cfc-4a29-81bc-0ef6daeb391c admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:43.862325 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88244119-2cfc-4a29-81bc-0ef6daeb391c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:43.862906 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88244119-2cfc-4a29-81bc-0ef6daeb391c admin admin] PATH_INFO: `/v3/projects/34b86c9fa7f54631ad83a8d35e33819c/users/301b05f90dbd482daa4d1702e24d2620/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:43.866202 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-53f48e87-69c4-427b-ad21-1a8c6d0fc43b None None] MFA Rules not processed for user `008bf02d56c44048a48f147490c7b073`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:43.871525 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-53f48e87-69c4-427b-ad21-1a8c6d0fc43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:43.912909 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88244119-2cfc-4a29-81bc-0ef6daeb391c admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b86c9fa7f54631ad83a8d35e33819c, user_id=301b05f90dbd482daa4d1702e24d2620, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:43.916070 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88244119-2cfc-4a29-81bc-0ef6daeb391c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:43.952856 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 850/1687] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:43 2021] PUT /identity/v3/projects/34b86c9fa7f54631ad83a8d35e33819c/users/301b05f90dbd482daa4d1702e24d2620/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:43.970577 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88244119-2cfc-4a29-81bc-0ef6daeb391c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:43.991687 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-88244119-2cfc-4a29-81bc-0ef6daeb391c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:44.124131 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 838/1688] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:43 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:44.127502 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f48e87-69c4-427b-ad21-1a8c6d0fc43b None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:44.194974 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f48e87-69c4-427b-ad21-1a8c6d0fc43b None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:44.247650 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88244119-2cfc-4a29-81bc-0ef6daeb391c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:44.283933 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17092c47-f7cb-45a7-bfa1-5e3550754b5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:44.284720 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17092c47-f7cb-45a7-bfa1-5e3550754b5c service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:44.287645 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17092c47-f7cb-45a7-bfa1-5e3550754b5c service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:44.288303 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17092c47-f7cb-45a7-bfa1-5e3550754b5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:44.320944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17092c47-f7cb-45a7-bfa1-5e3550754b5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:44.324300 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17092c47-f7cb-45a7-bfa1-5e3550754b5c service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:44.354330 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 851/1689] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:43 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:44.371383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32c2da-f7ec-47de-9010-f7a57487c61f None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:44.371744 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32c2da-f7ec-47de-9010-f7a57487c61f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:44.377164 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c32c2da-f7ec-47de-9010-f7a57487c61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:44.443730 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c23b77-f57c-4f82-ba35-13b8727f8614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:44.453260 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c23b77-f57c-4f82-ba35-13b8727f8614 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:44.453696 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c23b77-f57c-4f82-ba35-13b8727f8614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:44.454180 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c23b77-f57c-4f82-ba35-13b8727f8614 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:44.455429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c23b77-f57c-4f82-ba35-13b8727f8614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:44.457463 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c23b77-f57c-4f82-ba35-13b8727f8614 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:44.483458 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 839/1690] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:44 2021] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:44.486842 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c23b77-f57c-4f82-ba35-13b8727f8614 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:44.513334 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c23b77-f57c-4f82-ba35-13b8727f8614 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:44.522445 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-0c32c2da-f7ec-47de-9010-f7a57487c61f None None] MFA Rules not processed for user `16c47acc08ad42ec9f14cbad92726027`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:44.529316 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eccc8df-4413-4a12-9449-c8dbdd525691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:44.531036 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-0c32c2da-f7ec-47de-9010-f7a57487c61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:44.532143 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccc8df-4413-4a12-9449-c8dbdd525691 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:44.537155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccc8df-4413-4a12-9449-c8dbdd525691 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:44.537652 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eccc8df-4413-4a12-9449-c8dbdd525691 admin admin] PATH_INFO: `/v3/projects/34b86c9fa7f54631ad83a8d35e33819c/users/301b05f90dbd482daa4d1702e24d2620/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:44.546855 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccc8df-4413-4a12-9449-c8dbdd525691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b86c9fa7f54631ad83a8d35e33819c, user_id=301b05f90dbd482daa4d1702e24d2620, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:44.564603 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eccc8df-4413-4a12-9449-c8dbdd525691 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:44.623185 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 840/1691] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:44 2021] PUT /identity/v3/projects/34b86c9fa7f54631ad83a8d35e33819c/users/301b05f90dbd482daa4d1702e24d2620/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:44.642184 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9ee61-60a9-4e9a-add8-071167b6dd82 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:44.642184 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9ee61-60a9-4e9a-add8-071167b6dd82 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:44.642184 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9ee61-60a9-4e9a-add8-071167b6dd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:44.781443 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-55f9ee61-60a9-4e9a-add8-071167b6dd82 None None] MFA Rules not processed for user `301b05f90dbd482daa4d1702e24d2620`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:44.789270 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-55f9ee61-60a9-4e9a-add8-071167b6dd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:44.850958 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 852/1692] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:44 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:45.048733 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 841/1693] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:44 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:45.062803 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32c2da-f7ec-47de-9010-f7a57487c61f None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:45.065499 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-0c32c2da-f7ec-47de-9010-f7a57487c61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:45.278065 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c32c2da-f7ec-47de-9010-f7a57487c61f None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:45.428032 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c042f2-5a2b-4d7d-b422-2082dcf93449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:45.428708 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c042f2-5a2b-4d7d-b422-2082dcf93449 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:45.428988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c042f2-5a2b-4d7d-b422-2082dcf93449 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:45.429268 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c042f2-5a2b-4d7d-b422-2082dcf93449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:45.455818 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c042f2-5a2b-4d7d-b422-2082dcf93449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:45.457482 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c042f2-5a2b-4d7d-b422-2082dcf93449 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:45.496353 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 853/1694] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:45 2021] GET /identity/v3/auth/tokens => generated 3492 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:45.836370 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9ee61-60a9-4e9a-add8-071167b6dd82 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:45.867342 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9ee61-60a9-4e9a-add8-071167b6dd82 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:45.884536 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c109434-52db-46fb-a81f-874318917c75 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:45.886642 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c109434-52db-46fb-a81f-874318917c75 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:45.887997 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c109434-52db-46fb-a81f-874318917c75 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:45.889165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c109434-52db-46fb-a81f-874318917c75 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:45.954961 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c042f2-5a2b-4d7d-b422-2082dcf93449 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:45.956994 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-00c042f2-5a2b-4d7d-b422-2082dcf93449 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:46.217554 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c109434-52db-46fb-a81f-874318917c75 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:46.228268 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c109434-52db-46fb-a81f-874318917c75 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:46.257745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 842/1695] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:45 2021] GET /identity/v3/auth/tokens => generated 3427 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:13:46.262861 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c109434-52db-46fb-a81f-874318917c75 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:46.263917 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c042f2-5a2b-4d7d-b422-2082dcf93449 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:46.266691 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-2c109434-52db-46fb-a81f-874318917c75 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:46.281169 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471ebe2-e865-4425-924c-e23579f015db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:46.282023 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471ebe2-e865-4425-924c-e23579f015db service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:46.282317 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471ebe2-e865-4425-924c-e23579f015db service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:46.282676 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471ebe2-e865-4425-924c-e23579f015db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:46.516492 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c109434-52db-46fb-a81f-874318917c75 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:46.537959 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56445a-0dcf-41c0-bce1-abded3058d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:46.537959 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56445a-0dcf-41c0-bce1-abded3058d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:46.537959 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56445a-0dcf-41c0-bce1-abded3058d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:46.537959 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56445a-0dcf-41c0-bce1-abded3058d17 admin admin] PATH_INFO: `/v3/projects/3ce26b6227214329abc88943cbf5d865` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:46.541006 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56445a-0dcf-41c0-bce1-abded3058d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce26b6227214329abc88943cbf5d865)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:46.549560 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471ebe2-e865-4425-924c-e23579f015db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:46.556563 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56445a-0dcf-41c0-bce1-abded3058d17 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:46.559550 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471ebe2-e865-4425-924c-e23579f015db service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:46.599796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 854/1696] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:45 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:46.781898 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-8a56445a-0dcf-41c0-bce1-abded3058d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce26b6227214329abc88943cbf5d865', 'request_id': 'req-8a56445a-0dcf-41c0-bce1-abded3058d17'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:46.810631 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-8a56445a-0dcf-41c0-bce1-abded3058d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce26b6227214329abc88943cbf5d865', 'request_id': 'req-8a56445a-0dcf-41c0-bce1-abded3058d17'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:46.850634 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d556-255b-4dd7-b7ba-4fbda3e026f1 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:46.851012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d556-255b-4dd7-b7ba-4fbda3e026f1 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:46.851521 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f1d556-255b-4dd7-b7ba-4fbda3e026f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:46.863249 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-8a56445a-0dcf-41c0-bce1-abded3058d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce26b6227214329abc88943cbf5d865', 'request_id': 'req-8a56445a-0dcf-41c0-bce1-abded3058d17'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:46.878368 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-8a56445a-0dcf-41c0-bce1-abded3058d17 admin admin] The token cache is being invalidate because project 3ce26b6227214329abc88943cbf5d865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:13:46.878892 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-8a56445a-0dcf-41c0-bce1-abded3058d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:46.880313 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-8a56445a-0dcf-41c0-bce1-abded3058d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:46.882479 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 843/1697] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:13:46 2021] DELETE /identity/v3/projects/3ce26b6227214329abc88943cbf5d865 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:46.886947 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56445a-0dcf-41c0-bce1-abded3058d17 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:46.889293 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8a56445a-0dcf-41c0-bce1-abded3058d17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:46.916157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e0f1d556-255b-4dd7-b7ba-4fbda3e026f1 None None] MFA Rules not processed for user `33143e95face4c81af346e9ca6991ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:46.924069 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e0f1d556-255b-4dd7-b7ba-4fbda3e026f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:46.989799 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56445a-0dcf-41c0-bce1-abded3058d17 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:47.012053 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb411f51-2d8b-4c61-8ba0-4199ede0e97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:47.013020 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb411f51-2d8b-4c61-8ba0-4199ede0e97c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:47.013308 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb411f51-2d8b-4c61-8ba0-4199ede0e97c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:47.013645 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb411f51-2d8b-4c61-8ba0-4199ede0e97c admin admin] PATH_INFO: `/v3/users/85579b904819495d9d8e3a541378ad62` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:47.020968 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb411f51-2d8b-4c61-8ba0-4199ede0e97c admin admin] RBAC: Authorizing `identity:delete_user(user_id=85579b904819495d9d8e3a541378ad62)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:47.029461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb411f51-2d8b-4c61-8ba0-4199ede0e97c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:47.147024 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bb411f51-2d8b-4c61-8ba0-4199ede0e97c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85579b904819495d9d8e3a541378ad62'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:47.168872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bb411f51-2d8b-4c61-8ba0-4199ede0e97c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85579b904819495d9d8e3a541378ad62'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:47.196658 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 855/1698] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:46 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:47.197822 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bb411f51-2d8b-4c61-8ba0-4199ede0e97c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85579b904819495d9d8e3a541378ad62'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:47.202423 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bb411f51-2d8b-4c61-8ba0-4199ede0e97c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85579b904819495d9d8e3a541378ad62'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:47.221113 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bb411f51-2d8b-4c61-8ba0-4199ede0e97c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85579b904819495d9d8e3a541378ad62'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:47.233519 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 844/1699] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:13:46 2021] DELETE /identity/v3/users/85579b904819495d9d8e3a541378ad62 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:48.530496 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e1480-7325-4daf-b148-e3a2410c9248 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:48.531481 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e1480-7325-4daf-b148-e3a2410c9248 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:48.531481 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e1480-7325-4daf-b148-e3a2410c9248 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:48.533374 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 856/1700] 10.222.0.41 () {54 vars in 921 bytes} [Fri Oct 29 16:13:48 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:13:48.918477 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0118809-54d7-4587-8242-84d8ec183374 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:48.919449 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0118809-54d7-4587-8242-84d8ec183374 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:48.919878 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0118809-54d7-4587-8242-84d8ec183374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:49.017641 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-a0118809-54d7-4587-8242-84d8ec183374 None None] MFA Rules not processed for user `4f13d0e9f79a433c81759ecd819a6dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:49.021052 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a0118809-54d7-4587-8242-84d8ec183374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:49.176032 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 845/1701] 10.222.0.41 () {58 vars in 1018 bytes} [Fri Oct 29 16:13:48 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:13:49.997797 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e1480-7325-4daf-b148-e3a2410c9248 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:50.003402 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4e2e1480-7325-4daf-b148-e3a2410c9248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:50.116431 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0118809-54d7-4587-8242-84d8ec183374 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:50.119798 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a0118809-54d7-4587-8242-84d8ec183374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:50.143229 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0118809-54d7-4587-8242-84d8ec183374 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:50.144197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e1480-7325-4daf-b148-e3a2410c9248 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:50.157371 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b767a2f-e944-49a4-8912-ddfce1061274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:50.158585 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b767a2f-e944-49a4-8912-ddfce1061274 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:50.160592 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd4313e-4e7c-486e-a110-b331152cb47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:50.161011 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b767a2f-e944-49a4-8912-ddfce1061274 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:50.161731 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b767a2f-e944-49a4-8912-ddfce1061274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:50.169501 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4313e-4e7c-486e-a110-b331152cb47a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:50.177044 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4313e-4e7c-486e-a110-b331152cb47a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:50.177553 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd4313e-4e7c-486e-a110-b331152cb47a admin admin] PATH_INFO: `/v3/projects/fc9051e832574db8bf7006047c115738` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:50.183188 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4313e-4e7c-486e-a110-b331152cb47a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc9051e832574db8bf7006047c115738)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:50.185670 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd4313e-4e7c-486e-a110-b331152cb47a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:50.199725 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b767a2f-e944-49a4-8912-ddfce1061274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:50.202743 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b767a2f-e944-49a4-8912-ddfce1061274 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:50.217084 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 846/1702] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:50 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:50.299153 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-1cd4313e-4e7c-486e-a110-b331152cb47a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc9051e832574db8bf7006047c115738', 'request_id': 'req-1cd4313e-4e7c-486e-a110-b331152cb47a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:50.313011 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-1cd4313e-4e7c-486e-a110-b331152cb47a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc9051e832574db8bf7006047c115738', 'request_id': 'req-1cd4313e-4e7c-486e-a110-b331152cb47a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:50.334768 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-1cd4313e-4e7c-486e-a110-b331152cb47a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc9051e832574db8bf7006047c115738', 'request_id': 'req-1cd4313e-4e7c-486e-a110-b331152cb47a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:50.359398 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-1cd4313e-4e7c-486e-a110-b331152cb47a admin admin] The token cache is being invalidate because project fc9051e832574db8bf7006047c115738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:13:50.359701 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-1cd4313e-4e7c-486e-a110-b331152cb47a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:50.365222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-1cd4313e-4e7c-486e-a110-b331152cb47a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:50.374352 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 857/1703] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:13:49 2021] DELETE /identity/v3/projects/fc9051e832574db8bf7006047c115738 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:50.380374 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044db7fa-cd23-416e-a3b5-96ff4d9d3f6e None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:50.380946 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044db7fa-cd23-416e-a3b5-96ff4d9d3f6e None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:50.381454 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044db7fa-cd23-416e-a3b5-96ff4d9d3f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:50.459601 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-044db7fa-cd23-416e-a3b5-96ff4d9d3f6e None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:50.463723 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-044db7fa-cd23-416e-a3b5-96ff4d9d3f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:50.633159 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 847/1704] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:50.640456 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563621f7-a007-4bf3-8264-0ab593cf3027 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:50.640743 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563621f7-a007-4bf3-8264-0ab593cf3027 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:50.641188 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563621f7-a007-4bf3-8264-0ab593cf3027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:50.680053 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-563621f7-a007-4bf3-8264-0ab593cf3027 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:50.687411 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-563621f7-a007-4bf3-8264-0ab593cf3027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:50.735011 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 858/1705] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:50.743600 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044db7fa-cd23-416e-a3b5-96ff4d9d3f6e None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:50.761770 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044db7fa-cd23-416e-a3b5-96ff4d9d3f6e None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:50.771054 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f755a3-1153-4cde-9a2d-da499862d013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:50.772866 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f755a3-1153-4cde-9a2d-da499862d013 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:50.773403 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f755a3-1153-4cde-9a2d-da499862d013 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:50.773865 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f755a3-1153-4cde-9a2d-da499862d013 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:50.775307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f755a3-1153-4cde-9a2d-da499862d013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:13:50.776123 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f755a3-1153-4cde-9a2d-da499862d013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:50.780314 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f755a3-1153-4cde-9a2d-da499862d013 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:50.808811 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 848/1706] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:13:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:13:50.812914 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563621f7-a007-4bf3-8264-0ab593cf3027 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:50.828360 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563621f7-a007-4bf3-8264-0ab593cf3027 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:50.844878 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5b208-74f4-4271-9f45-d39636a60ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:50.845839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5b208-74f4-4271-9f45-d39636a60ce7 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:50.846412 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5b208-74f4-4271-9f45-d39636a60ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:50.847010 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b5b208-74f4-4271-9f45-d39636a60ce7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:50.848183 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5b208-74f4-4271-9f45-d39636a60ce7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:50.850749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b5b208-74f4-4271-9f45-d39636a60ce7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:50.911300 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 859/1707] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:13:50 2021] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:50.912566 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f755a3-1153-4cde-9a2d-da499862d013 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:50.929271 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f755a3-1153-4cde-9a2d-da499862d013 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:51.008737 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cdfe8-b994-4a01-b9a6-9fcc27409f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:51.009952 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cdfe8-b994-4a01-b9a6-9fcc27409f18 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:51.010406 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cdfe8-b994-4a01-b9a6-9fcc27409f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:51.010840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cdfe8-b994-4a01-b9a6-9fcc27409f18 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:51.011716 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cdfe8-b994-4a01-b9a6-9fcc27409f18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:51.013832 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98cdfe8-b994-4a01-b9a6-9fcc27409f18 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:51.052557 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 849/1708] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:13:50 2021] POST /identity/v3/users => generated 283 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:51.056029 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5b208-74f4-4271-9f45-d39636a60ce7 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:51.071678 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b5b208-74f4-4271-9f45-d39636a60ce7 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:51.079050 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c35fb-1d35-4a63-a117-882791c304f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:51.079764 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c35fb-1d35-4a63-a117-882791c304f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:51.080388 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c35fb-1d35-4a63-a117-882791c304f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:51.080650 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c35fb-1d35-4a63-a117-882791c304f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:51.081443 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c35fb-1d35-4a63-a117-882791c304f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:51.083254 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c35fb-1d35-4a63-a117-882791c304f0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:51.100552 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 860/1709] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:51 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:13:51.104767 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cdfe8-b994-4a01-b9a6-9fcc27409f18 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:51.128642 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cdfe8-b994-4a01-b9a6-9fcc27409f18 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:51.153541 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060d8d0a-928c-4818-b3a4-01fb748518fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:51.154328 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d8d0a-928c-4818-b3a4-01fb748518fe admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:51.154612 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d8d0a-928c-4818-b3a4-01fb748518fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:51.156620 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060d8d0a-928c-4818-b3a4-01fb748518fe admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:51.158193 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d8d0a-928c-4818-b3a4-01fb748518fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:51.160191 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060d8d0a-928c-4818-b3a4-01fb748518fe admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:51.175631 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 850/1710] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:51 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:51.180221 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c35fb-1d35-4a63-a117-882791c304f0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:51.192955 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c35fb-1d35-4a63-a117-882791c304f0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:51.204163 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b58b96-68ce-4893-815c-adaf2c1dc63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:51.205895 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b58b96-68ce-4893-815c-adaf2c1dc63c admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:51.206245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b58b96-68ce-4893-815c-adaf2c1dc63c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:51.206529 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b58b96-68ce-4893-815c-adaf2c1dc63c admin admin] PATH_INFO: `/v3/projects/c12ee33f8c7c4beeadb9229e60269c7b/users/b5ed567121fa4df19c8356e71cfe55c4/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:51.224772 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b58b96-68ce-4893-815c-adaf2c1dc63c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c12ee33f8c7c4beeadb9229e60269c7b, user_id=b5ed567121fa4df19c8356e71cfe55c4, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:51.228398 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b58b96-68ce-4893-815c-adaf2c1dc63c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:51.246559 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 861/1711] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:51 2021] PUT /identity/v3/projects/c12ee33f8c7c4beeadb9229e60269c7b/users/b5ed567121fa4df19c8356e71cfe55c4/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:13:51.259512 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe973d1d-6aaf-4092-9726-d4cfb4af1d59 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:51.260170 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe973d1d-6aaf-4092-9726-d4cfb4af1d59 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:51.260729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe973d1d-6aaf-4092-9726-d4cfb4af1d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:51.299050 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-fe973d1d-6aaf-4092-9726-d4cfb4af1d59 None None] MFA Rules not processed for user `b5ed567121fa4df19c8356e71cfe55c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:51.302089 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-fe973d1d-6aaf-4092-9726-d4cfb4af1d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:51.381037 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 851/1712] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:51 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:51.382242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b58b96-68ce-4893-815c-adaf2c1dc63c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:51.448638 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b58b96-68ce-4893-815c-adaf2c1dc63c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:51.455702 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b54302-6c2d-4c9a-9a82-f0ef3fc6dd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:51.456693 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b54302-6c2d-4c9a-9a82-f0ef3fc6dd9e admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:51.457131 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b54302-6c2d-4c9a-9a82-f0ef3fc6dd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:51.457554 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b54302-6c2d-4c9a-9a82-f0ef3fc6dd9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:51.458601 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b54302-6c2d-4c9a-9a82-f0ef3fc6dd9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:51.460830 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b54302-6c2d-4c9a-9a82-f0ef3fc6dd9e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:51.489941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 862/1713] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:13:51 2021] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:51.493786 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe973d1d-6aaf-4092-9726-d4cfb4af1d59 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:51.505370 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe973d1d-6aaf-4092-9726-d4cfb4af1d59 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:51.563968 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aac07-5b57-4632-9bd7-fcc1ea78c0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:51.564736 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aac07-5b57-4632-9bd7-fcc1ea78c0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:51.565017 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aac07-5b57-4632-9bd7-fcc1ea78c0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:51.565288 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1aac07-5b57-4632-9bd7-fcc1ea78c0d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:51.566031 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1aac07-5b57-4632-9bd7-fcc1ea78c0d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:51.567976 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1aac07-5b57-4632-9bd7-fcc1ea78c0d4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:51.589908 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 852/1714] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:13:51 2021] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:13:51.593943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b54302-6c2d-4c9a-9a82-f0ef3fc6dd9e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:51.604892 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b54302-6c2d-4c9a-9a82-f0ef3fc6dd9e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:51.609672 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb182f-81e9-4f23-9924-47c35f0a937b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:51.610422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb182f-81e9-4f23-9924-47c35f0a937b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:51.610659 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb182f-81e9-4f23-9924-47c35f0a937b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:51.611031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb182f-81e9-4f23-9924-47c35f0a937b admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:51.611706 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb182f-81e9-4f23-9924-47c35f0a937b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:51.613312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb182f-81e9-4f23-9924-47c35f0a937b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:51.624561 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 863/1715] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:51 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:13:51.628882 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aac07-5b57-4632-9bd7-fcc1ea78c0d4 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:51.646705 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1aac07-5b57-4632-9bd7-fcc1ea78c0d4 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:51.655052 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e73bf-1cbb-4c89-ad2a-7578e0154d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:51.655959 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e73bf-1cbb-4c89-ad2a-7578e0154d4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:51.656237 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e73bf-1cbb-4c89-ad2a-7578e0154d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:51.656514 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e73bf-1cbb-4c89-ad2a-7578e0154d4c admin admin] PATH_INFO: `/v3/projects/7366ac3e2e064df58166b0add32ec6e9/users/2c5bd8483a704d859ccde34f2ca68364/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:51.678194 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e73bf-1cbb-4c89-ad2a-7578e0154d4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7366ac3e2e064df58166b0add32ec6e9, user_id=2c5bd8483a704d859ccde34f2ca68364, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:51.680906 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540e73bf-1cbb-4c89-ad2a-7578e0154d4c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:51.695328 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 853/1716] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:51 2021] PUT /identity/v3/projects/7366ac3e2e064df58166b0add32ec6e9/users/2c5bd8483a704d859ccde34f2ca68364/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:51.699409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb182f-81e9-4f23-9924-47c35f0a937b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:51.710624 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb182f-81e9-4f23-9924-47c35f0a937b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:51.771177 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e41e77-9116-400f-8055-e72f3d71c657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:51.771867 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e41e77-9116-400f-8055-e72f3d71c657 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:51.772146 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e41e77-9116-400f-8055-e72f3d71c657 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:51.772424 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e41e77-9116-400f-8055-e72f3d71c657 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:51.773170 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e41e77-9116-400f-8055-e72f3d71c657 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:51.775306 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e41e77-9116-400f-8055-e72f3d71c657 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:51.791332 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 864/1717] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:13:51 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:13:51.792395 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e73bf-1cbb-4c89-ad2a-7578e0154d4c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:51.805596 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e73bf-1cbb-4c89-ad2a-7578e0154d4c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:51.814916 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0045f49-aeba-4871-9a59-77f1466cf64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:51.815837 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0045f49-aeba-4871-9a59-77f1466cf64b admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:51.816114 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0045f49-aeba-4871-9a59-77f1466cf64b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:51.816386 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0045f49-aeba-4871-9a59-77f1466cf64b admin admin] PATH_INFO: `/v3/projects/7366ac3e2e064df58166b0add32ec6e9/users/2c5bd8483a704d859ccde34f2ca68364/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:51.818640 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0045f49-aeba-4871-9a59-77f1466cf64b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7366ac3e2e064df58166b0add32ec6e9, user_id=2c5bd8483a704d859ccde34f2ca68364, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:51.818913 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b83edb-e8ed-42ed-89ee-65ee6a173128 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:51.819204 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b83edb-e8ed-42ed-89ee-65ee6a173128 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:51.819481 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b83edb-e8ed-42ed-89ee-65ee6a173128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:51.821289 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0045f49-aeba-4871-9a59-77f1466cf64b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:51.833072 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 854/1718] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:13:51 2021] PUT /identity/v3/projects/7366ac3e2e064df58166b0add32ec6e9/users/2c5bd8483a704d859ccde34f2ca68364/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:51.840471 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-04b83edb-e8ed-42ed-89ee-65ee6a173128 None None] MFA Rules not processed for user `16c47acc08ad42ec9f14cbad92726027`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:51.841580 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-04b83edb-e8ed-42ed-89ee-65ee6a173128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:51.843239 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2346f76-a373-40ae-9a16-444e1d027a32 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:51.843516 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2346f76-a373-40ae-9a16-444e1d027a32 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:51.843787 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2346f76-a373-40ae-9a16-444e1d027a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:51.873449 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-c2346f76-a373-40ae-9a16-444e1d027a32 None None] MFA Rules not processed for user `2c5bd8483a704d859ccde34f2ca68364`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:51.874707 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-c2346f76-a373-40ae-9a16-444e1d027a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:51.914221 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 865/1719] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:51 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:13:52.022888 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 855/1720] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:51 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:52.034694 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b83edb-e8ed-42ed-89ee-65ee6a173128 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:52.036648 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-04b83edb-e8ed-42ed-89ee-65ee6a173128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:52.133367 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b83edb-e8ed-42ed-89ee-65ee6a173128 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:52.139528 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01cd28-35ad-497f-bc1a-9aa2a0d0a080 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:52.140767 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01cd28-35ad-497f-bc1a-9aa2a0d0a080 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:52.141152 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01cd28-35ad-497f-bc1a-9aa2a0d0a080 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:52.141689 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01cd28-35ad-497f-bc1a-9aa2a0d0a080 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:52.155182 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01cd28-35ad-497f-bc1a-9aa2a0d0a080 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:52.156724 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01cd28-35ad-497f-bc1a-9aa2a0d0a080 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:52.182831 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 866/1721] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:52 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:52.304209 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2346f76-a373-40ae-9a16-444e1d027a32 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:52.319259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2346f76-a373-40ae-9a16-444e1d027a32 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:52.326186 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec45da-08a2-462a-aaae-24d5240383a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:52.327107 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec45da-08a2-462a-aaae-24d5240383a5 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:52.327786 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec45da-08a2-462a-aaae-24d5240383a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:52.328267 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec45da-08a2-462a-aaae-24d5240383a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:52.455774 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec45da-08a2-462a-aaae-24d5240383a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:52.458494 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec45da-08a2-462a-aaae-24d5240383a5 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:52.470615 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 856/1722] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:52 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:56.471893 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01cd28-35ad-497f-bc1a-9aa2a0d0a080 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:56.473484 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-3e01cd28-35ad-497f-bc1a-9aa2a0d0a080 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:56.596546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01cd28-35ad-497f-bc1a-9aa2a0d0a080 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:56.602971 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291b372-a079-46f0-ac31-683fb5b879d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:56.604658 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291b372-a079-46f0-ac31-683fb5b879d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:56.605108 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291b372-a079-46f0-ac31-683fb5b879d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:56.605529 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291b372-a079-46f0-ac31-683fb5b879d2 admin admin] PATH_INFO: `/v3/users/38e9e167c25b4498a02cd2576107d350` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:56.607124 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291b372-a079-46f0-ac31-683fb5b879d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e9e167c25b4498a02cd2576107d350)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:56.609689 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f291b372-a079-46f0-ac31-683fb5b879d2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:56.703632 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f291b372-a079-46f0-ac31-683fb5b879d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e9e167c25b4498a02cd2576107d350'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:56.704321 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f291b372-a079-46f0-ac31-683fb5b879d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e9e167c25b4498a02cd2576107d350'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:56.733315 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f291b372-a079-46f0-ac31-683fb5b879d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e9e167c25b4498a02cd2576107d350'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:56.734261 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f291b372-a079-46f0-ac31-683fb5b879d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e9e167c25b4498a02cd2576107d350'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:56.757357 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f291b372-a079-46f0-ac31-683fb5b879d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e9e167c25b4498a02cd2576107d350'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:56.785470 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 867/1723] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:13:56 2021] DELETE /identity/v3/users/38e9e167c25b4498a02cd2576107d350 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:56.790139 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b377f07-eeae-4d24-99df-e9f9ef13b286 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:56.790735 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b377f07-eeae-4d24-99df-e9f9ef13b286 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:56.790735 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b377f07-eeae-4d24-99df-e9f9ef13b286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:56.831381 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-1b377f07-eeae-4d24-99df-e9f9ef13b286 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:56.832796 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1b377f07-eeae-4d24-99df-e9f9ef13b286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:56.951532 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 857/1724] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:56.979067 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291b372-a079-46f0-ac31-683fb5b879d2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:56.980471 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f291b372-a079-46f0-ac31-683fb5b879d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:57.058828 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291b372-a079-46f0-ac31-683fb5b879d2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:57.067978 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc90836-e50e-4a10-91df-7961735ae87b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:57.069646 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc90836-e50e-4a10-91df-7961735ae87b service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:57.070647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc90836-e50e-4a10-91df-7961735ae87b service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:57.071124 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc90836-e50e-4a10-91df-7961735ae87b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:57.086748 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc90836-e50e-4a10-91df-7961735ae87b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:57.088490 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc90836-e50e-4a10-91df-7961735ae87b service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:57.100996 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 868/1725] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:57.809166 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b377f07-eeae-4d24-99df-e9f9ef13b286 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:57.812286 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1b377f07-eeae-4d24-99df-e9f9ef13b286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:57.825380 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b377f07-eeae-4d24-99df-e9f9ef13b286 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:57.834866 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25be27-8747-418c-912c-f954cdd14328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:57.835748 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25be27-8747-418c-912c-f954cdd14328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:57.836030 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25be27-8747-418c-912c-f954cdd14328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:57.836353 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25be27-8747-418c-912c-f954cdd14328 admin admin] PATH_INFO: `/v3/projects/36c08f19a18a4e69969a259803ad214f` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:57.837719 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25be27-8747-418c-912c-f954cdd14328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36c08f19a18a4e69969a259803ad214f)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:57.839598 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf25be27-8747-418c-912c-f954cdd14328 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:57.931259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bf25be27-8747-418c-912c-f954cdd14328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36c08f19a18a4e69969a259803ad214f', 'request_id': 'req-bf25be27-8747-418c-912c-f954cdd14328'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:57.940404 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bf25be27-8747-418c-912c-f954cdd14328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36c08f19a18a4e69969a259803ad214f', 'request_id': 'req-bf25be27-8747-418c-912c-f954cdd14328'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:57.954337 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bf25be27-8747-418c-912c-f954cdd14328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36c08f19a18a4e69969a259803ad214f', 'request_id': 'req-bf25be27-8747-418c-912c-f954cdd14328'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:57.994806 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bf25be27-8747-418c-912c-f954cdd14328 admin admin] The token cache is being invalidate because project 36c08f19a18a4e69969a259803ad214f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:13:57.995344 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bf25be27-8747-418c-912c-f954cdd14328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:57.996198 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bf25be27-8747-418c-912c-f954cdd14328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:57.998727 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 858/1726] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:13:57 2021] DELETE /identity/v3/projects/36c08f19a18a4e69969a259803ad214f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:58.002368 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc90836-e50e-4a10-91df-7961735ae87b service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:58.020798 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc90836-e50e-4a10-91df-7961735ae87b service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:58.108050 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed1ab2-1397-4f8f-a957-0e34227d835b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:58.109202 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed1ab2-1397-4f8f-a957-0e34227d835b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:58.110669 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed1ab2-1397-4f8f-a957-0e34227d835b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:58.111115 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed1ab2-1397-4f8f-a957-0e34227d835b admin admin] PATH_INFO: `/v3/users/301b05f90dbd482daa4d1702e24d2620` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:58.114456 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed1ab2-1397-4f8f-a957-0e34227d835b admin admin] RBAC: Authorizing `identity:delete_user(user_id=301b05f90dbd482daa4d1702e24d2620)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:58.120092 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed1ab2-1397-4f8f-a957-0e34227d835b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:58.221622 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-96ed1ab2-1397-4f8f-a957-0e34227d835b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '301b05f90dbd482daa4d1702e24d2620'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:58.221622 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-96ed1ab2-1397-4f8f-a957-0e34227d835b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '301b05f90dbd482daa4d1702e24d2620'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:58.251677 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-96ed1ab2-1397-4f8f-a957-0e34227d835b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '301b05f90dbd482daa4d1702e24d2620'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:58.253181 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-96ed1ab2-1397-4f8f-a957-0e34227d835b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '301b05f90dbd482daa4d1702e24d2620'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:58.274860 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-96ed1ab2-1397-4f8f-a957-0e34227d835b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '301b05f90dbd482daa4d1702e24d2620'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:58.356147 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 869/1727] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:13:58 2021] DELETE /identity/v3/users/301b05f90dbd482daa4d1702e24d2620 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:58.363183 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25be27-8747-418c-912c-f954cdd14328 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:58.365837 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-bf25be27-8747-418c-912c-f954cdd14328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:58.395666 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25be27-8747-418c-912c-f954cdd14328 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:58.409757 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed1ab2-1397-4f8f-a957-0e34227d835b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:58.412241 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-96ed1ab2-1397-4f8f-a957-0e34227d835b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:58.529653 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed1ab2-1397-4f8f-a957-0e34227d835b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:58.542549 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c53064-4820-42e9-ae0a-fd0bbd67146d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:58.543815 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c53064-4820-42e9-ae0a-fd0bbd67146d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:58.544623 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c53064-4820-42e9-ae0a-fd0bbd67146d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:58.546214 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c53064-4820-42e9-ae0a-fd0bbd67146d admin admin] PATH_INFO: `/v3/users/b5ed567121fa4df19c8356e71cfe55c4` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:58.549743 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c53064-4820-42e9-ae0a-fd0bbd67146d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5ed567121fa4df19c8356e71cfe55c4)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:58.553748 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c53064-4820-42e9-ae0a-fd0bbd67146d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:58.555960 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5bc7d4-8222-4ba3-ba18-a8b3230029c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:58.558162 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bc7d4-8222-4ba3-ba18-a8b3230029c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:58.560398 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bc7d4-8222-4ba3-ba18-a8b3230029c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:58.560896 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bc7d4-8222-4ba3-ba18-a8b3230029c5 admin admin] PATH_INFO: `/v3/users/07e5ee67b60c41ba9de20c92d6f56409` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:58.563634 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bc7d4-8222-4ba3-ba18-a8b3230029c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e5ee67b60c41ba9de20c92d6f56409)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:58.568714 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5bc7d4-8222-4ba3-ba18-a8b3230029c5 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:58.702471 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-01c53064-4820-42e9-ae0a-fd0bbd67146d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5ed567121fa4df19c8356e71cfe55c4'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:58.708072 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-01c53064-4820-42e9-ae0a-fd0bbd67146d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5ed567121fa4df19c8356e71cfe55c4'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:58.726514 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ec5bc7d4-8222-4ba3-ba18-a8b3230029c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e5ee67b60c41ba9de20c92d6f56409'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:58.738338 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ec5bc7d4-8222-4ba3-ba18-a8b3230029c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e5ee67b60c41ba9de20c92d6f56409'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:58.739293 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-01c53064-4820-42e9-ae0a-fd0bbd67146d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5ed567121fa4df19c8356e71cfe55c4'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:58.741543 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-01c53064-4820-42e9-ae0a-fd0bbd67146d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5ed567121fa4df19c8356e71cfe55c4'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:58.751248 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ec5bc7d4-8222-4ba3-ba18-a8b3230029c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e5ee67b60c41ba9de20c92d6f56409'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:58.753048 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ec5bc7d4-8222-4ba3-ba18-a8b3230029c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e5ee67b60c41ba9de20c92d6f56409'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:58.758445 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-01c53064-4820-42e9-ae0a-fd0bbd67146d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5ed567121fa4df19c8356e71cfe55c4'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:58.781235 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 870/1728] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:13:58 2021] DELETE /identity/v3/users/b5ed567121fa4df19c8356e71cfe55c4 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:13:58.781757 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ec5bc7d4-8222-4ba3-ba18-a8b3230029c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e5ee67b60c41ba9de20c92d6f56409'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:13:58.784087 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd907350-36c5-4e94-b76c-a3d81098578e None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:58.785056 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd907350-36c5-4e94-b76c-a3d81098578e None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:58.785874 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd907350-36c5-4e94-b76c-a3d81098578e None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:58.789890 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 871/1729] 10.222.0.41 () {54 vars in 921 bytes} [Fri Oct 29 16:13:58 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:13:58.792843 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 859/1730] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:13:58 2021] DELETE /identity/v3/users/07e5ee67b60c41ba9de20c92d6f56409 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:13:58.794461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fcc9b-9675-4ce2-bb4c-f304a6696bc5 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:58.795050 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fcc9b-9675-4ce2-bb4c-f304a6696bc5 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:58.795545 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fcc9b-9675-4ce2-bb4c-f304a6696bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:58.808426 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503b524-fcbb-4ef5-acb7-3bccd1a25791 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:58.810361 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503b524-fcbb-4ef5-acb7-3bccd1a25791 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:58.810853 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b503b524-fcbb-4ef5-acb7-3bccd1a25791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:58.825973 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-c36fcc9b-9675-4ce2-bb4c-f304a6696bc5 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:58.828342 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-c36fcc9b-9675-4ce2-bb4c-f304a6696bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:58.855125 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-b503b524-fcbb-4ef5-acb7-3bccd1a25791 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:58.856976 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b503b524-fcbb-4ef5-acb7-3bccd1a25791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:58.923138 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 860/1731] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:58.924722 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb88c04-a4ea-438a-916c-8d39584e8e26 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:58.925093 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb88c04-a4ea-438a-916c-8d39584e8e26 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:58.925424 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb88c04-a4ea-438a-916c-8d39584e8e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:58.943581 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 872/1732] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:13:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:58.944399 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503b524-fcbb-4ef5-acb7-3bccd1a25791 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:58.945782 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b503b524-fcbb-4ef5-acb7-3bccd1a25791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:58.949894 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-dfb88c04-a4ea-438a-916c-8d39584e8e26 None None] MFA Rules not processed for user `4f13d0e9f79a433c81759ecd819a6dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:13:58.951718 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-dfb88c04-a4ea-438a-916c-8d39584e8e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:59.013992 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b503b524-fcbb-4ef5-acb7-3bccd1a25791 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:59.021567 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459b96a-7bb4-4c73-a201-9cf829b52778 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:59.022961 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459b96a-7bb4-4c73-a201-9cf829b52778 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:59.023258 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459b96a-7bb4-4c73-a201-9cf829b52778 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:59.023531 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2459b96a-7bb4-4c73-a201-9cf829b52778 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:59.040364 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459b96a-7bb4-4c73-a201-9cf829b52778 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:59.042715 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2459b96a-7bb4-4c73-a201-9cf829b52778 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:59.056013 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 873/1733] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:59.056975 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459b96a-7bb4-4c73-a201-9cf829b52778 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:59.057755 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 861/1734] 10.222.0.41 () {58 vars in 1018 bytes} [Fri Oct 29 16:13:58 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:13:59.066666 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2459b96a-7bb4-4c73-a201-9cf829b52778 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:59.071116 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706d02c-d4e7-49b3-89d2-169abc63ad0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:59.072240 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706d02c-d4e7-49b3-89d2-169abc63ad0b service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:59.072772 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706d02c-d4e7-49b3-89d2-169abc63ad0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:59.073846 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706d02c-d4e7-49b3-89d2-169abc63ad0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:59.081828 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb88c04-a4ea-438a-916c-8d39584e8e26 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:13:59.085817 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706d02c-d4e7-49b3-89d2-169abc63ad0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:59.086881 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-dfb88c04-a4ea-438a-916c-8d39584e8e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:13:59.087967 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706d02c-d4e7-49b3-89d2-169abc63ad0b service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:59.104116 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 874/1735] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:13:59.115397 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb88c04-a4ea-438a-916c-8d39584e8e26 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:13:59.126861 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3735865-e939-437e-bd78-d9d73c2e7d59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:13:59.127191 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3735865-e939-437e-bd78-d9d73c2e7d59 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:13:59.127473 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3735865-e939-437e-bd78-d9d73c2e7d59 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:13:59.127814 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3735865-e939-437e-bd78-d9d73c2e7d59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:13:59.140978 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3735865-e939-437e-bd78-d9d73c2e7d59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:13:59.142551 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3735865-e939-437e-bd78-d9d73c2e7d59 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:13:59.166775 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 862/1736] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:13:59 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:14:00.044354 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706d02c-d4e7-49b3-89d2-169abc63ad0b service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:00.046213 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-8706d02c-d4e7-49b3-89d2-169abc63ad0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:00.063693 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706d02c-d4e7-49b3-89d2-169abc63ad0b service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:00.084194 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19178264-789c-4cac-931f-3432417bf7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:00.087330 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19178264-789c-4cac-931f-3432417bf7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:00.087625 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19178264-789c-4cac-931f-3432417bf7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:00.087909 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19178264-789c-4cac-931f-3432417bf7ff admin admin] PATH_INFO: `/v3/projects/34b86c9fa7f54631ad83a8d35e33819c` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:00.090483 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19178264-789c-4cac-931f-3432417bf7ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b86c9fa7f54631ad83a8d35e33819c)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:00.096415 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19178264-789c-4cac-931f-3432417bf7ff admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:00.169434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-19178264-789c-4cac-931f-3432417bf7ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b86c9fa7f54631ad83a8d35e33819c', 'request_id': 'req-19178264-789c-4cac-931f-3432417bf7ff'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.190358 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-19178264-789c-4cac-931f-3432417bf7ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b86c9fa7f54631ad83a8d35e33819c', 'request_id': 'req-19178264-789c-4cac-931f-3432417bf7ff'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.215856 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-19178264-789c-4cac-931f-3432417bf7ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b86c9fa7f54631ad83a8d35e33819c', 'request_id': 'req-19178264-789c-4cac-931f-3432417bf7ff'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.234641 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-19178264-789c-4cac-931f-3432417bf7ff admin admin] The token cache is being invalidate because project 34b86c9fa7f54631ad83a8d35e33819c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:00.234935 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-19178264-789c-4cac-931f-3432417bf7ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.237452 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-19178264-789c-4cac-931f-3432417bf7ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.239707 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3735865-e939-437e-bd78-d9d73c2e7d59 service nova] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:00.240960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 875/1737] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:00 2021] DELETE /identity/v3/projects/34b86c9fa7f54631ad83a8d35e33819c => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:00.246034 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e3735865-e939-437e-bd78-d9d73c2e7d59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:00.248594 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9289c-4755-44b2-b4f9-b82629ef4b6c None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:00.248594 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9289c-4755-44b2-b4f9-b82629ef4b6c None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:00.248594 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9289c-4755-44b2-b4f9-b82629ef4b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:00.277315 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-80a9289c-4755-44b2-b4f9-b82629ef4b6c None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:00.279953 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-80a9289c-4755-44b2-b4f9-b82629ef4b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:00.281801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3735865-e939-437e-bd78-d9d73c2e7d59 service nova] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:00.367513 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dee56-807a-4141-9933-42dada126b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:00.368658 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dee56-807a-4141-9933-42dada126b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:00.369005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dee56-807a-4141-9933-42dada126b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:00.369425 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dee56-807a-4141-9933-42dada126b7c admin admin] PATH_INFO: `/v3/projects/c12ee33f8c7c4beeadb9229e60269c7b` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:00.370910 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dee56-807a-4141-9933-42dada126b7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c12ee33f8c7c4beeadb9229e60269c7b)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:00.373462 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dee56-807a-4141-9933-42dada126b7c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:00.469004 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-264dee56-807a-4141-9933-42dada126b7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c12ee33f8c7c4beeadb9229e60269c7b', 'request_id': 'req-264dee56-807a-4141-9933-42dada126b7c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.478267 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 876/1738] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:00.480387 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9289c-4755-44b2-b4f9-b82629ef4b6c None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:00.497749 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-264dee56-807a-4141-9933-42dada126b7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c12ee33f8c7c4beeadb9229e60269c7b', 'request_id': 'req-264dee56-807a-4141-9933-42dada126b7c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.506034 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-80a9289c-4755-44b2-b4f9-b82629ef4b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:00.522070 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-264dee56-807a-4141-9933-42dada126b7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c12ee33f8c7c4beeadb9229e60269c7b', 'request_id': 'req-264dee56-807a-4141-9933-42dada126b7c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.540974 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-264dee56-807a-4141-9933-42dada126b7c admin admin] The token cache is being invalidate because project c12ee33f8c7c4beeadb9229e60269c7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:00.541304 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-264dee56-807a-4141-9933-42dada126b7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.541956 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-264dee56-807a-4141-9933-42dada126b7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.544336 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 863/1739] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:00 2021] DELETE /identity/v3/projects/c12ee33f8c7c4beeadb9229e60269c7b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:00.547847 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9289c-4755-44b2-b4f9-b82629ef4b6c None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:00.549609 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76074a5d-7c00-43b2-982d-63c21f85b94c None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:00.549900 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76074a5d-7c00-43b2-982d-63c21f85b94c None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:00.550200 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76074a5d-7c00-43b2-982d-63c21f85b94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:00.603979 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-76074a5d-7c00-43b2-982d-63c21f85b94c None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:00.606473 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-76074a5d-7c00-43b2-982d-63c21f85b94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:00.678614 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eb0f6-8246-475e-88e1-9f60cff4d47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:00.680025 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eb0f6-8246-475e-88e1-9f60cff4d47b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:00.681436 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eb0f6-8246-475e-88e1-9f60cff4d47b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:00.683427 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919eb0f6-8246-475e-88e1-9f60cff4d47b admin admin] PATH_INFO: `/v3/projects/4b4a2861cfa64a7d8eff54cda724c405` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:00.687012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919eb0f6-8246-475e-88e1-9f60cff4d47b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b4a2861cfa64a7d8eff54cda724c405)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:00.695091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 864/1740] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:00.698947 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919eb0f6-8246-475e-88e1-9f60cff4d47b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:00.699271 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76074a5d-7c00-43b2-982d-63c21f85b94c None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:00.700850 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-76074a5d-7c00-43b2-982d-63c21f85b94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:00.714276 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76074a5d-7c00-43b2-982d-63c21f85b94c None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:00.719361 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca419d6f-d296-421f-a99a-b0b8a969e261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:00.720233 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419d6f-d296-421f-a99a-b0b8a969e261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:00.720513 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419d6f-d296-421f-a99a-b0b8a969e261 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:00.720786 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419d6f-d296-421f-a99a-b0b8a969e261 admin admin] PATH_INFO: `/v3/users/2c5bd8483a704d859ccde34f2ca68364` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:00.722137 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca419d6f-d296-421f-a99a-b0b8a969e261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c5bd8483a704d859ccde34f2ca68364)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:00.724883 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca419d6f-d296-421f-a99a-b0b8a969e261 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:00.771229 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-919eb0f6-8246-475e-88e1-9f60cff4d47b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b4a2861cfa64a7d8eff54cda724c405', 'request_id': 'req-919eb0f6-8246-475e-88e1-9f60cff4d47b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.778375 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-919eb0f6-8246-475e-88e1-9f60cff4d47b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b4a2861cfa64a7d8eff54cda724c405', 'request_id': 'req-919eb0f6-8246-475e-88e1-9f60cff4d47b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.788721 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-919eb0f6-8246-475e-88e1-9f60cff4d47b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b4a2861cfa64a7d8eff54cda724c405', 'request_id': 'req-919eb0f6-8246-475e-88e1-9f60cff4d47b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.806253 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-919eb0f6-8246-475e-88e1-9f60cff4d47b admin admin] The token cache is being invalidate because project 4b4a2861cfa64a7d8eff54cda724c405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:00.806611 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-919eb0f6-8246-475e-88e1-9f60cff4d47b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.807568 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-919eb0f6-8246-475e-88e1-9f60cff4d47b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.809366 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 877/1741] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:00 2021] DELETE /identity/v3/projects/4b4a2861cfa64a7d8eff54cda724c405 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:00.810722 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eb0f6-8246-475e-88e1-9f60cff4d47b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:00.812245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-919eb0f6-8246-475e-88e1-9f60cff4d47b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:00.821077 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ca419d6f-d296-421f-a99a-b0b8a969e261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c5bd8483a704d859ccde34f2ca68364'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.834985 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ca419d6f-d296-421f-a99a-b0b8a969e261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c5bd8483a704d859ccde34f2ca68364'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.845352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ca419d6f-d296-421f-a99a-b0b8a969e261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c5bd8483a704d859ccde34f2ca68364'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.846188 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ca419d6f-d296-421f-a99a-b0b8a969e261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c5bd8483a704d859ccde34f2ca68364'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.864089 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ca419d6f-d296-421f-a99a-b0b8a969e261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c5bd8483a704d859ccde34f2ca68364'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:00.878215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 865/1742] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:00 2021] DELETE /identity/v3/users/2c5bd8483a704d859ccde34f2ca68364 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:00.880449 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f060b-41b8-4c76-8870-703d6500fb63 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:00.881342 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f060b-41b8-4c76-8870-703d6500fb63 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:00.881633 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f060b-41b8-4c76-8870-703d6500fb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:00.909856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-3d8f060b-41b8-4c76-8870-703d6500fb63 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:00.912009 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3d8f060b-41b8-4c76-8870-703d6500fb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:00.940303 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919eb0f6-8246-475e-88e1-9f60cff4d47b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:01.034212 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 866/1743] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:01.062079 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a1bb5-c3b2-4032-a77a-bd2c26a07974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:01.064422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a1bb5-c3b2-4032-a77a-bd2c26a07974 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:01.064951 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a1bb5-c3b2-4032-a77a-bd2c26a07974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:01.065444 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9a1bb5-c3b2-4032-a77a-bd2c26a07974 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:01.069355 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a1bb5-c3b2-4032-a77a-bd2c26a07974 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:14:01.070221 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a1bb5-c3b2-4032-a77a-bd2c26a07974 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:01.072582 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9a1bb5-c3b2-4032-a77a-bd2c26a07974 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:01.091686 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 878/1744] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:14:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:14:01.098558 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a1bb5-c3b2-4032-a77a-bd2c26a07974 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:01.102858 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde3cb5-5c0f-4b53-b459-6b22082d1583 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:01.104139 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde3cb5-5c0f-4b53-b459-6b22082d1583 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:01.111883 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cde3cb5-5c0f-4b53-b459-6b22082d1583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:01.113247 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-2f9a1bb5-c3b2-4032-a77a-bd2c26a07974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:01.136541 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9a1bb5-c3b2-4032-a77a-bd2c26a07974 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:01.140909 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-2cde3cb5-5c0f-4b53-b459-6b22082d1583 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:01.142169 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-2cde3cb5-5c0f-4b53-b459-6b22082d1583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:01.145187 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29a4f1-bcd1-4f06-89f2-23435bfcf721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:01.146258 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29a4f1-bcd1-4f06-89f2-23435bfcf721 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:01.146752 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29a4f1-bcd1-4f06-89f2-23435bfcf721 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:01.147257 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d29a4f1-bcd1-4f06-89f2-23435bfcf721 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:01.148179 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29a4f1-bcd1-4f06-89f2-23435bfcf721 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:01.152192 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d29a4f1-bcd1-4f06-89f2-23435bfcf721 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:01.152333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 867/1745] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:01.159077 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde3cb5-5c0f-4b53-b459-6b22082d1583 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:01.169236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cde3cb5-5c0f-4b53-b459-6b22082d1583 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:01.177362 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d5fdf-9a6b-4d10-a847-40bcb431dff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:01.178386 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d5fdf-9a6b-4d10-a847-40bcb431dff4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:01.179161 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d5fdf-9a6b-4d10-a847-40bcb431dff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:01.179161 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028d5fdf-9a6b-4d10-a847-40bcb431dff4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:01.180223 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d5fdf-9a6b-4d10-a847-40bcb431dff4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:14:01.180651 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d5fdf-9a6b-4d10-a847-40bcb431dff4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:01.191994 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 879/1746] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:01 2021] POST /identity/v3/projects => generated 381 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:01.195904 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028d5fdf-9a6b-4d10-a847-40bcb431dff4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:01.204202 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29a4f1-bcd1-4f06-89f2-23435bfcf721 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:01.234714 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 868/1747] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:14:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:14:01.235904 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d5fdf-9a6b-4d10-a847-40bcb431dff4 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:01.263367 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028d5fdf-9a6b-4d10-a847-40bcb431dff4 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:01.334816 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d29a4f1-bcd1-4f06-89f2-23435bfcf721 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:01.341349 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab82602-20de-44fb-8dbe-0c9e738fccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:01.342666 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab82602-20de-44fb-8dbe-0c9e738fccd7 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:01.343356 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab82602-20de-44fb-8dbe-0c9e738fccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:01.343829 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab82602-20de-44fb-8dbe-0c9e738fccd7 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:01.345173 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab82602-20de-44fb-8dbe-0c9e738fccd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:01.347947 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab82602-20de-44fb-8dbe-0c9e738fccd7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:01.359159 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cc4cd-40c7-4b99-a2f6-4a06eb25e805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:01.360489 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cc4cd-40c7-4b99-a2f6-4a06eb25e805 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:01.360789 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cc4cd-40c7-4b99-a2f6-4a06eb25e805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:01.361065 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97cc4cd-40c7-4b99-a2f6-4a06eb25e805 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:01.362172 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cc4cd-40c7-4b99-a2f6-4a06eb25e805 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:01.365875 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97cc4cd-40c7-4b99-a2f6-4a06eb25e805 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:01.395147 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 880/1748] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:01 2021] POST /identity/v3/users => generated 291 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:01.397971 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab82602-20de-44fb-8dbe-0c9e738fccd7 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:01.449880 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 869/1749] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:01 2021] POST /identity/v3/projects => generated 403 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:01.465456 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cc4cd-40c7-4b99-a2f6-4a06eb25e805 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:01.472576 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-f97cc4cd-40c7-4b99-a2f6-4a06eb25e805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:01.479235 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab82602-20de-44fb-8dbe-0c9e738fccd7 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:01.590783 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d531bd2-a679-4e20-bec9-b0e38333f999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:01.591854 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d531bd2-a679-4e20-bec9-b0e38333f999 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:01.592315 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d531bd2-a679-4e20-bec9-b0e38333f999 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:01.592832 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d531bd2-a679-4e20-bec9-b0e38333f999 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:01.593990 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d531bd2-a679-4e20-bec9-b0e38333f999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:01.598576 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d531bd2-a679-4e20-bec9-b0e38333f999 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:01.612419 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 881/1750] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:01 2021] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:01.614260 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d531bd2-a679-4e20-bec9-b0e38333f999 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:01.629532 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d531bd2-a679-4e20-bec9-b0e38333f999 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:01.640244 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b24f55-7524-4f5f-b1eb-7e835a8bcf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:01.641844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b24f55-7524-4f5f-b1eb-7e835a8bcf83 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:01.642610 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b24f55-7524-4f5f-b1eb-7e835a8bcf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:01.643080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b24f55-7524-4f5f-b1eb-7e835a8bcf83 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:01.644172 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b24f55-7524-4f5f-b1eb-7e835a8bcf83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:01.648301 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b24f55-7524-4f5f-b1eb-7e835a8bcf83 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:01.674163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97cc4cd-40c7-4b99-a2f6-4a06eb25e805 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:01.684032 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae3651-d799-4de5-9e54-1910c53a755d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:01.685505 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae3651-d799-4de5-9e54-1910c53a755d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:01.686019 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae3651-d799-4de5-9e54-1910c53a755d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:01.686503 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ae3651-d799-4de5-9e54-1910c53a755d admin admin] PATH_INFO: `/v3/projects/7366ac3e2e064df58166b0add32ec6e9` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:01.688695 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae3651-d799-4de5-9e54-1910c53a755d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7366ac3e2e064df58166b0add32ec6e9)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:01.693118 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ae3651-d799-4de5-9e54-1910c53a755d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:01.702207 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 882/1751] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:01 2021] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:01.704040 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b24f55-7524-4f5f-b1eb-7e835a8bcf83 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:01.726482 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b24f55-7524-4f5f-b1eb-7e835a8bcf83 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:01.741069 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e12ce6-5977-4e0d-87a9-7c9ab04b25de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:01.744700 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e12ce6-5977-4e0d-87a9-7c9ab04b25de admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:01.745278 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e12ce6-5977-4e0d-87a9-7c9ab04b25de admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:01.745757 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e12ce6-5977-4e0d-87a9-7c9ab04b25de admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:01.749361 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e12ce6-5977-4e0d-87a9-7c9ab04b25de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:01.752684 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e12ce6-5977-4e0d-87a9-7c9ab04b25de admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:01.771378 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 883/1752] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:01 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:01.772658 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e12ce6-5977-4e0d-87a9-7c9ab04b25de admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:01.783531 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e12ce6-5977-4e0d-87a9-7c9ab04b25de admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:01.805403 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d282d-3f3b-45d9-9170-4b0fe7432e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:01.806122 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d282d-3f3b-45d9-9170-4b0fe7432e3d admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:01.806408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d282d-3f3b-45d9-9170-4b0fe7432e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:01.806720 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052d282d-3f3b-45d9-9170-4b0fe7432e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:01.807423 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d282d-3f3b-45d9-9170-4b0fe7432e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:01.809053 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052d282d-3f3b-45d9-9170-4b0fe7432e3d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:01.831679 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d6ae3651-d799-4de5-9e54-1910c53a755d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7366ac3e2e064df58166b0add32ec6e9', 'request_id': 'req-d6ae3651-d799-4de5-9e54-1910c53a755d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:01.836805 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 884/1753] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:01 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:01.837994 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d282d-3f3b-45d9-9170-4b0fe7432e3d admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:01.850774 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d6ae3651-d799-4de5-9e54-1910c53a755d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7366ac3e2e064df58166b0add32ec6e9', 'request_id': 'req-d6ae3651-d799-4de5-9e54-1910c53a755d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:01.854557 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052d282d-3f3b-45d9-9170-4b0fe7432e3d admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:01.861783 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d6ae3651-d799-4de5-9e54-1910c53a755d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7366ac3e2e064df58166b0add32ec6e9', 'request_id': 'req-d6ae3651-d799-4de5-9e54-1910c53a755d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:01.883607 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d6ae3651-d799-4de5-9e54-1910c53a755d admin admin] The token cache is being invalidate because project 7366ac3e2e064df58166b0add32ec6e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:01.883915 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d6ae3651-d799-4de5-9e54-1910c53a755d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:01.885517 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d6ae3651-d799-4de5-9e54-1910c53a755d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:01.892488 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 870/1754] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:01 2021] DELETE /identity/v3/projects/7366ac3e2e064df58166b0add32ec6e9 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:01.893394 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae3651-d799-4de5-9e54-1910c53a755d admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:01.897222 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d6ae3651-d799-4de5-9e54-1910c53a755d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:01.940475 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11536af6-be61-4d3e-8c2d-b3e8f7777325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:01.941413 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11536af6-be61-4d3e-8c2d-b3e8f7777325 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:01.941693 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11536af6-be61-4d3e-8c2d-b3e8f7777325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:01.941991 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11536af6-be61-4d3e-8c2d-b3e8f7777325 admin admin] PATH_INFO: `/v3/projects/0a407f94e49e4aa98a8bc8915ffb1392/users/5b33170742de47d3a76b24962e7a0a35/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:01.959300 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11536af6-be61-4d3e-8c2d-b3e8f7777325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a407f94e49e4aa98a8bc8915ffb1392, user_id=5b33170742de47d3a76b24962e7a0a35, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:01.962019 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11536af6-be61-4d3e-8c2d-b3e8f7777325 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:01.979410 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 885/1755] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:01 2021] PUT /identity/v3/projects/0a407f94e49e4aa98a8bc8915ffb1392/users/5b33170742de47d3a76b24962e7a0a35/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:01.980794 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee9a86-a655-4441-9785-cca0cff96128 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:01.981085 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee9a86-a655-4441-9785-cca0cff96128 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:01.981367 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee9a86-a655-4441-9785-cca0cff96128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:01.992547 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ae3651-d799-4de5-9e54-1910c53a755d admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:02.001977 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-daee9a86-a655-4441-9785-cca0cff96128 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:02.003259 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-daee9a86-a655-4441-9785-cca0cff96128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:02.052740 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7021578-1a26-4363-b8b2-8534e6f7a134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:02.053443 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7021578-1a26-4363-b8b2-8534e6f7a134 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:02.053726 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7021578-1a26-4363-b8b2-8534e6f7a134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:02.054523 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7021578-1a26-4363-b8b2-8534e6f7a134 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:02.055692 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7021578-1a26-4363-b8b2-8534e6f7a134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:02.057302 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7021578-1a26-4363-b8b2-8534e6f7a134 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:02.070425 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 886/1756] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:02.071292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 871/1757] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:01 2021] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:02.076188 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb506dc-99c1-4007-a174-0a113d3cef6d None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:02.076477 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb506dc-99c1-4007-a174-0a113d3cef6d None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:02.076760 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb506dc-99c1-4007-a174-0a113d3cef6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:02.078322 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7021578-1a26-4363-b8b2-8534e6f7a134 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:02.091479 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7021578-1a26-4363-b8b2-8534e6f7a134 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:02.096927 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8084ec78-542c-42fb-8133-565d67e88874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:02.098892 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084ec78-542c-42fb-8133-565d67e88874 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:02.098892 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084ec78-542c-42fb-8133-565d67e88874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:02.099068 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8084ec78-542c-42fb-8133-565d67e88874 admin admin] PATH_INFO: `/v3/projects/658e12cca50341f0888a1a775ac5039e/users/01208554297147f28db29390e6fc3601/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:02.105559 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-beb506dc-99c1-4007-a174-0a113d3cef6d None None] MFA Rules not processed for user `5b33170742de47d3a76b24962e7a0a35`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:02.107104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-beb506dc-99c1-4007-a174-0a113d3cef6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:02.118150 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084ec78-542c-42fb-8133-565d67e88874 admin admin] RBAC: Authorizing `identity:create_grant(project_id=658e12cca50341f0888a1a775ac5039e, user_id=01208554297147f28db29390e6fc3601, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:02.121785 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8084ec78-542c-42fb-8133-565d67e88874 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:02.147556 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 872/1758] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:02 2021] PUT /identity/v3/projects/658e12cca50341f0888a1a775ac5039e/users/01208554297147f28db29390e6fc3601/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:02.149470 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71c047-a9df-4302-a007-ef4a4ad9d63e None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:02.149872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71c047-a9df-4302-a007-ef4a4ad9d63e None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:02.150724 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71c047-a9df-4302-a007-ef4a4ad9d63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:02.177259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-2a71c047-a9df-4302-a007-ef4a4ad9d63e None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:02.178810 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-2a71c047-a9df-4302-a007-ef4a4ad9d63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:02.225588 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 887/1759] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:02 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:02.230453 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcc2ad-34a1-43b3-9595-5f6b6ff640d4 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:02.230741 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcc2ad-34a1-43b3-9595-5f6b6ff640d4 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:02.231020 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fcc2ad-34a1-43b3-9595-5f6b6ff640d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:02.250781 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-69fcc2ad-34a1-43b3-9595-5f6b6ff640d4 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:02.252255 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-69fcc2ad-34a1-43b3-9595-5f6b6ff640d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:02.257494 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 873/1760] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:02.260524 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71c047-a9df-4302-a007-ef4a4ad9d63e None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:02.263089 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-2a71c047-a9df-4302-a007-ef4a4ad9d63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:02.272968 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 888/1761] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:02.273628 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcc2ad-34a1-43b3-9595-5f6b6ff640d4 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:02.282041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71c047-a9df-4302-a007-ef4a4ad9d63e None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:02.289306 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fcc2ad-34a1-43b3-9595-5f6b6ff640d4 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:02.300569 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc704f28-1898-4799-b1ee-1d728f2043f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:02.300779 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cec1c9-9185-45f3-aa4f-95ee4034992e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:02.303456 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc704f28-1898-4799-b1ee-1d728f2043f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:02.303865 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc704f28-1898-4799-b1ee-1d728f2043f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:02.304222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc704f28-1898-4799-b1ee-1d728f2043f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:02.304831 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cec1c9-9185-45f3-aa4f-95ee4034992e admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:02.305122 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cec1c9-9185-45f3-aa4f-95ee4034992e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:02.305233 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc704f28-1898-4799-b1ee-1d728f2043f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:14:02.305392 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cec1c9-9185-45f3-aa4f-95ee4034992e admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:02.305542 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc704f28-1898-4799-b1ee-1d728f2043f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:02.307313 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc704f28-1898-4799-b1ee-1d728f2043f5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:02.311338 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cec1c9-9185-45f3-aa4f-95ee4034992e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:02.315201 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cec1c9-9185-45f3-aa4f-95ee4034992e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:02.339856 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 889/1762] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:14:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:14:02.341988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc704f28-1898-4799-b1ee-1d728f2043f5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:02.345303 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-bc704f28-1898-4799-b1ee-1d728f2043f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:02.371485 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 874/1763] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:02 2021] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:02.372130 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cec1c9-9185-45f3-aa4f-95ee4034992e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:02.425775 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc704f28-1898-4799-b1ee-1d728f2043f5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:02.491868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4be879-ac24-4d17-8d63-9929547f8dc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:02.492489 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4be879-ac24-4d17-8d63-9929547f8dc4 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:02.492772 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4be879-ac24-4d17-8d63-9929547f8dc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:02.493046 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4be879-ac24-4d17-8d63-9929547f8dc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:02.540394 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cec1c9-9185-45f3-aa4f-95ee4034992e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:02.546938 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5531a5-d5ad-4856-ae32-08e7e55f5f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:02.547800 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5531a5-d5ad-4856-ae32-08e7e55f5f27 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:02.548062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5531a5-d5ad-4856-ae32-08e7e55f5f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:02.548438 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5531a5-d5ad-4856-ae32-08e7e55f5f27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:02.549247 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5531a5-d5ad-4856-ae32-08e7e55f5f27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:02.551404 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5531a5-d5ad-4856-ae32-08e7e55f5f27 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:02.585749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4be879-ac24-4d17-8d63-9929547f8dc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:02.589947 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4be879-ac24-4d17-8d63-9929547f8dc4 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:02.590485 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 875/1764] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:02 2021] POST /identity/v3/projects => generated 385 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:02.591761 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5531a5-d5ad-4856-ae32-08e7e55f5f27 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:02.615175 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 890/1765] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:02.618396 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4be879-ac24-4d17-8d63-9929547f8dc4 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:02.642201 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4be879-ac24-4d17-8d63-9929547f8dc4 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:02.682822 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5531a5-d5ad-4856-ae32-08e7e55f5f27 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:02.689413 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0352aaf-48ff-47ee-a979-df2ef9d6190a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:02.692573 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0352aaf-48ff-47ee-a979-df2ef9d6190a admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:02.692573 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0352aaf-48ff-47ee-a979-df2ef9d6190a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:02.692573 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0352aaf-48ff-47ee-a979-df2ef9d6190a admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:02.705458 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0352aaf-48ff-47ee-a979-df2ef9d6190a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:02.708554 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0352aaf-48ff-47ee-a979-df2ef9d6190a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:02.759080 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 876/1766] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:02 2021] POST /identity/v3/users => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:02.765400 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0352aaf-48ff-47ee-a979-df2ef9d6190a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:02.769195 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210ded5-9baa-4dc2-bca1-9c381526bc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:02.770004 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210ded5-9baa-4dc2-bca1-9c381526bc7d admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:02.770294 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210ded5-9baa-4dc2-bca1-9c381526bc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:02.770573 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e210ded5-9baa-4dc2-bca1-9c381526bc7d admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:02.771285 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210ded5-9baa-4dc2-bca1-9c381526bc7d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:02.777858 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e210ded5-9baa-4dc2-bca1-9c381526bc7d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:02.787881 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0352aaf-48ff-47ee-a979-df2ef9d6190a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:02.793528 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98d992-2bfe-4d55-a619-48e79b290fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:02.794410 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98d992-2bfe-4d55-a619-48e79b290fde admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:02.794690 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98d992-2bfe-4d55-a619-48e79b290fde admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:02.794962 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98d992-2bfe-4d55-a619-48e79b290fde admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:02.797478 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98d992-2bfe-4d55-a619-48e79b290fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:02.797808 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98d992-2bfe-4d55-a619-48e79b290fde admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:02.812781 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 877/1767] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:02 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:02.813729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98d992-2bfe-4d55-a619-48e79b290fde admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:02.827597 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 891/1768] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:02 2021] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:02.831362 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210ded5-9baa-4dc2-bca1-9c381526bc7d admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:02.831677 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98d992-2bfe-4d55-a619-48e79b290fde admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:02.840928 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9aeb5-da73-460d-a02c-107cfad68b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:02.841988 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9aeb5-da73-460d-a02c-107cfad68b4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:02.842336 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9aeb5-da73-460d-a02c-107cfad68b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:02.842711 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9aeb5-da73-460d-a02c-107cfad68b4b admin admin] PATH_INFO: `/v3/projects/2b5a5ed635274bd7b7a92b5b1a352f3b/users/800de5f43bba4b0fb4991cd0540fdb9b/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:02.847090 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e210ded5-9baa-4dc2-bca1-9c381526bc7d admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:02.862751 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd47305-46fb-4b10-8f78-4a7b1f44a3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:02.863982 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9aeb5-da73-460d-a02c-107cfad68b4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b5a5ed635274bd7b7a92b5b1a352f3b, user_id=800de5f43bba4b0fb4991cd0540fdb9b, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:02.864105 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd47305-46fb-4b10-8f78-4a7b1f44a3bd admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:02.864268 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd47305-46fb-4b10-8f78-4a7b1f44a3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:02.864541 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd47305-46fb-4b10-8f78-4a7b1f44a3bd admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:02.868022 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd47305-46fb-4b10-8f78-4a7b1f44a3bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:02.869874 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9aeb5-da73-460d-a02c-107cfad68b4b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:02.870088 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd47305-46fb-4b10-8f78-4a7b1f44a3bd admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:02.892660 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 878/1769] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:02 2021] PUT /identity/v3/projects/2b5a5ed635274bd7b7a92b5b1a352f3b/users/800de5f43bba4b0fb4991cd0540fdb9b/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:02.900154 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9aeb5-da73-460d-a02c-107cfad68b4b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:02.904115 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 892/1770] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:02 2021] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:02.909094 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd47305-46fb-4b10-8f78-4a7b1f44a3bd admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:02.932144 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd47305-46fb-4b10-8f78-4a7b1f44a3bd admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:03.043830 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9aeb5-da73-460d-a02c-107cfad68b4b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:03.055075 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101a927-2b8a-4b85-8d12-ecdf1b9a1d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:03.056608 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255eda4-536f-4b8f-8eac-66154f0015fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:03.057496 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255eda4-536f-4b8f-8eac-66154f0015fa admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:03.057686 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255eda4-536f-4b8f-8eac-66154f0015fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:03.057876 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f255eda4-536f-4b8f-8eac-66154f0015fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:03.058637 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255eda4-536f-4b8f-8eac-66154f0015fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:03.062916 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f255eda4-536f-4b8f-8eac-66154f0015fa admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:03.064565 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101a927-2b8a-4b85-8d12-ecdf1b9a1d77 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:03.064862 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101a927-2b8a-4b85-8d12-ecdf1b9a1d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:03.065149 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a101a927-2b8a-4b85-8d12-ecdf1b9a1d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:03.065913 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101a927-2b8a-4b85-8d12-ecdf1b9a1d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:03.076986 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a101a927-2b8a-4b85-8d12-ecdf1b9a1d77 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:03.085480 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 879/1771] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:02 2021] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:03.093875 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255eda4-536f-4b8f-8eac-66154f0015fa admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:03.098190 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 893/1772] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:02 2021] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:03.099263 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101a927-2b8a-4b85-8d12-ecdf1b9a1d77 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:03.110887 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a101a927-2b8a-4b85-8d12-ecdf1b9a1d77 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:03.116246 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f255eda4-536f-4b8f-8eac-66154f0015fa admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:03.116834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb81e4-949f-4b13-8aa5-c28c9990ef95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:03.118144 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb81e4-949f-4b13-8aa5-c28c9990ef95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:03.118505 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb81e4-949f-4b13-8aa5-c28c9990ef95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:03.118853 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb81e4-949f-4b13-8aa5-c28c9990ef95 admin admin] PATH_INFO: `/v3/projects/fd7156f781a947a1a86342d0a131e25f/users/766706b6602e44e093cf47928834f249/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:03.122643 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94584b25-92d6-438e-be34-f0a8309bcfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:03.123953 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94584b25-92d6-438e-be34-f0a8309bcfae admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:03.124394 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94584b25-92d6-438e-be34-f0a8309bcfae admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:03.124813 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94584b25-92d6-438e-be34-f0a8309bcfae admin admin] PATH_INFO: `/v3/projects/2b5a5ed635274bd7b7a92b5b1a352f3b/users/800de5f43bba4b0fb4991cd0540fdb9b/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:03.127162 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94584b25-92d6-438e-be34-f0a8309bcfae admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b5a5ed635274bd7b7a92b5b1a352f3b, user_id=800de5f43bba4b0fb4991cd0540fdb9b, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:03.131008 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94584b25-92d6-438e-be34-f0a8309bcfae admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:03.137361 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb81e4-949f-4b13-8aa5-c28c9990ef95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7156f781a947a1a86342d0a131e25f, user_id=766706b6602e44e093cf47928834f249, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:03.141251 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb81e4-949f-4b13-8aa5-c28c9990ef95 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:03.153960 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 880/1773] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:03 2021] PUT /identity/v3/projects/2b5a5ed635274bd7b7a92b5b1a352f3b/users/800de5f43bba4b0fb4991cd0540fdb9b/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:03.155350 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab63768-a35c-4f82-a463-85584bb84ffa None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:03.155655 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab63768-a35c-4f82-a463-85584bb84ffa None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:03.155963 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab63768-a35c-4f82-a463-85584bb84ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:03.165960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 894/1774] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:03 2021] PUT /identity/v3/projects/fd7156f781a947a1a86342d0a131e25f/users/766706b6602e44e093cf47928834f249/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:03.176931 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f9987-8693-4cc0-a164-4108131d2703 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:03.177945 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f9987-8693-4cc0-a164-4108131d2703 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:03.178232 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f9987-8693-4cc0-a164-4108131d2703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:03.216873 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-699f9987-8693-4cc0-a164-4108131d2703 None None] MFA Rules not processed for user `766706b6602e44e093cf47928834f249`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:03.218135 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-699f9987-8693-4cc0-a164-4108131d2703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:03.220437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-bab63768-a35c-4f82-a463-85584bb84ffa None None] MFA Rules not processed for user `800de5f43bba4b0fb4991cd0540fdb9b`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:03.224636 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-bab63768-a35c-4f82-a463-85584bb84ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:03.319704 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 881/1775] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:03 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:03.333439 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab63768-a35c-4f82-a463-85584bb84ffa None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:03.335032 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-bab63768-a35c-4f82-a463-85584bb84ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:03.349617 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 895/1776] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:03 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:03.355697 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f9987-8693-4cc0-a164-4108131d2703 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:03.357315 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-699f9987-8693-4cc0-a164-4108131d2703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:03.408783 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab63768-a35c-4f82-a463-85584bb84ffa None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:03.414962 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c51ee-48c9-48bf-814d-d1ffb8ec4376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:03.415627 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c51ee-48c9-48bf-814d-d1ffb8ec4376 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:03.416380 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c51ee-48c9-48bf-814d-d1ffb8ec4376 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:03.416682 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99c51ee-48c9-48bf-814d-d1ffb8ec4376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:03.428391 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c51ee-48c9-48bf-814d-d1ffb8ec4376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:03.430349 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99c51ee-48c9-48bf-814d-d1ffb8ec4376 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:03.444684 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f9987-8693-4cc0-a164-4108131d2703 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:03.449699 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d9942-8015-40e3-8d05-5fa9ad84912a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:03.450755 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d9942-8015-40e3-8d05-5fa9ad84912a service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:03.450969 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d9942-8015-40e3-8d05-5fa9ad84912a service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:03.451774 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d9942-8015-40e3-8d05-5fa9ad84912a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:03.464245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d9942-8015-40e3-8d05-5fa9ad84912a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:03.465827 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d9942-8015-40e3-8d05-5fa9ad84912a service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:03.468450 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 882/1777] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:03 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:14:03.489455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 896/1778] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:03 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:03.513146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c51ee-48c9-48bf-814d-d1ffb8ec4376 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:03.555063 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d9942-8015-40e3-8d05-5fa9ad84912a service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:03.564921 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d9942-8015-40e3-8d05-5fa9ad84912a service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:03.570399 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3613d3-3c94-49da-b78b-2ddf4503140f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:03.571201 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3613d3-3c94-49da-b78b-2ddf4503140f service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:03.571335 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3613d3-3c94-49da-b78b-2ddf4503140f service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:03.571783 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3613d3-3c94-49da-b78b-2ddf4503140f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:03.593590 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99c51ee-48c9-48bf-814d-d1ffb8ec4376 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:03.601095 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4628e387-79a3-424e-9a7e-e72b0325b275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:03.602369 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628e387-79a3-424e-9a7e-e72b0325b275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:03.602799 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628e387-79a3-424e-9a7e-e72b0325b275 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:03.603215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4628e387-79a3-424e-9a7e-e72b0325b275 admin admin] PATH_INFO: `/v3/users/766706b6602e44e093cf47928834f249` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:03.604754 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628e387-79a3-424e-9a7e-e72b0325b275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=766706b6602e44e093cf47928834f249)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:03.606897 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4628e387-79a3-424e-9a7e-e72b0325b275 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:03.659256 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3613d3-3c94-49da-b78b-2ddf4503140f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:03.661633 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3613d3-3c94-49da-b78b-2ddf4503140f service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:03.673780 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 897/1779] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:03 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:03.688937 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-4628e387-79a3-424e-9a7e-e72b0325b275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '766706b6602e44e093cf47928834f249'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:03.706265 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-4628e387-79a3-424e-9a7e-e72b0325b275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '766706b6602e44e093cf47928834f249'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:03.721817 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-4628e387-79a3-424e-9a7e-e72b0325b275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '766706b6602e44e093cf47928834f249'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:03.723336 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-4628e387-79a3-424e-9a7e-e72b0325b275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '766706b6602e44e093cf47928834f249'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:03.743350 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-4628e387-79a3-424e-9a7e-e72b0325b275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '766706b6602e44e093cf47928834f249'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:03.751155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 883/1780] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:03 2021] DELETE /identity/v3/users/766706b6602e44e093cf47928834f249 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:03.755843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f6818-e701-48ab-8e20-b1df95b123fe None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:03.756419 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f6818-e701-48ab-8e20-b1df95b123fe None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:03.756707 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f6818-e701-48ab-8e20-b1df95b123fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:03.786091 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-c07f6818-e701-48ab-8e20-b1df95b123fe None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:03.787803 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c07f6818-e701-48ab-8e20-b1df95b123fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:03.845350 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532936c7-ad9d-4adc-81c5-afe4e9bff4b6 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:03.845675 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532936c7-ad9d-4adc-81c5-afe4e9bff4b6 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:03.845957 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532936c7-ad9d-4adc-81c5-afe4e9bff4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:03.893990 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-532936c7-ad9d-4adc-81c5-afe4e9bff4b6 None None] MFA Rules not processed for user `01208554297147f28db29390e6fc3601`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:03.895938 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-532936c7-ad9d-4adc-81c5-afe4e9bff4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:03.963739 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 898/1781] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:03.975057 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f6818-e701-48ab-8e20-b1df95b123fe None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:03.976477 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c07f6818-e701-48ab-8e20-b1df95b123fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:03.989801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 884/1782] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:03 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:03.996177 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532936c7-ad9d-4adc-81c5-afe4e9bff4b6 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:03.997156 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-532936c7-ad9d-4adc-81c5-afe4e9bff4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:04.026755 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532936c7-ad9d-4adc-81c5-afe4e9bff4b6 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:04.037428 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a4652-3195-4bd4-8189-cec2d16c6746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:04.038168 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a4652-3195-4bd4-8189-cec2d16c6746 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:04.038460 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a4652-3195-4bd4-8189-cec2d16c6746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:04.041207 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3a4652-3195-4bd4-8189-cec2d16c6746 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:04.041910 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a4652-3195-4bd4-8189-cec2d16c6746 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:04.044650 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3a4652-3195-4bd4-8189-cec2d16c6746 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:04.096501 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f6818-e701-48ab-8e20-b1df95b123fe None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:04.106339 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 885/1783] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:03 2021] POST /identity/v3/projects => generated 403 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:04.107595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a4652-3195-4bd4-8189-cec2d16c6746 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:04.115627 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76daf05-82e0-4423-8968-17ef6bb42b31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:04.118635 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76daf05-82e0-4423-8968-17ef6bb42b31 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:04.118917 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76daf05-82e0-4423-8968-17ef6bb42b31 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:04.119190 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76daf05-82e0-4423-8968-17ef6bb42b31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:04.149068 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76daf05-82e0-4423-8968-17ef6bb42b31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:04.152089 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76daf05-82e0-4423-8968-17ef6bb42b31 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:04.174346 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 899/1784] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:03 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:04.175358 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76daf05-82e0-4423-8968-17ef6bb42b31 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:04.178903 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c76daf05-82e0-4423-8968-17ef6bb42b31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:04.203874 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76daf05-82e0-4423-8968-17ef6bb42b31 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:04.253966 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3a4652-3195-4bd4-8189-cec2d16c6746 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:04.276406 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5c157-a7a8-4648-8e30-6380553f5ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:04.277153 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5c157-a7a8-4648-8e30-6380553f5ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:04.277442 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5c157-a7a8-4648-8e30-6380553f5ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:04.277734 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea5c157-a7a8-4648-8e30-6380553f5ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:04.279149 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5c157-a7a8-4648-8e30-6380553f5ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:04.290083 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea5c157-a7a8-4648-8e30-6380553f5ad7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:04.337171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6915e9-09fd-43a7-b543-d28597a4ed05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:04.338525 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6915e9-09fd-43a7-b543-d28597a4ed05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:04.339819 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 886/1785] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:04 2021] POST /identity/v3/users => generated 308 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:04.340768 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6915e9-09fd-43a7-b543-d28597a4ed05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:04.341992 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6915e9-09fd-43a7-b543-d28597a4ed05 admin admin] PATH_INFO: `/v3/users/5b33170742de47d3a76b24962e7a0a35` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:04.344358 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5c157-a7a8-4648-8e30-6380553f5ad7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:04.345744 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6915e9-09fd-43a7-b543-d28597a4ed05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b33170742de47d3a76b24962e7a0a35)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:04.352184 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6915e9-09fd-43a7-b543-d28597a4ed05 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:04.373034 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea5c157-a7a8-4648-8e30-6380553f5ad7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:04.385526 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993940de-a5de-4e00-8abf-637a82b0de75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:04.395991 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993940de-a5de-4e00-8abf-637a82b0de75 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:04.395991 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993940de-a5de-4e00-8abf-637a82b0de75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:04.395991 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993940de-a5de-4e00-8abf-637a82b0de75 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:04.395991 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993940de-a5de-4e00-8abf-637a82b0de75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:04.396789 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993940de-a5de-4e00-8abf-637a82b0de75 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:04.420967 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 887/1786] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:04 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:04.426299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993940de-a5de-4e00-8abf-637a82b0de75 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:04.442341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993940de-a5de-4e00-8abf-637a82b0de75 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:04.442734 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-2b6915e9-09fd-43a7-b543-d28597a4ed05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b33170742de47d3a76b24962e7a0a35'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:04.443707 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-2b6915e9-09fd-43a7-b543-d28597a4ed05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b33170742de47d3a76b24962e7a0a35'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:04.448497 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4435420-7006-499e-830d-4497ac2f703c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:04.449392 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4435420-7006-499e-830d-4497ac2f703c admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:04.449715 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4435420-7006-499e-830d-4497ac2f703c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:04.450062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4435420-7006-499e-830d-4497ac2f703c admin admin] PATH_INFO: `/v3/projects/b20689c274894889ad90408954697168/users/fe8212aa75aa468ca93873c68a43998a/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:04.470636 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-2b6915e9-09fd-43a7-b543-d28597a4ed05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b33170742de47d3a76b24962e7a0a35'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:04.471563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-2b6915e9-09fd-43a7-b543-d28597a4ed05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b33170742de47d3a76b24962e7a0a35'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:04.474679 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4435420-7006-499e-830d-4497ac2f703c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b20689c274894889ad90408954697168, user_id=fe8212aa75aa468ca93873c68a43998a, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:04.476880 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4435420-7006-499e-830d-4497ac2f703c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:04.490379 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-2b6915e9-09fd-43a7-b543-d28597a4ed05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b33170742de47d3a76b24962e7a0a35'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:04.509462 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 888/1787] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:04 2021] PUT /identity/v3/projects/b20689c274894889ad90408954697168/users/fe8212aa75aa468ca93873c68a43998a/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:04.511958 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4435420-7006-499e-830d-4497ac2f703c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:04.514074 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d4435420-7006-499e-830d-4497ac2f703c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:04.521616 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 900/1788] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:04 2021] DELETE /identity/v3/users/5b33170742de47d3a76b24962e7a0a35 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:04.523403 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab6fdc-1692-47ac-b573-b9a1df481127 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:04.528137 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab6fdc-1692-47ac-b573-b9a1df481127 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:04.529386 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab6fdc-1692-47ac-b573-b9a1df481127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:04.590582 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-7fab6fdc-1692-47ac-b573-b9a1df481127 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:04.591937 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-7fab6fdc-1692-47ac-b573-b9a1df481127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:04.608441 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4435420-7006-499e-830d-4497ac2f703c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:04.707815 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 901/1789] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:04.719040 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab6fdc-1692-47ac-b573-b9a1df481127 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:04.720549 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-7fab6fdc-1692-47ac-b573-b9a1df481127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:04.735139 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a891f-8f1d-4666-a6f9-f8481d483660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:04.735839 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a891f-8f1d-4666-a6f9-f8481d483660 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:04.736125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a891f-8f1d-4666-a6f9-f8481d483660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:04.736405 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a891f-8f1d-4666-a6f9-f8481d483660 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:04.737163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a891f-8f1d-4666-a6f9-f8481d483660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:04.741519 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5a891f-8f1d-4666-a6f9-f8481d483660 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:04.768890 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 889/1790] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:04 2021] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:04.771074 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a891f-8f1d-4666-a6f9-f8481d483660 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:04.800066 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a891f-8f1d-4666-a6f9-f8481d483660 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:04.818368 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55330ba7-2cb4-42ef-8922-e3e0b0ec010e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:04.822432 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55330ba7-2cb4-42ef-8922-e3e0b0ec010e admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:04.822726 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55330ba7-2cb4-42ef-8922-e3e0b0ec010e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:04.823007 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55330ba7-2cb4-42ef-8922-e3e0b0ec010e admin admin] PATH_INFO: `/v3/projects/b20689c274894889ad90408954697168/users/fe8212aa75aa468ca93873c68a43998a/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:04.828242 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55330ba7-2cb4-42ef-8922-e3e0b0ec010e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b20689c274894889ad90408954697168, user_id=fe8212aa75aa468ca93873c68a43998a, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:04.831947 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab6fdc-1692-47ac-b573-b9a1df481127 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:04.835871 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55330ba7-2cb4-42ef-8922-e3e0b0ec010e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:04.841351 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0cc3b-7f83-49ed-94dc-1874c70aaa6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:04.844113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0cc3b-7f83-49ed-94dc-1874c70aaa6f service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:04.844113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0cc3b-7f83-49ed-94dc-1874c70aaa6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:04.844113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0cc3b-7f83-49ed-94dc-1874c70aaa6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:04.862465 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 890/1791] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:04 2021] PUT /identity/v3/projects/b20689c274894889ad90408954697168/users/fe8212aa75aa468ca93873c68a43998a/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:04.876263 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0cc3b-7f83-49ed-94dc-1874c70aaa6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:04.876439 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55330ba7-2cb4-42ef-8922-e3e0b0ec010e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:04.882172 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0cc3b-7f83-49ed-94dc-1874c70aaa6f service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:04.885358 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-55330ba7-2cb4-42ef-8922-e3e0b0ec010e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:04.906619 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 902/1792] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:05.020277 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55330ba7-2cb4-42ef-8922-e3e0b0ec010e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:05.027058 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ebf7a-98a3-4be2-bba5-2fc852942a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:05.028101 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ebf7a-98a3-4be2-bba5-2fc852942a47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:05.028441 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ebf7a-98a3-4be2-bba5-2fc852942a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:05.028771 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ebf7a-98a3-4be2-bba5-2fc852942a47 admin admin] PATH_INFO: `/v3/projects/fd7156f781a947a1a86342d0a131e25f` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:05.030264 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ebf7a-98a3-4be2-bba5-2fc852942a47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd7156f781a947a1a86342d0a131e25f)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:05.032307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ebf7a-98a3-4be2-bba5-2fc852942a47 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:05.085432 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-7a3ebf7a-98a3-4be2-bba5-2fc852942a47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd7156f781a947a1a86342d0a131e25f', 'request_id': 'req-7a3ebf7a-98a3-4be2-bba5-2fc852942a47'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:05.091975 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-7a3ebf7a-98a3-4be2-bba5-2fc852942a47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd7156f781a947a1a86342d0a131e25f', 'request_id': 'req-7a3ebf7a-98a3-4be2-bba5-2fc852942a47'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:05.100698 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-7a3ebf7a-98a3-4be2-bba5-2fc852942a47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd7156f781a947a1a86342d0a131e25f', 'request_id': 'req-7a3ebf7a-98a3-4be2-bba5-2fc852942a47'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:05.118810 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-7a3ebf7a-98a3-4be2-bba5-2fc852942a47 admin admin] The token cache is being invalidate because project fd7156f781a947a1a86342d0a131e25f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:05.119361 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-7a3ebf7a-98a3-4be2-bba5-2fc852942a47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:05.120298 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-7a3ebf7a-98a3-4be2-bba5-2fc852942a47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:05.122749 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 891/1793] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:04 2021] DELETE /identity/v3/projects/fd7156f781a947a1a86342d0a131e25f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:05.129523 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1834610-729b-45b5-a7fe-165bcd43c3b7 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:05.130408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1834610-729b-45b5-a7fe-165bcd43c3b7 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:05.130951 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1834610-729b-45b5-a7fe-165bcd43c3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:05.154985 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-b1834610-729b-45b5-a7fe-165bcd43c3b7 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:05.156517 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b1834610-729b-45b5-a7fe-165bcd43c3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:05.238615 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 903/1794] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:05.253358 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58720826-5db6-434b-8af3-b3d33caa6187 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:05.253691 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58720826-5db6-434b-8af3-b3d33caa6187 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:05.255472 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58720826-5db6-434b-8af3-b3d33caa6187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:05.297459 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-58720826-5db6-434b-8af3-b3d33caa6187 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:05.299007 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-58720826-5db6-434b-8af3-b3d33caa6187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:05.313326 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 892/1795] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:05.315277 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1834610-729b-45b5-a7fe-165bcd43c3b7 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:05.332376 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1834610-729b-45b5-a7fe-165bcd43c3b7 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:05.339419 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e2cfc-ad0f-44f1-b0b5-3d98214a24e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:05.340332 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e2cfc-ad0f-44f1-b0b5-3d98214a24e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:05.341206 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e2cfc-ad0f-44f1-b0b5-3d98214a24e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:05.341644 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e2cfc-ad0f-44f1-b0b5-3d98214a24e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:05.342785 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e2cfc-ad0f-44f1-b0b5-3d98214a24e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:14:05.343151 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e2cfc-ad0f-44f1-b0b5-3d98214a24e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:05.345200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e2cfc-ad0f-44f1-b0b5-3d98214a24e9 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:05.362212 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 904/1796] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:14:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:14:05.362798 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58720826-5db6-434b-8af3-b3d33caa6187 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:05.373233 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58720826-5db6-434b-8af3-b3d33caa6187 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:05.378140 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37a79f-0238-4700-9ea8-60033f12c362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:05.379399 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37a79f-0238-4700-9ea8-60033f12c362 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:05.379688 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37a79f-0238-4700-9ea8-60033f12c362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:05.380101 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37a79f-0238-4700-9ea8-60033f12c362 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:05.380828 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37a79f-0238-4700-9ea8-60033f12c362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:05.399786 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37a79f-0238-4700-9ea8-60033f12c362 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:05.454524 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 893/1797] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:05 2021] POST /identity/v3/projects => generated 377 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:14:05.456651 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e2cfc-ad0f-44f1-b0b5-3d98214a24e9 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:05.480333 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e2cfc-ad0f-44f1-b0b5-3d98214a24e9 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:05.562674 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc0005-26bc-4f31-87db-1a2ab5587da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:05.563624 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc0005-26bc-4f31-87db-1a2ab5587da0 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:05.563936 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc0005-26bc-4f31-87db-1a2ab5587da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:05.564218 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc0005-26bc-4f31-87db-1a2ab5587da0 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:05.567434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc0005-26bc-4f31-87db-1a2ab5587da0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:05.569733 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc0005-26bc-4f31-87db-1a2ab5587da0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:05.601290 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 905/1798] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:05 2021] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:05.611041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37a79f-0238-4700-9ea8-60033f12c362 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:05.630539 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37a79f-0238-4700-9ea8-60033f12c362 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:05.636879 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac60325-cff9-441a-b296-32f36d627b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:05.637611 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac60325-cff9-441a-b296-32f36d627b9c admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:05.637818 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac60325-cff9-441a-b296-32f36d627b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:05.638129 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac60325-cff9-441a-b296-32f36d627b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:05.638893 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac60325-cff9-441a-b296-32f36d627b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:05.651553 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc0005-26bc-4f31-87db-1a2ab5587da0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:05.653860 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b1dc0005-26bc-4f31-87db-1a2ab5587da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:05.657219 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac60325-cff9-441a-b296-32f36d627b9c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:05.668432 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc0005-26bc-4f31-87db-1a2ab5587da0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:05.673760 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca931e52-cd45-4449-ac5e-47e96313b47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:05.675148 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca931e52-cd45-4449-ac5e-47e96313b47e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:05.675434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca931e52-cd45-4449-ac5e-47e96313b47e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:05.676562 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca931e52-cd45-4449-ac5e-47e96313b47e admin admin] PATH_INFO: `/v3/projects/0a407f94e49e4aa98a8bc8915ffb1392` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:05.677896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca931e52-cd45-4449-ac5e-47e96313b47e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a407f94e49e4aa98a8bc8915ffb1392)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:05.680443 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca931e52-cd45-4449-ac5e-47e96313b47e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:05.682462 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 894/1799] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:05 2021] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:05.686366 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac60325-cff9-441a-b296-32f36d627b9c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:05.706859 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac60325-cff9-441a-b296-32f36d627b9c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:05.717064 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea2a4c-bee8-40c7-b5e5-a2b7145dd5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:05.717969 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea2a4c-bee8-40c7-b5e5-a2b7145dd5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:05.718098 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea2a4c-bee8-40c7-b5e5-a2b7145dd5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:05.718331 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbea2a4c-bee8-40c7-b5e5-a2b7145dd5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:05.719137 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea2a4c-bee8-40c7-b5e5-a2b7145dd5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:05.720772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbea2a4c-bee8-40c7-b5e5-a2b7145dd5d3 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:05.735832 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 895/1800] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:05 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:14:05.737813 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea2a4c-bee8-40c7-b5e5-a2b7145dd5d3 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:05.754105 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbea2a4c-bee8-40c7-b5e5-a2b7145dd5d3 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:05.768113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ca931e52-cd45-4449-ac5e-47e96313b47e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a407f94e49e4aa98a8bc8915ffb1392', 'request_id': 'req-ca931e52-cd45-4449-ac5e-47e96313b47e'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:05.780178 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ca931e52-cd45-4449-ac5e-47e96313b47e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a407f94e49e4aa98a8bc8915ffb1392', 'request_id': 'req-ca931e52-cd45-4449-ac5e-47e96313b47e'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:05.789242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ca931e52-cd45-4449-ac5e-47e96313b47e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a407f94e49e4aa98a8bc8915ffb1392', 'request_id': 'req-ca931e52-cd45-4449-ac5e-47e96313b47e'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:05.803754 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ca931e52-cd45-4449-ac5e-47e96313b47e admin admin] The token cache is being invalidate because project 0a407f94e49e4aa98a8bc8915ffb1392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:05.804196 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ca931e52-cd45-4449-ac5e-47e96313b47e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:05.804930 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ca931e52-cd45-4449-ac5e-47e96313b47e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:05.809902 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 906/1801] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:05 2021] DELETE /identity/v3/projects/0a407f94e49e4aa98a8bc8915ffb1392 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:05.810763 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca931e52-cd45-4449-ac5e-47e96313b47e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:05.812064 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ca931e52-cd45-4449-ac5e-47e96313b47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:05.820737 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08541649-b9e2-4f04-b92c-e144f4167237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:05.821631 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08541649-b9e2-4f04-b92c-e144f4167237 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:05.821935 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08541649-b9e2-4f04-b92c-e144f4167237 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:05.822222 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08541649-b9e2-4f04-b92c-e144f4167237 admin admin] PATH_INFO: `/v3/projects/0fa5746ea18e41c6a8da2ad9cdaa8752/users/61e9e5f0e85a443bbc6b4f43c27e79a8/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:05.840030 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08541649-b9e2-4f04-b92c-e144f4167237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fa5746ea18e41c6a8da2ad9cdaa8752, user_id=61e9e5f0e85a443bbc6b4f43c27e79a8, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:05.842938 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08541649-b9e2-4f04-b92c-e144f4167237 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:05.857167 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 896/1802] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:05 2021] PUT /identity/v3/projects/0fa5746ea18e41c6a8da2ad9cdaa8752/users/61e9e5f0e85a443bbc6b4f43c27e79a8/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:05.868549 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b16965-3c4b-40a6-a51c-c7329f4c777f None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:05.868845 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b16965-3c4b-40a6-a51c-c7329f4c777f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:05.869271 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b16965-3c4b-40a6-a51c-c7329f4c777f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:05.899493 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-35b16965-3c4b-40a6-a51c-c7329f4c777f None None] MFA Rules not processed for user `61e9e5f0e85a443bbc6b4f43c27e79a8`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:05.900890 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca931e52-cd45-4449-ac5e-47e96313b47e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:05.901406 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-35b16965-3c4b-40a6-a51c-c7329f4c777f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:05.975369 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae83501-a99d-467f-8ae1-45f05f26eb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:05.976463 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae83501-a99d-467f-8ae1-45f05f26eb5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:05.976934 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae83501-a99d-467f-8ae1-45f05f26eb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:05.977695 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae83501-a99d-467f-8ae1-45f05f26eb5a admin admin] PATH_INFO: `/v3/users/800de5f43bba4b0fb4991cd0540fdb9b` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:05.978727 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae83501-a99d-467f-8ae1-45f05f26eb5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=800de5f43bba4b0fb4991cd0540fdb9b)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:05.983802 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae83501-a99d-467f-8ae1-45f05f26eb5a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:05.984060 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 897/1803] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:05 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:06.005301 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b16965-3c4b-40a6-a51c-c7329f4c777f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:06.012157 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-35b16965-3c4b-40a6-a51c-c7329f4c777f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:06.063317 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4ae83501-a99d-467f-8ae1-45f05f26eb5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800de5f43bba4b0fb4991cd0540fdb9b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:06.064179 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4ae83501-a99d-467f-8ae1-45f05f26eb5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800de5f43bba4b0fb4991cd0540fdb9b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:06.094752 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4ae83501-a99d-467f-8ae1-45f05f26eb5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800de5f43bba4b0fb4991cd0540fdb9b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:06.097085 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4ae83501-a99d-467f-8ae1-45f05f26eb5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800de5f43bba4b0fb4991cd0540fdb9b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:06.116196 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4ae83501-a99d-467f-8ae1-45f05f26eb5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800de5f43bba4b0fb4991cd0540fdb9b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:06.137703 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 907/1804] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:05 2021] DELETE /identity/v3/users/800de5f43bba4b0fb4991cd0540fdb9b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:06.137703 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c9f52-a6bc-479c-87e1-da10edd06790 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:06.137703 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c9f52-a6bc-479c-87e1-da10edd06790 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:06.137703 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361c9f52-a6bc-479c-87e1-da10edd06790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:06.188568 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b16965-3c4b-40a6-a51c-c7329f4c777f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:06.212038 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-361c9f52-a6bc-479c-87e1-da10edd06790 None None] MFA Rules not processed for user `fe8212aa75aa468ca93873c68a43998a`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:06.215663 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-361c9f52-a6bc-479c-87e1-da10edd06790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:06.260538 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd284056-05e4-4863-acde-764346d0dcbb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27a0c9ae2bf40caa92e9dbceff8d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:06.261346 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd284056-05e4-4863-acde-764346d0dcbb service glance] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:06.261903 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd284056-05e4-4863-acde-764346d0dcbb service glance] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:06.262203 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd284056-05e4-4863-acde-764346d0dcbb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:06.264832 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-dd284056-05e4-4863-acde-764346d0dcbb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:06.405592 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 908/1805] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:06 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:06.441884 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd284056-05e4-4863-acde-764346d0dcbb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:06.443890 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd284056-05e4-4863-acde-764346d0dcbb service glance] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:06.461155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 898/1806] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:06 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:06.614718 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c9f52-a6bc-479c-87e1-da10edd06790 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:06.616434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-361c9f52-a6bc-479c-87e1-da10edd06790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:06.825031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361c9f52-a6bc-479c-87e1-da10edd06790 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:06.841595 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802dcc26-4cd6-4630-b82d-e43bac591a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:06.842641 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dcc26-4cd6-4630-b82d-e43bac591a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:06.843030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dcc26-4cd6-4630-b82d-e43bac591a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:06.843408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802dcc26-4cd6-4630-b82d-e43bac591a30 admin admin] PATH_INFO: `/v3/projects/2b5a5ed635274bd7b7a92b5b1a352f3b` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:06.850110 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802dcc26-4cd6-4630-b82d-e43bac591a30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b5a5ed635274bd7b7a92b5b1a352f3b)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:06.852246 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802dcc26-4cd6-4630-b82d-e43bac591a30 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:06.932270 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-802dcc26-4cd6-4630-b82d-e43bac591a30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b5a5ed635274bd7b7a92b5b1a352f3b', 'request_id': 'req-802dcc26-4cd6-4630-b82d-e43bac591a30'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:06.940142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-802dcc26-4cd6-4630-b82d-e43bac591a30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b5a5ed635274bd7b7a92b5b1a352f3b', 'request_id': 'req-802dcc26-4cd6-4630-b82d-e43bac591a30'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:06.953791 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-802dcc26-4cd6-4630-b82d-e43bac591a30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b5a5ed635274bd7b7a92b5b1a352f3b', 'request_id': 'req-802dcc26-4cd6-4630-b82d-e43bac591a30'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:06.977288 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-802dcc26-4cd6-4630-b82d-e43bac591a30 admin admin] The token cache is being invalidate because project 2b5a5ed635274bd7b7a92b5b1a352f3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:06.978417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-802dcc26-4cd6-4630-b82d-e43bac591a30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:06.979149 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-802dcc26-4cd6-4630-b82d-e43bac591a30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:06.983253 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 909/1807] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:06 2021] DELETE /identity/v3/projects/2b5a5ed635274bd7b7a92b5b1a352f3b => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:06.990493 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329633cf-040a-44ba-a445-fc319f96daa8 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:06.990939 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329633cf-040a-44ba-a445-fc319f96daa8 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:06.991224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329633cf-040a-44ba-a445-fc319f96daa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:07.013933 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-329633cf-040a-44ba-a445-fc319f96daa8 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:07.015723 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-329633cf-040a-44ba-a445-fc319f96daa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:07.164318 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 899/1808] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:07.173262 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aa273-b6ee-4533-9a54-8a1b123676d9 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:07.173822 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aa273-b6ee-4533-9a54-8a1b123676d9 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:07.173900 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aa273-b6ee-4533-9a54-8a1b123676d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:07.197869 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-096aa273-b6ee-4533-9a54-8a1b123676d9 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:07.199218 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-096aa273-b6ee-4533-9a54-8a1b123676d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:07.211000 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 910/1809] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:07.215932 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329633cf-040a-44ba-a445-fc319f96daa8 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:07.232183 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329633cf-040a-44ba-a445-fc319f96daa8 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:07.237388 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e5d3b-14c6-4824-adfa-c696b7f08c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:07.239006 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e5d3b-14c6-4824-adfa-c696b7f08c4d admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:07.239461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e5d3b-14c6-4824-adfa-c696b7f08c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:07.239921 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e5d3b-14c6-4824-adfa-c696b7f08c4d admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:07.240984 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e5d3b-14c6-4824-adfa-c696b7f08c4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:14:07.241428 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e5d3b-14c6-4824-adfa-c696b7f08c4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:07.243841 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e5d3b-14c6-4824-adfa-c696b7f08c4d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:07.260774 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 900/1810] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:14:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:14:07.263987 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096aa273-b6ee-4533-9a54-8a1b123676d9 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:07.277338 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096aa273-b6ee-4533-9a54-8a1b123676d9 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:07.284249 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb64864-479e-4944-b708-c565f1e262f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:07.285864 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb64864-479e-4944-b708-c565f1e262f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:07.286628 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb64864-479e-4944-b708-c565f1e262f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:07.287980 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb64864-479e-4944-b708-c565f1e262f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:07.289890 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb64864-479e-4944-b708-c565f1e262f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:07.292304 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb64864-479e-4944-b708-c565f1e262f3 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:07.337330 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 911/1811] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:07 2021] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:07.342388 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e5d3b-14c6-4824-adfa-c696b7f08c4d admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:07.367211 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e5d3b-14c6-4824-adfa-c696b7f08c4d admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:07.427353 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc47cb-fc0d-4ed0-933d-adba9fd698e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:07.428122 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc47cb-fc0d-4ed0-933d-adba9fd698e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:07.428510 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc47cb-fc0d-4ed0-933d-adba9fd698e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:07.428894 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dc47cb-fc0d-4ed0-933d-adba9fd698e1 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:07.429809 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc47cb-fc0d-4ed0-933d-adba9fd698e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:07.431994 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dc47cb-fc0d-4ed0-933d-adba9fd698e1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:07.456012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 901/1812] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:07 2021] POST /identity/v3/users => generated 286 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:07.459901 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb64864-479e-4944-b708-c565f1e262f3 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:07.470570 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb64864-479e-4944-b708-c565f1e262f3 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:07.482850 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d21795-6ab1-4e09-b7a0-aacf609cf79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:07.483934 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d21795-6ab1-4e09-b7a0-aacf609cf79b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:07.484218 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d21795-6ab1-4e09-b7a0-aacf609cf79b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:07.484503 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d21795-6ab1-4e09-b7a0-aacf609cf79b admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:07.485955 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d21795-6ab1-4e09-b7a0-aacf609cf79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:07.487956 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d21795-6ab1-4e09-b7a0-aacf609cf79b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:07.507417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 912/1813] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:07 2021] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:07.511963 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc47cb-fc0d-4ed0-933d-adba9fd698e1 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:07.531909 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dc47cb-fc0d-4ed0-933d-adba9fd698e1 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:07.544163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b2185-55ee-44cf-804c-d9ea552e6401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:07.544912 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b2185-55ee-44cf-804c-d9ea552e6401 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:07.545199 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b2185-55ee-44cf-804c-d9ea552e6401 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:07.545519 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b2185-55ee-44cf-804c-d9ea552e6401 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:07.546314 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b2185-55ee-44cf-804c-d9ea552e6401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:07.552549 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b2185-55ee-44cf-804c-d9ea552e6401 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:07.572958 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 902/1814] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:07 2021] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:14:07.576783 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d21795-6ab1-4e09-b7a0-aacf609cf79b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:07.607045 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d21795-6ab1-4e09-b7a0-aacf609cf79b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:07.625562 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c302c03-e3bc-4c5b-9aa8-06e5ea06e86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:07.627064 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c302c03-e3bc-4c5b-9aa8-06e5ea06e86c admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:07.627064 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c302c03-e3bc-4c5b-9aa8-06e5ea06e86c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:07.627418 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c302c03-e3bc-4c5b-9aa8-06e5ea06e86c admin admin] PATH_INFO: `/v3/projects/e53f8ad0152945ffac18d7d6b72270b8/users/928d889dd68e48b698db829665e25f98/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:07.673420 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c302c03-e3bc-4c5b-9aa8-06e5ea06e86c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e53f8ad0152945ffac18d7d6b72270b8, user_id=928d889dd68e48b698db829665e25f98, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:07.678262 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c302c03-e3bc-4c5b-9aa8-06e5ea06e86c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:07.721741 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 913/1815] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:07 2021] PUT /identity/v3/projects/e53f8ad0152945ffac18d7d6b72270b8/users/928d889dd68e48b698db829665e25f98/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:07.734306 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a388d04-1984-4fe0-9715-28f1b7dffed3 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:07.735091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a388d04-1984-4fe0-9715-28f1b7dffed3 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:07.735527 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a388d04-1984-4fe0-9715-28f1b7dffed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:07.793597 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-5a388d04-1984-4fe0-9715-28f1b7dffed3 None None] MFA Rules not processed for user `928d889dd68e48b698db829665e25f98`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:07.806935 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-5a388d04-1984-4fe0-9715-28f1b7dffed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:07.907974 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 903/1816] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:07 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:07.918974 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c302c03-e3bc-4c5b-9aa8-06e5ea06e86c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:07.922839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-1c302c03-e3bc-4c5b-9aa8-06e5ea06e86c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:08.068430 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c302c03-e3bc-4c5b-9aa8-06e5ea06e86c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:08.077711 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8e5968-9f85-47a7-8eb1-dcc8cee2e4c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:08.078791 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e5968-9f85-47a7-8eb1-dcc8cee2e4c7 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:08.079234 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e5968-9f85-47a7-8eb1-dcc8cee2e4c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:08.079713 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8e5968-9f85-47a7-8eb1-dcc8cee2e4c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:08.092216 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e5968-9f85-47a7-8eb1-dcc8cee2e4c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:08.093672 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8e5968-9f85-47a7-8eb1-dcc8cee2e4c7 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:08.114093 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 914/1817] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:07 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:14:08.131369 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a388d04-1984-4fe0-9715-28f1b7dffed3 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:08.210781 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a388d04-1984-4fe0-9715-28f1b7dffed3 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:08.215930 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb76f2c-2a8a-4193-a205-f040dd9a3826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:08.216813 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb76f2c-2a8a-4193-a205-f040dd9a3826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:08.217095 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb76f2c-2a8a-4193-a205-f040dd9a3826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:08.217372 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb76f2c-2a8a-4193-a205-f040dd9a3826 admin admin] PATH_INFO: `/v3/users/928d889dd68e48b698db829665e25f98` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:08.218634 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb76f2c-2a8a-4193-a205-f040dd9a3826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=928d889dd68e48b698db829665e25f98)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:08.220563 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb76f2c-2a8a-4193-a205-f040dd9a3826 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:08.276548 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0fb76f2c-2a8a-4193-a205-f040dd9a3826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '928d889dd68e48b698db829665e25f98'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:08.287049 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0fb76f2c-2a8a-4193-a205-f040dd9a3826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '928d889dd68e48b698db829665e25f98'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:08.294465 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0fb76f2c-2a8a-4193-a205-f040dd9a3826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '928d889dd68e48b698db829665e25f98'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:08.295135 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0fb76f2c-2a8a-4193-a205-f040dd9a3826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '928d889dd68e48b698db829665e25f98'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:08.314640 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0fb76f2c-2a8a-4193-a205-f040dd9a3826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '928d889dd68e48b698db829665e25f98'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:08.329404 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 904/1818] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:08 2021] DELETE /identity/v3/users/928d889dd68e48b698db829665e25f98 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:08.336703 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925bced-551b-48b9-a7a7-cdf6c21b35be None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:08.338021 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925bced-551b-48b9-a7a7-cdf6c21b35be None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:08.338847 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7925bced-551b-48b9-a7a7-cdf6c21b35be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:08.383686 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-7925bced-551b-48b9-a7a7-cdf6c21b35be None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:08.387414 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-7925bced-551b-48b9-a7a7-cdf6c21b35be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:08.489289 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 915/1819] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:08.500148 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb76f2c-2a8a-4193-a205-f040dd9a3826 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:08.502268 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-0fb76f2c-2a8a-4193-a205-f040dd9a3826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:08.580468 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb76f2c-2a8a-4193-a205-f040dd9a3826 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:08.586352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce5aae-f539-499a-9ed1-851140728fa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:08.587088 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce5aae-f539-499a-9ed1-851140728fa3 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:08.587383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce5aae-f539-499a-9ed1-851140728fa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:08.587665 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce5aae-f539-499a-9ed1-851140728fa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:08.590789 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925bced-551b-48b9-a7a7-cdf6c21b35be None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:08.592206 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-7925bced-551b-48b9-a7a7-cdf6c21b35be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:08.609482 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7925bced-551b-48b9-a7a7-cdf6c21b35be None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:08.610288 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce5aae-f539-499a-9ed1-851140728fa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:08.612158 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce5aae-f539-499a-9ed1-851140728fa3 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:08.614615 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094dda1-d7e4-4501-9134-8d9736e17e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:08.615503 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094dda1-d7e4-4501-9134-8d9736e17e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:08.615790 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094dda1-d7e4-4501-9134-8d9736e17e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:08.616072 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094dda1-d7e4-4501-9134-8d9736e17e09 admin admin] PATH_INFO: `/v3/users/01208554297147f28db29390e6fc3601` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:08.617314 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094dda1-d7e4-4501-9134-8d9736e17e09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01208554297147f28db29390e6fc3601)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:08.619303 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094dda1-d7e4-4501-9134-8d9736e17e09 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:08.637550 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 905/1820] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:08.687808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a094dda1-d7e4-4501-9134-8d9736e17e09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01208554297147f28db29390e6fc3601'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:08.688717 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a094dda1-d7e4-4501-9134-8d9736e17e09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01208554297147f28db29390e6fc3601'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:08.713468 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a094dda1-d7e4-4501-9134-8d9736e17e09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01208554297147f28db29390e6fc3601'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:08.714241 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a094dda1-d7e4-4501-9134-8d9736e17e09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01208554297147f28db29390e6fc3601'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:08.724475 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a094dda1-d7e4-4501-9134-8d9736e17e09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01208554297147f28db29390e6fc3601'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:08.739126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 916/1821] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:08 2021] DELETE /identity/v3/users/01208554297147f28db29390e6fc3601 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:08.924359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce5aae-f539-499a-9ed1-851140728fa3 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:08.927395 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-94ce5aae-f539-499a-9ed1-851140728fa3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:08.943187 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce5aae-f539-499a-9ed1-851140728fa3 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:09.005896 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93b147d-78da-4d00-8e5e-d31a94887893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:09.006735 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b147d-78da-4d00-8e5e-d31a94887893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:09.007017 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b147d-78da-4d00-8e5e-d31a94887893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:09.007291 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93b147d-78da-4d00-8e5e-d31a94887893 admin admin] PATH_INFO: `/v3/projects/e53f8ad0152945ffac18d7d6b72270b8` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:09.008627 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b147d-78da-4d00-8e5e-d31a94887893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e53f8ad0152945ffac18d7d6b72270b8)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:09.011124 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93b147d-78da-4d00-8e5e-d31a94887893 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:09.063491 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a93b147d-78da-4d00-8e5e-d31a94887893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e53f8ad0152945ffac18d7d6b72270b8', 'request_id': 'req-a93b147d-78da-4d00-8e5e-d31a94887893'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:09.070327 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a93b147d-78da-4d00-8e5e-d31a94887893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e53f8ad0152945ffac18d7d6b72270b8', 'request_id': 'req-a93b147d-78da-4d00-8e5e-d31a94887893'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:09.077503 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a93b147d-78da-4d00-8e5e-d31a94887893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e53f8ad0152945ffac18d7d6b72270b8', 'request_id': 'req-a93b147d-78da-4d00-8e5e-d31a94887893'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:09.089011 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a93b147d-78da-4d00-8e5e-d31a94887893 admin admin] The token cache is being invalidate because project e53f8ad0152945ffac18d7d6b72270b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:09.089386 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a93b147d-78da-4d00-8e5e-d31a94887893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:09.090114 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a93b147d-78da-4d00-8e5e-d31a94887893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:09.092572 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 906/1822] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:08 2021] DELETE /identity/v3/projects/e53f8ad0152945ffac18d7d6b72270b8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:09.099459 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527307f7-34ed-4965-a16d-aef2ada534fd None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:09.099459 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527307f7-34ed-4965-a16d-aef2ada534fd None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:09.099459 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527307f7-34ed-4965-a16d-aef2ada534fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:09.118048 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-527307f7-34ed-4965-a16d-aef2ada534fd None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:09.119395 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-527307f7-34ed-4965-a16d-aef2ada534fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:09.188844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 917/1823] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:09.198566 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5b3ed-e5a1-4155-b442-42f16f449f3c None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:09.198854 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5b3ed-e5a1-4155-b442-42f16f449f3c None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:09.199136 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5b3ed-e5a1-4155-b442-42f16f449f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:09.218093 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527307f7-34ed-4965-a16d-aef2ada534fd None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:09.220250 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-527307f7-34ed-4965-a16d-aef2ada534fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:09.232562 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-7fa5b3ed-e5a1-4155-b442-42f16f449f3c None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:09.234969 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7fa5b3ed-e5a1-4155-b442-42f16f449f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:09.254778 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527307f7-34ed-4965-a16d-aef2ada534fd None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:09.259141 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 907/1824] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:09.260736 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5b3ed-e5a1-4155-b442-42f16f449f3c None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:09.262880 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6324e7c-da4d-4652-9b55-9a422eac8a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:09.263835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6324e7c-da4d-4652-9b55-9a422eac8a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:09.264186 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6324e7c-da4d-4652-9b55-9a422eac8a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:09.264532 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6324e7c-da4d-4652-9b55-9a422eac8a1b admin admin] PATH_INFO: `/v3/projects/658e12cca50341f0888a1a775ac5039e` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:09.265825 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6324e7c-da4d-4652-9b55-9a422eac8a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=658e12cca50341f0888a1a775ac5039e)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:09.268594 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6324e7c-da4d-4652-9b55-9a422eac8a1b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:09.272260 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5b3ed-e5a1-4155-b442-42f16f449f3c None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:09.278805 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce190ab-fede-4245-b027-419f63b67855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:09.279658 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce190ab-fede-4245-b027-419f63b67855 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:09.280364 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce190ab-fede-4245-b027-419f63b67855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:09.280715 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce190ab-fede-4245-b027-419f63b67855 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:09.281605 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce190ab-fede-4245-b027-419f63b67855 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:14:09.281936 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce190ab-fede-4245-b027-419f63b67855 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:09.283584 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce190ab-fede-4245-b027-419f63b67855 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:09.300105 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 908/1825] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:14:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:14:09.301678 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce190ab-fede-4245-b027-419f63b67855 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:09.315343 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce190ab-fede-4245-b027-419f63b67855 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:09.330643 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d6324e7c-da4d-4652-9b55-9a422eac8a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '658e12cca50341f0888a1a775ac5039e', 'request_id': 'req-d6324e7c-da4d-4652-9b55-9a422eac8a1b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:09.336986 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d6324e7c-da4d-4652-9b55-9a422eac8a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '658e12cca50341f0888a1a775ac5039e', 'request_id': 'req-d6324e7c-da4d-4652-9b55-9a422eac8a1b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:09.349846 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d6324e7c-da4d-4652-9b55-9a422eac8a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '658e12cca50341f0888a1a775ac5039e', 'request_id': 'req-d6324e7c-da4d-4652-9b55-9a422eac8a1b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:09.365024 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d6324e7c-da4d-4652-9b55-9a422eac8a1b admin admin] The token cache is being invalidate because project 658e12cca50341f0888a1a775ac5039e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:09.365790 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d6324e7c-da4d-4652-9b55-9a422eac8a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:09.366126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d6324e7c-da4d-4652-9b55-9a422eac8a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:09.368205 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 918/1826] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:09 2021] DELETE /identity/v3/projects/658e12cca50341f0888a1a775ac5039e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:09.371854 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6324e7c-da4d-4652-9b55-9a422eac8a1b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:09.373198 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-d6324e7c-da4d-4652-9b55-9a422eac8a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:09.384709 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a32fa-f0f8-46cc-9375-e417e43a7323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:09.385457 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a32fa-f0f8-46cc-9375-e417e43a7323 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:09.385856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a32fa-f0f8-46cc-9375-e417e43a7323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:09.386250 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a32fa-f0f8-46cc-9375-e417e43a7323 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:09.387091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a32fa-f0f8-46cc-9375-e417e43a7323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:09.389070 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a32fa-f0f8-46cc-9375-e417e43a7323 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:09.424438 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 909/1827] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:09 2021] POST /identity/v3/projects => generated 363 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:09.426953 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a32fa-f0f8-46cc-9375-e417e43a7323 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:09.432221 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-886a32fa-f0f8-46cc-9375-e417e43a7323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:09.457136 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6324e7c-da4d-4652-9b55-9a422eac8a1b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:09.548871 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8655047-4055-4485-bef0-b5b5055fb4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:09.549960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8655047-4055-4485-bef0-b5b5055fb4b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:09.550313 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8655047-4055-4485-bef0-b5b5055fb4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:09.550729 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8655047-4055-4485-bef0-b5b5055fb4b7 admin admin] PATH_INFO: `/v3/users/fe8212aa75aa468ca93873c68a43998a` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:09.552106 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8655047-4055-4485-bef0-b5b5055fb4b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe8212aa75aa468ca93873c68a43998a)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:09.564939 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8655047-4055-4485-bef0-b5b5055fb4b7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:09.566331 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a32fa-f0f8-46cc-9375-e417e43a7323 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:09.573870 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695244e-e0d9-44d7-af9c-a85897399b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:09.574654 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695244e-e0d9-44d7-af9c-a85897399b05 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:09.575355 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695244e-e0d9-44d7-af9c-a85897399b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:09.576409 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9695244e-e0d9-44d7-af9c-a85897399b05 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:09.577146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695244e-e0d9-44d7-af9c-a85897399b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:09.579102 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9695244e-e0d9-44d7-af9c-a85897399b05 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:09.611729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 910/1828] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:09 2021] POST /identity/v3/users => generated 282 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:09.612984 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695244e-e0d9-44d7-af9c-a85897399b05 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:09.613106 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f8655047-4055-4485-bef0-b5b5055fb4b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe8212aa75aa468ca93873c68a43998a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:09.614140 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f8655047-4055-4485-bef0-b5b5055fb4b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe8212aa75aa468ca93873c68a43998a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:09.623094 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9695244e-e0d9-44d7-af9c-a85897399b05 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:09.628055 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfbbdf-f9d1-4b10-a1f7-bf9fda0b0922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:09.628386 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f8655047-4055-4485-bef0-b5b5055fb4b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe8212aa75aa468ca93873c68a43998a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:09.628927 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfbbdf-f9d1-4b10-a1f7-bf9fda0b0922 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:09.629102 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f8655047-4055-4485-bef0-b5b5055fb4b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe8212aa75aa468ca93873c68a43998a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:09.629304 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfbbdf-f9d1-4b10-a1f7-bf9fda0b0922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:09.629656 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbfbbdf-f9d1-4b10-a1f7-bf9fda0b0922 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:09.630637 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbfbbdf-f9d1-4b10-a1f7-bf9fda0b0922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:09.632305 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbfbbdf-f9d1-4b10-a1f7-bf9fda0b0922 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:09.642688 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f8655047-4055-4485-bef0-b5b5055fb4b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe8212aa75aa468ca93873c68a43998a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:09.662267 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 919/1829] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:09 2021] DELETE /identity/v3/users/fe8212aa75aa468ca93873c68a43998a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:09.663342 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 911/1830] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:09 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:09.667641 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8655047-4055-4485-bef0-b5b5055fb4b7 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:09.669234 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f8655047-4055-4485-bef0-b5b5055fb4b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:09.758601 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8655047-4055-4485-bef0-b5b5055fb4b7 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:09.768625 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3061413a-af68-49b1-b406-78d1b7e119c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:09.770345 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061413a-af68-49b1-b406-78d1b7e119c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:09.771090 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061413a-af68-49b1-b406-78d1b7e119c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:09.771502 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3061413a-af68-49b1-b406-78d1b7e119c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:09.772553 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061413a-af68-49b1-b406-78d1b7e119c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:09.774546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3061413a-af68-49b1-b406-78d1b7e119c7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:09.793036 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 920/1831] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:09 2021] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:09.793379 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfbbdf-f9d1-4b10-a1f7-bf9fda0b0922 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:09.816869 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbfbbdf-f9d1-4b10-a1f7-bf9fda0b0922 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:09.823175 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64170799-2fb2-4759-b187-b90ee23be4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:09.824171 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64170799-2fb2-4759-b187-b90ee23be4e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:09.824528 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64170799-2fb2-4759-b187-b90ee23be4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:09.824880 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64170799-2fb2-4759-b187-b90ee23be4e0 admin admin] PATH_INFO: `/v3/projects/1bf6fee7125b4a0db0222dfe56f36b87/users/da0bf4df5bd14fde83eacc8abe24aeb8/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:09.845393 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64170799-2fb2-4759-b187-b90ee23be4e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf6fee7125b4a0db0222dfe56f36b87, user_id=da0bf4df5bd14fde83eacc8abe24aeb8, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:09.848841 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64170799-2fb2-4759-b187-b90ee23be4e0 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:09.877158 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c51be-f0af-44f7-a9f5-37c5c1a2fa23 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:09.877499 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c51be-f0af-44f7-a9f5-37c5c1a2fa23 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:09.877737 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c51be-f0af-44f7-a9f5-37c5c1a2fa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:09.881568 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 912/1832] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:09 2021] PUT /identity/v3/projects/1bf6fee7125b4a0db0222dfe56f36b87/users/da0bf4df5bd14fde83eacc8abe24aeb8/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:09.908711 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-bd0c51be-f0af-44f7-a9f5-37c5c1a2fa23 None None] MFA Rules not processed for user `da0bf4df5bd14fde83eacc8abe24aeb8`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:09.910210 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-bd0c51be-f0af-44f7-a9f5-37c5c1a2fa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:09.997358 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 921/1833] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:09 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:10.010873 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64170799-2fb2-4759-b187-b90ee23be4e0 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:10.010873 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-64170799-2fb2-4759-b187-b90ee23be4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:10.012367 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c51be-f0af-44f7-a9f5-37c5c1a2fa23 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:10.014234 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-bd0c51be-f0af-44f7-a9f5-37c5c1a2fa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:10.091870 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64170799-2fb2-4759-b187-b90ee23be4e0 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:10.098955 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f92f1a-c0ab-45b8-b142-e9d40b95486e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:10.099951 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f92f1a-c0ab-45b8-b142-e9d40b95486e service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:10.100243 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f92f1a-c0ab-45b8-b142-e9d40b95486e service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:10.100526 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f92f1a-c0ab-45b8-b142-e9d40b95486e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:10.114124 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f92f1a-c0ab-45b8-b142-e9d40b95486e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:10.115781 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f92f1a-c0ab-45b8-b142-e9d40b95486e service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:10.135940 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 913/1834] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:10 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:10.161153 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c51be-f0af-44f7-a9f5-37c5c1a2fa23 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:10.166851 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a7823-1f56-47e9-8361-04cb63161218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:10.167891 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a7823-1f56-47e9-8361-04cb63161218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:10.168180 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a7823-1f56-47e9-8361-04cb63161218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:10.168453 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a7823-1f56-47e9-8361-04cb63161218 admin admin] PATH_INFO: `/v3/projects/b20689c274894889ad90408954697168` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:10.169666 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a7823-1f56-47e9-8361-04cb63161218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b20689c274894889ad90408954697168)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:10.171803 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6a7823-1f56-47e9-8361-04cb63161218 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:10.233582 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8a6a7823-1f56-47e9-8361-04cb63161218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b20689c274894889ad90408954697168', 'request_id': 'req-8a6a7823-1f56-47e9-8361-04cb63161218'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:10.240684 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8a6a7823-1f56-47e9-8361-04cb63161218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b20689c274894889ad90408954697168', 'request_id': 'req-8a6a7823-1f56-47e9-8361-04cb63161218'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:10.251927 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8a6a7823-1f56-47e9-8361-04cb63161218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b20689c274894889ad90408954697168', 'request_id': 'req-8a6a7823-1f56-47e9-8361-04cb63161218'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:10.269193 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8a6a7823-1f56-47e9-8361-04cb63161218 admin admin] The token cache is being invalidate because project b20689c274894889ad90408954697168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:10.269580 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8a6a7823-1f56-47e9-8361-04cb63161218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:10.271551 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8a6a7823-1f56-47e9-8361-04cb63161218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:10.274131 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 922/1835] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:10 2021] DELETE /identity/v3/projects/b20689c274894889ad90408954697168 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:10.280541 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed391d0-2edd-4080-bbe6-3c980e2ff865 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:10.281058 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed391d0-2edd-4080-bbe6-3c980e2ff865 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:10.281474 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed391d0-2edd-4080-bbe6-3c980e2ff865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:10.304694 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-eed391d0-2edd-4080-bbe6-3c980e2ff865 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:10.308513 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-eed391d0-2edd-4080-bbe6-3c980e2ff865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:10.471954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 914/1836] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:10.475147 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168b069-f9ef-407d-b032-b4c6b7384814 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:10.477374 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168b069-f9ef-407d-b032-b4c6b7384814 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:10.477374 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168b069-f9ef-407d-b032-b4c6b7384814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:10.507582 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-d168b069-f9ef-407d-b032-b4c6b7384814 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:10.509431 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-d168b069-f9ef-407d-b032-b4c6b7384814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:10.523092 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 923/1837] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:10.524515 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed391d0-2edd-4080-bbe6-3c980e2ff865 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:10.537193 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed391d0-2edd-4080-bbe6-3c980e2ff865 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:10.549007 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d4f77-3a1f-428d-a89d-44262626139d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:10.551157 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d4f77-3a1f-428d-a89d-44262626139d admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:10.551496 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d4f77-3a1f-428d-a89d-44262626139d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:10.552300 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d4f77-3a1f-428d-a89d-44262626139d admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:10.555382 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d4f77-3a1f-428d-a89d-44262626139d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:14:10.556979 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d4f77-3a1f-428d-a89d-44262626139d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:10.560918 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d4f77-3a1f-428d-a89d-44262626139d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:10.610307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 915/1838] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:14:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:14:10.618554 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168b069-f9ef-407d-b032-b4c6b7384814 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:10.637835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168b069-f9ef-407d-b032-b4c6b7384814 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:10.659325 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee97987-de08-43ca-b31e-e2b6e145e2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:10.660624 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee97987-de08-43ca-b31e-e2b6e145e2d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:10.660977 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee97987-de08-43ca-b31e-e2b6e145e2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:10.661316 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee97987-de08-43ca-b31e-e2b6e145e2d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:10.662133 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee97987-de08-43ca-b31e-e2b6e145e2d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:10.671153 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee97987-de08-43ca-b31e-e2b6e145e2d3 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:10.777908 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 924/1839] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:10 2021] POST /identity/v3/projects => generated 365 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:10.779279 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d4f77-3a1f-428d-a89d-44262626139d admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:10.831709 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d4f77-3a1f-428d-a89d-44262626139d admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:11.009493 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f31cb-b7f9-4119-be19-eb8659645afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:11.010211 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f31cb-b7f9-4119-be19-eb8659645afc admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:11.010562 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f31cb-b7f9-4119-be19-eb8659645afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:11.010910 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9f31cb-b7f9-4119-be19-eb8659645afc admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:11.012232 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f31cb-b7f9-4119-be19-eb8659645afc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:11.014458 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9f31cb-b7f9-4119-be19-eb8659645afc admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:11.050621 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 916/1840] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:10 2021] POST /identity/v3/users => generated 283 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:11.053320 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee97987-de08-43ca-b31e-e2b6e145e2d3 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:11.066691 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee97987-de08-43ca-b31e-e2b6e145e2d3 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:11.073909 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a147f70-5298-44cd-9f38-5dbde85d2857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:11.074943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a147f70-5298-44cd-9f38-5dbde85d2857 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:11.075369 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a147f70-5298-44cd-9f38-5dbde85d2857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:11.075784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a147f70-5298-44cd-9f38-5dbde85d2857 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:11.076674 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a147f70-5298-44cd-9f38-5dbde85d2857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:11.078475 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a147f70-5298-44cd-9f38-5dbde85d2857 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:11.104119 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 925/1841] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:11 2021] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:11.108369 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f31cb-b7f9-4119-be19-eb8659645afc admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:11.125220 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9f31cb-b7f9-4119-be19-eb8659645afc admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:11.132338 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ee63f2-f3ce-485a-a27b-017d6b9c34a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:11.133071 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee63f2-f3ce-485a-a27b-017d6b9c34a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:11.133350 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee63f2-f3ce-485a-a27b-017d6b9c34a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:11.133618 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ee63f2-f3ce-485a-a27b-017d6b9c34a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:11.134420 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee63f2-f3ce-485a-a27b-017d6b9c34a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:11.135979 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ee63f2-f3ce-485a-a27b-017d6b9c34a4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:11.147791 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 917/1842] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:11 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:11.152063 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a147f70-5298-44cd-9f38-5dbde85d2857 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:11.162780 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a147f70-5298-44cd-9f38-5dbde85d2857 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:11.167495 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f159ca3-9e45-4afa-b938-1ff2aeb6198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:11.168383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f159ca3-9e45-4afa-b938-1ff2aeb6198b admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:11.168788 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f159ca3-9e45-4afa-b938-1ff2aeb6198b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:11.169065 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f159ca3-9e45-4afa-b938-1ff2aeb6198b admin admin] PATH_INFO: `/v3/projects/52f22ea21ee94b81af2bc1b925300e6e/users/9fd801cc161e4e139421effe51260606/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:11.184643 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f159ca3-9e45-4afa-b938-1ff2aeb6198b admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f22ea21ee94b81af2bc1b925300e6e, user_id=9fd801cc161e4e139421effe51260606, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:11.187411 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f159ca3-9e45-4afa-b938-1ff2aeb6198b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:11.206497 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 926/1843] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:11 2021] PUT /identity/v3/projects/52f22ea21ee94b81af2bc1b925300e6e/users/9fd801cc161e4e139421effe51260606/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:11.217584 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cbc49-3628-483a-90f7-6c25f1df81ee None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:11.218561 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cbc49-3628-483a-90f7-6c25f1df81ee None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:11.218561 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5cbc49-3628-483a-90f7-6c25f1df81ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:11.250121 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-7f5cbc49-3628-483a-90f7-6c25f1df81ee None None] MFA Rules not processed for user `9fd801cc161e4e139421effe51260606`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:11.251791 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7f5cbc49-3628-483a-90f7-6c25f1df81ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:11.321548 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 918/1844] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:11 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:11.326201 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f159ca3-9e45-4afa-b938-1ff2aeb6198b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:11.400747 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f159ca3-9e45-4afa-b938-1ff2aeb6198b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:11.405340 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dbeab-b423-4302-81d8-6b5d4195a08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:11.406152 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dbeab-b423-4302-81d8-6b5d4195a08a admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:11.406527 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dbeab-b423-4302-81d8-6b5d4195a08a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:11.406874 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dbeab-b423-4302-81d8-6b5d4195a08a admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:11.407718 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dbeab-b423-4302-81d8-6b5d4195a08a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:11.409837 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79dbeab-b423-4302-81d8-6b5d4195a08a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:11.443080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 927/1845] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:11 2021] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:11.444496 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cbc49-3628-483a-90f7-6c25f1df81ee None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:11.455927 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5cbc49-3628-483a-90f7-6c25f1df81ee None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:11.524007 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dc26a-3a88-460f-bbf4-553bf8d07533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:11.524991 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dc26a-3a88-460f-bbf4-553bf8d07533 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:11.525451 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dc26a-3a88-460f-bbf4-553bf8d07533 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:11.525739 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5dc26a-3a88-460f-bbf4-553bf8d07533 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:11.526599 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dc26a-3a88-460f-bbf4-553bf8d07533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:11.528523 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5dc26a-3a88-460f-bbf4-553bf8d07533 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:11.553961 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 919/1846] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:11 2021] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:11.555118 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dbeab-b423-4302-81d8-6b5d4195a08a admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:11.566962 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dbeab-b423-4302-81d8-6b5d4195a08a admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:11.571859 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf60048-f352-4114-9b3d-62a6f53ccb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:11.572629 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf60048-f352-4114-9b3d-62a6f53ccb36 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:11.572990 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf60048-f352-4114-9b3d-62a6f53ccb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:11.573345 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf60048-f352-4114-9b3d-62a6f53ccb36 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:11.574322 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf60048-f352-4114-9b3d-62a6f53ccb36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:11.576516 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf60048-f352-4114-9b3d-62a6f53ccb36 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:11.589737 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 928/1847] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:11 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:14:11.594178 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dc26a-3a88-460f-bbf4-553bf8d07533 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:11.604679 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5dc26a-3a88-460f-bbf4-553bf8d07533 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:11.609559 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921df38-3805-4979-95b7-50a531682f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:11.610538 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921df38-3805-4979-95b7-50a531682f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:11.611096 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921df38-3805-4979-95b7-50a531682f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:11.611096 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921df38-3805-4979-95b7-50a531682f4c admin admin] PATH_INFO: `/v3/projects/06cc7c03d6b84e489bf3dc611c6778a8/users/90f793df56e8408b83e7757072547353/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:11.625899 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921df38-3805-4979-95b7-50a531682f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=06cc7c03d6b84e489bf3dc611c6778a8, user_id=90f793df56e8408b83e7757072547353, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:11.629751 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b921df38-3805-4979-95b7-50a531682f4c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:11.649225 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 920/1848] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:11 2021] PUT /identity/v3/projects/06cc7c03d6b84e489bf3dc611c6778a8/users/90f793df56e8408b83e7757072547353/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:11.653201 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf60048-f352-4114-9b3d-62a6f53ccb36 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:11.663984 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf60048-f352-4114-9b3d-62a6f53ccb36 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:11.730434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d74e0-6c97-42c5-9de8-bf88076a33fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:11.731366 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d74e0-6c97-42c5-9de8-bf88076a33fc admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:11.731705 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d74e0-6c97-42c5-9de8-bf88076a33fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:11.732006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d74e0-6c97-42c5-9de8-bf88076a33fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:11.732764 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d74e0-6c97-42c5-9de8-bf88076a33fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:11.734478 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d74e0-6c97-42c5-9de8-bf88076a33fc admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:11.750073 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 929/1849] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:11 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:14:11.751261 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921df38-3805-4979-95b7-50a531682f4c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:11.762729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921df38-3805-4979-95b7-50a531682f4c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:11.770676 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f91642-1ffe-446c-924f-fceb7cc7f239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:11.771633 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f91642-1ffe-446c-924f-fceb7cc7f239 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:11.771921 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f91642-1ffe-446c-924f-fceb7cc7f239 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:11.772197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f91642-1ffe-446c-924f-fceb7cc7f239 admin admin] PATH_INFO: `/v3/projects/06cc7c03d6b84e489bf3dc611c6778a8/users/90f793df56e8408b83e7757072547353/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:11.776089 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f91642-1ffe-446c-924f-fceb7cc7f239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06cc7c03d6b84e489bf3dc611c6778a8, user_id=90f793df56e8408b83e7757072547353, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:11.779153 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f91642-1ffe-446c-924f-fceb7cc7f239 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:11.790804 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 921/1850] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:11 2021] PUT /identity/v3/projects/06cc7c03d6b84e489bf3dc611c6778a8/users/90f793df56e8408b83e7757072547353/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:11.802382 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa405b54-6f28-4192-ac23-b7813db65893 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:11.802677 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa405b54-6f28-4192-ac23-b7813db65893 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:11.802962 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa405b54-6f28-4192-ac23-b7813db65893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:11.846940 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-fa405b54-6f28-4192-ac23-b7813db65893 None None] MFA Rules not processed for user `90f793df56e8408b83e7757072547353`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:11.848409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-fa405b54-6f28-4192-ac23-b7813db65893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:11.938006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 930/1851] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:11 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:11.940021 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f91642-1ffe-446c-924f-fceb7cc7f239 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:11.941933 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-65f91642-1ffe-446c-924f-fceb7cc7f239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:12.006708 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f91642-1ffe-446c-924f-fceb7cc7f239 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:12.011398 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c28f79a-9e59-42af-a2f6-1bcd2f5182e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:12.012181 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28f79a-9e59-42af-a2f6-1bcd2f5182e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:12.013010 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28f79a-9e59-42af-a2f6-1bcd2f5182e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:12.013108 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c28f79a-9e59-42af-a2f6-1bcd2f5182e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:12.024124 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28f79a-9e59-42af-a2f6-1bcd2f5182e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:12.025882 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c28f79a-9e59-42af-a2f6-1bcd2f5182e2 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:12.036525 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 922/1852] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:11 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:12.145587 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa405b54-6f28-4192-ac23-b7813db65893 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:12.157024 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa405b54-6f28-4192-ac23-b7813db65893 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:12.162756 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5fdce-1929-4a84-81ab-6a02538a6627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:12.163368 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5fdce-1929-4a84-81ab-6a02538a6627 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:12.163651 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5fdce-1929-4a84-81ab-6a02538a6627 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:12.164059 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5fdce-1929-4a84-81ab-6a02538a6627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:12.236673 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5fdce-1929-4a84-81ab-6a02538a6627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:12.239149 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5fdce-1929-4a84-81ab-6a02538a6627 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:12.261045 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 931/1853] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:12 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:25.583346 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62fad1-ca55-4111-83d3-5faf1149d590 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:25.583848 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62fad1-ca55-4111-83d3-5faf1149d590 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:25.584008 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62fad1-ca55-4111-83d3-5faf1149d590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:25.603314 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-fd62fad1-ca55-4111-83d3-5faf1149d590 None None] MFA Rules not processed for user `63baa45ff6a84614ac4656f6c7c6be2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:25.604510 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-fd62fad1-ca55-4111-83d3-5faf1149d590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:25.666160 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 923/1854] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:25 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:26.013183 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5fdce-1929-4a84-81ab-6a02538a6627 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:26.095194 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5fdce-1929-4a84-81ab-6a02538a6627 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:26.103170 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d12db-d7a0-4a0f-965a-346358be64f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:26.104616 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d12db-d7a0-4a0f-965a-346358be64f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:26.105086 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d12db-d7a0-4a0f-965a-346358be64f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:26.105571 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4d12db-d7a0-4a0f-965a-346358be64f7 admin admin] PATH_INFO: `/v3/users/9fd801cc161e4e139421effe51260606` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:26.117966 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d12db-d7a0-4a0f-965a-346358be64f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fd801cc161e4e139421effe51260606)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:26.117966 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4d12db-d7a0-4a0f-965a-346358be64f7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:26.166068 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-1d4d12db-d7a0-4a0f-965a-346358be64f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fd801cc161e4e139421effe51260606'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:26.166778 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-1d4d12db-d7a0-4a0f-965a-346358be64f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fd801cc161e4e139421effe51260606'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:26.187191 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-1d4d12db-d7a0-4a0f-965a-346358be64f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fd801cc161e4e139421effe51260606'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:26.187918 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-1d4d12db-d7a0-4a0f-965a-346358be64f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fd801cc161e4e139421effe51260606'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:26.197028 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-1d4d12db-d7a0-4a0f-965a-346358be64f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fd801cc161e4e139421effe51260606'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:26.213520 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 932/1855] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:26 2021] DELETE /identity/v3/users/9fd801cc161e4e139421effe51260606 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:26.216274 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875585af-b16a-46aa-8664-46fe00b7dd99 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:26.216567 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875585af-b16a-46aa-8664-46fe00b7dd99 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:26.216848 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875585af-b16a-46aa-8664-46fe00b7dd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:26.236890 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-875585af-b16a-46aa-8664-46fe00b7dd99 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:26.238551 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-875585af-b16a-46aa-8664-46fe00b7dd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:26.309192 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 924/1856] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:26.320396 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d12db-d7a0-4a0f-965a-346358be64f7 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:26.326161 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-1d4d12db-d7a0-4a0f-965a-346358be64f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:26.397660 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4d12db-d7a0-4a0f-965a-346358be64f7 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:26.401945 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d13733-57df-4bde-a496-b42ba0c46711 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:26.402765 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d13733-57df-4bde-a496-b42ba0c46711 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:26.403177 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d13733-57df-4bde-a496-b42ba0c46711 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:26.403577 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d13733-57df-4bde-a496-b42ba0c46711 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:26.440477 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d13733-57df-4bde-a496-b42ba0c46711 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:26.449694 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d13733-57df-4bde-a496-b42ba0c46711 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:26.467353 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 933/1857] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:26.820767 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875585af-b16a-46aa-8664-46fe00b7dd99 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:26.824204 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-875585af-b16a-46aa-8664-46fe00b7dd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:26.862605 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875585af-b16a-46aa-8664-46fe00b7dd99 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:26.871665 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a939e-df02-42e6-8789-b5a606866921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:26.875289 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a939e-df02-42e6-8789-b5a606866921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:26.875736 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a939e-df02-42e6-8789-b5a606866921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:26.875831 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50a939e-df02-42e6-8789-b5a606866921 admin admin] PATH_INFO: `/v3/projects/52f22ea21ee94b81af2bc1b925300e6e` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:26.877284 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a939e-df02-42e6-8789-b5a606866921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f22ea21ee94b81af2bc1b925300e6e)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:26.879906 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50a939e-df02-42e6-8789-b5a606866921 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:26.943122 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f50a939e-df02-42e6-8789-b5a606866921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f22ea21ee94b81af2bc1b925300e6e', 'request_id': 'req-f50a939e-df02-42e6-8789-b5a606866921'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:26.956827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f50a939e-df02-42e6-8789-b5a606866921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f22ea21ee94b81af2bc1b925300e6e', 'request_id': 'req-f50a939e-df02-42e6-8789-b5a606866921'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:26.965131 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f50a939e-df02-42e6-8789-b5a606866921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f22ea21ee94b81af2bc1b925300e6e', 'request_id': 'req-f50a939e-df02-42e6-8789-b5a606866921'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:26.981074 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f50a939e-df02-42e6-8789-b5a606866921 admin admin] The token cache is being invalidate because project 52f22ea21ee94b81af2bc1b925300e6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:26.981371 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f50a939e-df02-42e6-8789-b5a606866921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:26.982142 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f50a939e-df02-42e6-8789-b5a606866921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:26.984151 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 925/1858] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:26 2021] DELETE /identity/v3/projects/52f22ea21ee94b81af2bc1b925300e6e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:26.988097 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d13733-57df-4bde-a496-b42ba0c46711 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:26.998665 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d13733-57df-4bde-a496-b42ba0c46711 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:27.080885 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbde022-3d6e-4ea1-aa84-5dadd012be67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:27.081784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbde022-3d6e-4ea1-aa84-5dadd012be67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:27.082078 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbde022-3d6e-4ea1-aa84-5dadd012be67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:27.082359 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbde022-3d6e-4ea1-aa84-5dadd012be67 admin admin] PATH_INFO: `/v3/users/90f793df56e8408b83e7757072547353` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:27.083616 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbde022-3d6e-4ea1-aa84-5dadd012be67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90f793df56e8408b83e7757072547353)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:27.085554 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbde022-3d6e-4ea1-aa84-5dadd012be67 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:27.139975 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-0dbde022-3d6e-4ea1-aa84-5dadd012be67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90f793df56e8408b83e7757072547353'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:27.140728 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-0dbde022-3d6e-4ea1-aa84-5dadd012be67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90f793df56e8408b83e7757072547353'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:27.152213 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-0dbde022-3d6e-4ea1-aa84-5dadd012be67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90f793df56e8408b83e7757072547353'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:27.152901 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-0dbde022-3d6e-4ea1-aa84-5dadd012be67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90f793df56e8408b83e7757072547353'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:27.160911 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-0dbde022-3d6e-4ea1-aa84-5dadd012be67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90f793df56e8408b83e7757072547353'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:27.172883 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 934/1859] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:26 2021] DELETE /identity/v3/users/90f793df56e8408b83e7757072547353 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:27.429421 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a939e-df02-42e6-8789-b5a606866921 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:27.431117 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-f50a939e-df02-42e6-8789-b5a606866921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:27.447809 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50a939e-df02-42e6-8789-b5a606866921 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:27.551291 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ac1c2-739c-4be9-bcbc-c143f4a8dd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:27.552636 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ac1c2-739c-4be9-bcbc-c143f4a8dd0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:27.553145 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ac1c2-739c-4be9-bcbc-c143f4a8dd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:27.553729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ac1c2-739c-4be9-bcbc-c143f4a8dd0a admin admin] PATH_INFO: `/v3/projects/06cc7c03d6b84e489bf3dc611c6778a8` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:27.559188 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ac1c2-739c-4be9-bcbc-c143f4a8dd0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=06cc7c03d6b84e489bf3dc611c6778a8)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:27.561306 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ac1c2-739c-4be9-bcbc-c143f4a8dd0a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:27.615966 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ce8ac1c2-739c-4be9-bcbc-c143f4a8dd0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06cc7c03d6b84e489bf3dc611c6778a8', 'request_id': 'req-ce8ac1c2-739c-4be9-bcbc-c143f4a8dd0a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:27.622166 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ce8ac1c2-739c-4be9-bcbc-c143f4a8dd0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06cc7c03d6b84e489bf3dc611c6778a8', 'request_id': 'req-ce8ac1c2-739c-4be9-bcbc-c143f4a8dd0a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:27.630807 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ce8ac1c2-739c-4be9-bcbc-c143f4a8dd0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06cc7c03d6b84e489bf3dc611c6778a8', 'request_id': 'req-ce8ac1c2-739c-4be9-bcbc-c143f4a8dd0a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:27.642942 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ce8ac1c2-739c-4be9-bcbc-c143f4a8dd0a admin admin] The token cache is being invalidate because project 06cc7c03d6b84e489bf3dc611c6778a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:27.643219 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ce8ac1c2-739c-4be9-bcbc-c143f4a8dd0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:27.643878 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ce8ac1c2-739c-4be9-bcbc-c143f4a8dd0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:27.646383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 926/1860] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:27 2021] DELETE /identity/v3/projects/06cc7c03d6b84e489bf3dc611c6778a8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:27.651700 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23160d-72bc-4841-b316-1accb8d254ac None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:27.651990 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23160d-72bc-4841-b316-1accb8d254ac None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:27.652274 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23160d-72bc-4841-b316-1accb8d254ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:27.685796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-6a23160d-72bc-4841-b316-1accb8d254ac None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:27.687109 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-6a23160d-72bc-4841-b316-1accb8d254ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:27.784954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 935/1861] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:27.793306 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a0b2f-41a0-49b1-aa3a-e1277e0d8497 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:27.793741 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a0b2f-41a0-49b1-aa3a-e1277e0d8497 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:27.794066 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430a0b2f-41a0-49b1-aa3a-e1277e0d8497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:27.824352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-430a0b2f-41a0-49b1-aa3a-e1277e0d8497 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:27.826700 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-430a0b2f-41a0-49b1-aa3a-e1277e0d8497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:27.836824 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 927/1862] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:27.841056 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23160d-72bc-4841-b316-1accb8d254ac None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:27.851106 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23160d-72bc-4841-b316-1accb8d254ac None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:27.855686 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c228c0f-5770-4702-a7cf-d0fb4b744680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:27.856337 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c228c0f-5770-4702-a7cf-d0fb4b744680 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:27.856614 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c228c0f-5770-4702-a7cf-d0fb4b744680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:27.856883 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c228c0f-5770-4702-a7cf-d0fb4b744680 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:27.857602 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c228c0f-5770-4702-a7cf-d0fb4b744680 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:14:27.857903 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c228c0f-5770-4702-a7cf-d0fb4b744680 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:27.859515 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c228c0f-5770-4702-a7cf-d0fb4b744680 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:27.871091 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 936/1863] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:14:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:14:27.875348 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a0b2f-41a0-49b1-aa3a-e1277e0d8497 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:27.885533 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430a0b2f-41a0-49b1-aa3a-e1277e0d8497 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:27.891788 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc8811-480a-4f28-ad77-4cd0a8665a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:27.892621 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc8811-480a-4f28-ad77-4cd0a8665a1c admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:27.892925 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc8811-480a-4f28-ad77-4cd0a8665a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:27.893269 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc8811-480a-4f28-ad77-4cd0a8665a1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:27.894284 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc8811-480a-4f28-ad77-4cd0a8665a1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:27.897271 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc8811-480a-4f28-ad77-4cd0a8665a1c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:27.923839 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 928/1864] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:27 2021] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:14:27.928034 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c228c0f-5770-4702-a7cf-d0fb4b744680 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:27.938329 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c228c0f-5770-4702-a7cf-d0fb4b744680 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:27.993799 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba060b2-d078-4cd1-aab1-71bc06038eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:27.994508 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba060b2-d078-4cd1-aab1-71bc06038eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:27.994787 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba060b2-d078-4cd1-aab1-71bc06038eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:27.995058 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba060b2-d078-4cd1-aab1-71bc06038eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:27.995744 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba060b2-d078-4cd1-aab1-71bc06038eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:27.997656 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba060b2-d078-4cd1-aab1-71bc06038eb7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:28.018843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 937/1865] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:27 2021] POST /identity/v3/users => generated 282 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:14:28.024193 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc8811-480a-4f28-ad77-4cd0a8665a1c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:28.036146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc8811-480a-4f28-ad77-4cd0a8665a1c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:28.043028 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c916cd-1e42-4f3a-957e-246c08c51f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:28.044037 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c916cd-1e42-4f3a-957e-246c08c51f50 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:28.044526 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c916cd-1e42-4f3a-957e-246c08c51f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:28.045624 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c916cd-1e42-4f3a-957e-246c08c51f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:28.046538 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c916cd-1e42-4f3a-957e-246c08c51f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:28.049182 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c916cd-1e42-4f3a-957e-246c08c51f50 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:28.062579 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 929/1866] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:28 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:28.067712 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba060b2-d078-4cd1-aab1-71bc06038eb7 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:28.078777 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba060b2-d078-4cd1-aab1-71bc06038eb7 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:28.085395 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4802fd4-3723-44c7-99b6-553d11d369dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:28.086096 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4802fd4-3723-44c7-99b6-553d11d369dd admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:28.086096 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4802fd4-3723-44c7-99b6-553d11d369dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:28.086713 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4802fd4-3723-44c7-99b6-553d11d369dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:28.087092 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4802fd4-3723-44c7-99b6-553d11d369dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:28.088700 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4802fd4-3723-44c7-99b6-553d11d369dd admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:28.100305 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 938/1867] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:28 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:28.104802 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c916cd-1e42-4f3a-957e-246c08c51f50 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:28.119216 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c916cd-1e42-4f3a-957e-246c08c51f50 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:28.125128 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b89b8f-e812-4f86-89c5-792a47dae446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:28.127255 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89b8f-e812-4f86-89c5-792a47dae446 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:28.127931 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89b8f-e812-4f86-89c5-792a47dae446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:28.128386 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b89b8f-e812-4f86-89c5-792a47dae446 admin admin] PATH_INFO: `/v3/projects/9e1acd455c3540be90353dc73fd3bdbb/users/d5a9f5f9cda14111a4a7250495492c16/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:28.146759 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b89b8f-e812-4f86-89c5-792a47dae446 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e1acd455c3540be90353dc73fd3bdbb, user_id=d5a9f5f9cda14111a4a7250495492c16, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:28.149509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b89b8f-e812-4f86-89c5-792a47dae446 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:28.174594 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 930/1868] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:28 2021] PUT /identity/v3/projects/9e1acd455c3540be90353dc73fd3bdbb/users/d5a9f5f9cda14111a4a7250495492c16/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:28.185190 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c187f-7057-49c1-8fdf-6562234ba151 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:28.185500 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c187f-7057-49c1-8fdf-6562234ba151 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:28.185784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7c187f-7057-49c1-8fdf-6562234ba151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:28.237885 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-2b7c187f-7057-49c1-8fdf-6562234ba151 None None] MFA Rules not processed for user `d5a9f5f9cda14111a4a7250495492c16`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:28.239720 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-2b7c187f-7057-49c1-8fdf-6562234ba151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:28.340400 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 939/1869] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:28 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:28.345156 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b89b8f-e812-4f86-89c5-792a47dae446 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:28.439579 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b89b8f-e812-4f86-89c5-792a47dae446 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:28.444919 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccf9bc-1599-430d-9ee9-fcea3c9b4959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:28.445725 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccf9bc-1599-430d-9ee9-fcea3c9b4959 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:28.446040 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccf9bc-1599-430d-9ee9-fcea3c9b4959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:28.446317 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ccf9bc-1599-430d-9ee9-fcea3c9b4959 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:28.447041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccf9bc-1599-430d-9ee9-fcea3c9b4959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:28.448998 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ccf9bc-1599-430d-9ee9-fcea3c9b4959 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:28.485956 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 931/1870] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:28 2021] POST /identity/v3/projects => generated 363 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:28.487530 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c187f-7057-49c1-8fdf-6562234ba151 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:28.501068 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7c187f-7057-49c1-8fdf-6562234ba151 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:28.579642 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5aea1-0834-4840-acd8-a69201ec5b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:28.580887 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5aea1-0834-4840-acd8-a69201ec5b91 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:28.581283 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5aea1-0834-4840-acd8-a69201ec5b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:28.581628 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a5aea1-0834-4840-acd8-a69201ec5b91 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:28.582558 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5aea1-0834-4840-acd8-a69201ec5b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:28.584900 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a5aea1-0834-4840-acd8-a69201ec5b91 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:28.614138 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 940/1871] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:28 2021] POST /identity/v3/users => generated 288 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:28.616050 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccf9bc-1599-430d-9ee9-fcea3c9b4959 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:28.630120 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ccf9bc-1599-430d-9ee9-fcea3c9b4959 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:28.636114 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4721c3-09b9-4fb2-826a-0b87e925df13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:28.637487 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4721c3-09b9-4fb2-826a-0b87e925df13 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:28.637772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4721c3-09b9-4fb2-826a-0b87e925df13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:28.638130 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4721c3-09b9-4fb2-826a-0b87e925df13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:28.639577 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4721c3-09b9-4fb2-826a-0b87e925df13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:28.642149 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4721c3-09b9-4fb2-826a-0b87e925df13 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:28.653899 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 932/1872] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:28 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:14:28.657815 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5aea1-0834-4840-acd8-a69201ec5b91 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:28.673872 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a5aea1-0834-4840-acd8-a69201ec5b91 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:28.680323 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3cb34-b645-4ca3-9141-1fe019aed917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:28.681308 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3cb34-b645-4ca3-9141-1fe019aed917 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:28.681672 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3cb34-b645-4ca3-9141-1fe019aed917 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:28.681874 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3cb34-b645-4ca3-9141-1fe019aed917 admin admin] PATH_INFO: `/v3/projects/dd8fb58756374423a2f09357e26adca4/users/9bea4a5067864f4d9cb0da1d5d24fdb5/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:28.698119 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3cb34-b645-4ca3-9141-1fe019aed917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8fb58756374423a2f09357e26adca4, user_id=9bea4a5067864f4d9cb0da1d5d24fdb5, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:28.700852 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3cb34-b645-4ca3-9141-1fe019aed917 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:28.715950 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 941/1873] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:28 2021] PUT /identity/v3/projects/dd8fb58756374423a2f09357e26adca4/users/9bea4a5067864f4d9cb0da1d5d24fdb5/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:28.720830 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4721c3-09b9-4fb2-826a-0b87e925df13 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:28.736019 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4721c3-09b9-4fb2-826a-0b87e925df13 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:28.814743 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d50b9b-f370-40ae-ae21-2c06d8156365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:28.816128 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d50b9b-f370-40ae-ae21-2c06d8156365 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:28.816542 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d50b9b-f370-40ae-ae21-2c06d8156365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:28.817017 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d50b9b-f370-40ae-ae21-2c06d8156365 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:28.817903 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d50b9b-f370-40ae-ae21-2c06d8156365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:28.819672 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d50b9b-f370-40ae-ae21-2c06d8156365 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:28.838930 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3cb34-b645-4ca3-9141-1fe019aed917 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:28.839129 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 933/1874] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:28 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:28.872049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3cb34-b645-4ca3-9141-1fe019aed917 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:28.883911 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acbe25-9e20-4ebb-8c93-4382e606e82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:28.885235 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acbe25-9e20-4ebb-8c93-4382e606e82b admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:28.885749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acbe25-9e20-4ebb-8c93-4382e606e82b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:28.886022 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17acbe25-9e20-4ebb-8c93-4382e606e82b admin admin] PATH_INFO: `/v3/projects/dd8fb58756374423a2f09357e26adca4/users/9bea4a5067864f4d9cb0da1d5d24fdb5/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:28.889137 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acbe25-9e20-4ebb-8c93-4382e606e82b admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd8fb58756374423a2f09357e26adca4, user_id=9bea4a5067864f4d9cb0da1d5d24fdb5, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:28.892923 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17acbe25-9e20-4ebb-8c93-4382e606e82b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:28.906672 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 942/1875] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:28 2021] PUT /identity/v3/projects/dd8fb58756374423a2f09357e26adca4/users/9bea4a5067864f4d9cb0da1d5d24fdb5/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:28.920837 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3005dd-55a2-435d-944e-5e2ac4141a22 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:28.921574 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3005dd-55a2-435d-944e-5e2ac4141a22 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:28.922468 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3005dd-55a2-435d-944e-5e2ac4141a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:28.955678 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-ab3005dd-55a2-435d-944e-5e2ac4141a22 None None] MFA Rules not processed for user `9bea4a5067864f4d9cb0da1d5d24fdb5`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:28.957506 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-ab3005dd-55a2-435d-944e-5e2ac4141a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:29.046402 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 934/1876] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:28 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:29.059059 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acbe25-9e20-4ebb-8c93-4382e606e82b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:29.061055 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-17acbe25-9e20-4ebb-8c93-4382e606e82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:29.070762 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3005dd-55a2-435d-944e-5e2ac4141a22 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:29.078852 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-ab3005dd-55a2-435d-944e-5e2ac4141a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:29.141844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17acbe25-9e20-4ebb-8c93-4382e606e82b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:29.147828 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b1de2-2f62-4cbe-92a4-8bcd39b21d6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:29.148825 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b1de2-2f62-4cbe-92a4-8bcd39b21d6b service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:29.149257 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b1de2-2f62-4cbe-92a4-8bcd39b21d6b service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:29.149757 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b1de2-2f62-4cbe-92a4-8bcd39b21d6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:29.158393 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3005dd-55a2-435d-944e-5e2ac4141a22 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:29.160306 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b1de2-2f62-4cbe-92a4-8bcd39b21d6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:29.161902 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b1de2-2f62-4cbe-92a4-8bcd39b21d6b service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:29.163700 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef77382-1010-4d59-8f6f-c9868980c4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:29.164669 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef77382-1010-4d59-8f6f-c9868980c4d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:29.165197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef77382-1010-4d59-8f6f-c9868980c4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:29.165548 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef77382-1010-4d59-8f6f-c9868980c4d9 admin admin] PATH_INFO: `/v3/users/e99687be627d4a07a72a2e531d186f2a` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:29.167047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef77382-1010-4d59-8f6f-c9868980c4d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e99687be627d4a07a72a2e531d186f2a)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:29.169157 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef77382-1010-4d59-8f6f-c9868980c4d9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:29.173403 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 943/1877] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:29 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:29.292994 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-9ef77382-1010-4d59-8f6f-c9868980c4d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e99687be627d4a07a72a2e531d186f2a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:29.303567 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-9ef77382-1010-4d59-8f6f-c9868980c4d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e99687be627d4a07a72a2e531d186f2a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:29.308963 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b1de2-2f62-4cbe-92a4-8bcd39b21d6b service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:29.311746 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-9ef77382-1010-4d59-8f6f-c9868980c4d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e99687be627d4a07a72a2e531d186f2a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:29.312604 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-9ef77382-1010-4d59-8f6f-c9868980c4d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e99687be627d4a07a72a2e531d186f2a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:29.319216 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b1de2-2f62-4cbe-92a4-8bcd39b21d6b service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:29.323268 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc25698-2df4-4d32-9a0f-a84b0749204d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:29.324097 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc25698-2df4-4d32-9a0f-a84b0749204d service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:29.324365 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc25698-2df4-4d32-9a0f-a84b0749204d service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:29.324934 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc25698-2df4-4d32-9a0f-a84b0749204d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:29.326547 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-9ef77382-1010-4d59-8f6f-c9868980c4d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e99687be627d4a07a72a2e531d186f2a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:29.326796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-7fc25698-2df4-4d32-9a0f-a84b0749204d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:29.340105 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 935/1878] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:29 2021] DELETE /identity/v3/users/e99687be627d4a07a72a2e531d186f2a => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:29.404279 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc25698-2df4-4d32-9a0f-a84b0749204d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:29.405750 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc25698-2df4-4d32-9a0f-a84b0749204d service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:29.416569 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 944/1879] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:29 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:14:29.544991 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef77382-1010-4d59-8f6f-c9868980c4d9 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:29.546455 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-9ef77382-1010-4d59-8f6f-c9868980c4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:29.689587 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef77382-1010-4d59-8f6f-c9868980c4d9 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:29.694189 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc6e38a-e52d-4155-8c00-30a91e4fefb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:29.695700 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6e38a-e52d-4155-8c00-30a91e4fefb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:29.695982 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6e38a-e52d-4155-8c00-30a91e4fefb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:29.696321 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc6e38a-e52d-4155-8c00-30a91e4fefb6 admin admin] PATH_INFO: `/v3/projects/ac038ab1a550470794e72da5c1ac3951` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:29.697592 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6e38a-e52d-4155-8c00-30a91e4fefb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac038ab1a550470794e72da5c1ac3951)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:29.699717 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc6e38a-e52d-4155-8c00-30a91e4fefb6 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:29.755620 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bdc6e38a-e52d-4155-8c00-30a91e4fefb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac038ab1a550470794e72da5c1ac3951', 'request_id': 'req-bdc6e38a-e52d-4155-8c00-30a91e4fefb6'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:29.766732 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bdc6e38a-e52d-4155-8c00-30a91e4fefb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac038ab1a550470794e72da5c1ac3951', 'request_id': 'req-bdc6e38a-e52d-4155-8c00-30a91e4fefb6'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:29.776334 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bdc6e38a-e52d-4155-8c00-30a91e4fefb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac038ab1a550470794e72da5c1ac3951', 'request_id': 'req-bdc6e38a-e52d-4155-8c00-30a91e4fefb6'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:29.792211 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bdc6e38a-e52d-4155-8c00-30a91e4fefb6 admin admin] The token cache is being invalidate because project ac038ab1a550470794e72da5c1ac3951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:29.792507 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bdc6e38a-e52d-4155-8c00-30a91e4fefb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:29.793175 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bdc6e38a-e52d-4155-8c00-30a91e4fefb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:29.794779 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 936/1880] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:29 2021] DELETE /identity/v3/projects/ac038ab1a550470794e72da5c1ac3951 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:29.801130 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f451c-1fa0-494d-b630-27faf4db3779 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:29.801416 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f451c-1fa0-494d-b630-27faf4db3779 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:29.801692 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f451c-1fa0-494d-b630-27faf4db3779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:29.819323 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-8f3f451c-1fa0-494d-b630-27faf4db3779 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:29.820611 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-8f3f451c-1fa0-494d-b630-27faf4db3779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:29.881557 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 945/1881] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:29.888869 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f762fe-5427-4428-9fff-70f161d0ac52 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:29.889766 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f762fe-5427-4428-9fff-70f161d0ac52 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:29.890090 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f762fe-5427-4428-9fff-70f161d0ac52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:29.911831 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-52f762fe-5427-4428-9fff-70f161d0ac52 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:29.913579 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-52f762fe-5427-4428-9fff-70f161d0ac52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:29.924897 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 937/1882] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:29.926145 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f451c-1fa0-494d-b630-27faf4db3779 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:29.937436 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f451c-1fa0-494d-b630-27faf4db3779 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:29.942528 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb77a87-4bb9-44fc-83cb-d69f76236e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:29.942937 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb77a87-4bb9-44fc-83cb-d69f76236e95 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:29.943363 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb77a87-4bb9-44fc-83cb-d69f76236e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:29.943540 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb77a87-4bb9-44fc-83cb-d69f76236e95 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:29.944542 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb77a87-4bb9-44fc-83cb-d69f76236e95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:14:29.944872 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb77a87-4bb9-44fc-83cb-d69f76236e95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:29.946909 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb77a87-4bb9-44fc-83cb-d69f76236e95 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:29.962784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 946/1883] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:14:29 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:14:29.966929 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f762fe-5427-4428-9fff-70f161d0ac52 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:29.976908 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f762fe-5427-4428-9fff-70f161d0ac52 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:29.982247 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fade3-a9e6-46b8-ad89-0b0596d47423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:29.983246 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fade3-a9e6-46b8-ad89-0b0596d47423 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:29.983526 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fade3-a9e6-46b8-ad89-0b0596d47423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:29.984000 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3fade3-a9e6-46b8-ad89-0b0596d47423 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:29.984750 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fade3-a9e6-46b8-ad89-0b0596d47423 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:29.986673 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3fade3-a9e6-46b8-ad89-0b0596d47423 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:30.025949 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 938/1884] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:29 2021] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:30.027104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb77a87-4bb9-44fc-83cb-d69f76236e95 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:30.039064 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb77a87-4bb9-44fc-83cb-d69f76236e95 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:30.119601 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba881f6-4e45-4a2b-bc6b-c68adf176d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:30.120327 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba881f6-4e45-4a2b-bc6b-c68adf176d0e admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:30.121023 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba881f6-4e45-4a2b-bc6b-c68adf176d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:30.121540 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba881f6-4e45-4a2b-bc6b-c68adf176d0e admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:30.122601 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba881f6-4e45-4a2b-bc6b-c68adf176d0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:30.124702 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba881f6-4e45-4a2b-bc6b-c68adf176d0e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:30.155924 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fade3-a9e6-46b8-ad89-0b0596d47423 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:30.158114 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 947/1885] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:30 2021] POST /identity/v3/users => generated 285 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:14:30.174347 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3fade3-a9e6-46b8-ad89-0b0596d47423 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:30.180914 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834eb323-8127-4213-86b7-e39a8c604423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:30.181650 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eb323-8127-4213-86b7-e39a8c604423 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:30.182074 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eb323-8127-4213-86b7-e39a8c604423 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:30.182594 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834eb323-8127-4213-86b7-e39a8c604423 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:30.189718 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834eb323-8127-4213-86b7-e39a8c604423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:30.191569 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834eb323-8127-4213-86b7-e39a8c604423 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:30.209954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 939/1886] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:30 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:14:30.213086 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba881f6-4e45-4a2b-bc6b-c68adf176d0e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:30.225562 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba881f6-4e45-4a2b-bc6b-c68adf176d0e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:30.230675 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb80b00-b067-41ab-adcb-4d0800726871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:30.231379 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb80b00-b067-41ab-adcb-4d0800726871 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:30.231666 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb80b00-b067-41ab-adcb-4d0800726871 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:30.231950 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb80b00-b067-41ab-adcb-4d0800726871 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:30.232921 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb80b00-b067-41ab-adcb-4d0800726871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:30.234833 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb80b00-b067-41ab-adcb-4d0800726871 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:30.250344 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 948/1887] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:30 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:30.252468 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834eb323-8127-4213-86b7-e39a8c604423 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:30.270001 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834eb323-8127-4213-86b7-e39a8c604423 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:30.278765 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f0cd7-1353-4ba3-aaf0-0736aff2ddfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:30.279651 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f0cd7-1353-4ba3-aaf0-0736aff2ddfc admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:30.279937 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f0cd7-1353-4ba3-aaf0-0736aff2ddfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:30.280215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f0cd7-1353-4ba3-aaf0-0736aff2ddfc admin admin] PATH_INFO: `/v3/projects/e0a255264a9d4006b443873b64738069/users/7f8ed256a4df4f6cabe18805ff506e98/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:30.299968 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f0cd7-1353-4ba3-aaf0-0736aff2ddfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a255264a9d4006b443873b64738069, user_id=7f8ed256a4df4f6cabe18805ff506e98, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:30.303313 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f0cd7-1353-4ba3-aaf0-0736aff2ddfc admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:30.317983 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 940/1888] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:30 2021] PUT /identity/v3/projects/e0a255264a9d4006b443873b64738069/users/7f8ed256a4df4f6cabe18805ff506e98/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:30.367681 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ad419-5e9a-49f9-8449-585cd4ace751 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:30.367949 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ad419-5e9a-49f9-8449-585cd4ace751 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:30.368224 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ad419-5e9a-49f9-8449-585cd4ace751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:30.404991 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-529ad419-5e9a-49f9-8449-585cd4ace751 None None] MFA Rules not processed for user `7f8ed256a4df4f6cabe18805ff506e98`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:30.405466 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-529ad419-5e9a-49f9-8449-585cd4ace751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:30.504583 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 949/1889] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:30 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:30.512317 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f0cd7-1353-4ba3-aaf0-0736aff2ddfc admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:30.583877 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f0cd7-1353-4ba3-aaf0-0736aff2ddfc admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:30.588857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7d725-1a34-48bf-85af-83b273752ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:30.589501 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7d725-1a34-48bf-85af-83b273752ede admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:30.589771 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7d725-1a34-48bf-85af-83b273752ede admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:30.590078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c7d725-1a34-48bf-85af-83b273752ede admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:30.590811 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7d725-1a34-48bf-85af-83b273752ede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:30.592701 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c7d725-1a34-48bf-85af-83b273752ede admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:30.618279 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 941/1890] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:30 2021] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:14:30.622289 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ad419-5e9a-49f9-8449-585cd4ace751 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:30.633482 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ad419-5e9a-49f9-8449-585cd4ace751 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:30.701029 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726db801-50e7-4f87-9593-f21688da39e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:30.701720 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726db801-50e7-4f87-9593-f21688da39e8 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:30.702039 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726db801-50e7-4f87-9593-f21688da39e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:30.702320 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726db801-50e7-4f87-9593-f21688da39e8 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:30.703507 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726db801-50e7-4f87-9593-f21688da39e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:30.705769 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726db801-50e7-4f87-9593-f21688da39e8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:30.732177 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 950/1891] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:30 2021] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:30.733249 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7d725-1a34-48bf-85af-83b273752ede admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:30.746011 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c7d725-1a34-48bf-85af-83b273752ede admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:30.752501 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2bb84-16b2-4146-aa55-0d5d006c4f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:30.753300 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2bb84-16b2-4146-aa55-0d5d006c4f7a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:30.753588 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2bb84-16b2-4146-aa55-0d5d006c4f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:30.753899 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb2bb84-16b2-4146-aa55-0d5d006c4f7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:30.760146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2bb84-16b2-4146-aa55-0d5d006c4f7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:30.772368 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb2bb84-16b2-4146-aa55-0d5d006c4f7a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:30.794450 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 942/1892] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:30 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:30.803066 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726db801-50e7-4f87-9593-f21688da39e8 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:30.814432 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726db801-50e7-4f87-9593-f21688da39e8 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:30.821903 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb89d4-e0e3-4f6a-8fe0-fdab1a0e0b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:30.823226 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb89d4-e0e3-4f6a-8fe0-fdab1a0e0b58 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:30.823446 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb89d4-e0e3-4f6a-8fe0-fdab1a0e0b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:30.823714 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bb89d4-e0e3-4f6a-8fe0-fdab1a0e0b58 admin admin] PATH_INFO: `/v3/projects/f22f8bdc7e3f41cfb35fbccc0446c83b/users/08d94e885b524292b355f26dbbedf370/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:30.851122 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb89d4-e0e3-4f6a-8fe0-fdab1a0e0b58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22f8bdc7e3f41cfb35fbccc0446c83b, user_id=08d94e885b524292b355f26dbbedf370, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:30.853908 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bb89d4-e0e3-4f6a-8fe0-fdab1a0e0b58 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:30.870672 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 951/1893] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:30 2021] PUT /identity/v3/projects/f22f8bdc7e3f41cfb35fbccc0446c83b/users/08d94e885b524292b355f26dbbedf370/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:30.879973 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2bb84-16b2-4146-aa55-0d5d006c4f7a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:30.892390 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb2bb84-16b2-4146-aa55-0d5d006c4f7a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:30.966564 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b5a7c1-ffbb-487e-8e8e-e01245d0136b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:30.967236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5a7c1-ffbb-487e-8e8e-e01245d0136b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:30.967672 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5a7c1-ffbb-487e-8e8e-e01245d0136b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:30.967949 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b5a7c1-ffbb-487e-8e8e-e01245d0136b admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:30.968694 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5a7c1-ffbb-487e-8e8e-e01245d0136b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:30.970331 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b5a7c1-ffbb-487e-8e8e-e01245d0136b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:30.981552 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 943/1894] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:30 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:30.985723 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb89d4-e0e3-4f6a-8fe0-fdab1a0e0b58 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:30.996515 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bb89d4-e0e3-4f6a-8fe0-fdab1a0e0b58 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:31.001079 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71776595-5fed-448a-b021-91f5a1c6faf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:31.001974 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71776595-5fed-448a-b021-91f5a1c6faf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:31.002258 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71776595-5fed-448a-b021-91f5a1c6faf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:31.002532 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71776595-5fed-448a-b021-91f5a1c6faf2 admin admin] PATH_INFO: `/v3/projects/f22f8bdc7e3f41cfb35fbccc0446c83b/users/08d94e885b524292b355f26dbbedf370/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:31.005162 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71776595-5fed-448a-b021-91f5a1c6faf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22f8bdc7e3f41cfb35fbccc0446c83b, user_id=08d94e885b524292b355f26dbbedf370, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:31.007839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71776595-5fed-448a-b021-91f5a1c6faf2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:31.017964 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 952/1895] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:30 2021] PUT /identity/v3/projects/f22f8bdc7e3f41cfb35fbccc0446c83b/users/08d94e885b524292b355f26dbbedf370/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:31.034163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23e10f-6096-4369-88b9-716ee4759db5 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:31.034163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23e10f-6096-4369-88b9-716ee4759db5 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:31.034163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f23e10f-6096-4369-88b9-716ee4759db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:31.058833 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-3f23e10f-6096-4369-88b9-716ee4759db5 None None] MFA Rules not processed for user `08d94e885b524292b355f26dbbedf370`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:31.060050 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3f23e10f-6096-4369-88b9-716ee4759db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:31.140566 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 944/1896] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:31 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:31.148181 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71776595-5fed-448a-b021-91f5a1c6faf2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:31.149843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-71776595-5fed-448a-b021-91f5a1c6faf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:31.212067 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71776595-5fed-448a-b021-91f5a1c6faf2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:31.215728 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04265c7c-fc7d-4d58-9549-7cebba49ecd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:31.216378 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04265c7c-fc7d-4d58-9549-7cebba49ecd3 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:31.216661 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04265c7c-fc7d-4d58-9549-7cebba49ecd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:31.216937 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04265c7c-fc7d-4d58-9549-7cebba49ecd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:31.226505 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04265c7c-fc7d-4d58-9549-7cebba49ecd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:31.228346 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04265c7c-fc7d-4d58-9549-7cebba49ecd3 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:31.240065 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 953/1897] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:31 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:14:31.289979 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23e10f-6096-4369-88b9-716ee4759db5 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:31.291457 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3f23e10f-6096-4369-88b9-716ee4759db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:31.304200 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f23e10f-6096-4369-88b9-716ee4759db5 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:31.307832 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e4b840-15ac-4303-a901-efdad8ff0e85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:31.308471 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4b840-15ac-4303-a901-efdad8ff0e85 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:31.308819 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4b840-15ac-4303-a901-efdad8ff0e85 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:31.309022 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e4b840-15ac-4303-a901-efdad8ff0e85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:31.370680 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4b840-15ac-4303-a901-efdad8ff0e85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:31.372476 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e4b840-15ac-4303-a901-efdad8ff0e85 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:31.384794 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 945/1898] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:31 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:14:32.255743 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04265c7c-fc7d-4d58-9549-7cebba49ecd3 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:32.257548 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-04265c7c-fc7d-4d58-9549-7cebba49ecd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:32.320745 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04265c7c-fc7d-4d58-9549-7cebba49ecd3 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:32.325358 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2fc11-45f7-46d4-8145-41feb8c48c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:32.326268 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2fc11-45f7-46d4-8145-41feb8c48c1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:32.326546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2fc11-45f7-46d4-8145-41feb8c48c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:32.326821 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa2fc11-45f7-46d4-8145-41feb8c48c1c admin admin] PATH_INFO: `/v3/users/d5a9f5f9cda14111a4a7250495492c16` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:32.328012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2fc11-45f7-46d4-8145-41feb8c48c1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5a9f5f9cda14111a4a7250495492c16)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:32.329943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa2fc11-45f7-46d4-8145-41feb8c48c1c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:32.380242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cfa2fc11-45f7-46d4-8145-41feb8c48c1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5a9f5f9cda14111a4a7250495492c16'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:32.381137 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cfa2fc11-45f7-46d4-8145-41feb8c48c1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5a9f5f9cda14111a4a7250495492c16'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:32.396411 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cfa2fc11-45f7-46d4-8145-41feb8c48c1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5a9f5f9cda14111a4a7250495492c16'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:32.397148 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cfa2fc11-45f7-46d4-8145-41feb8c48c1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5a9f5f9cda14111a4a7250495492c16'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:32.404726 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cfa2fc11-45f7-46d4-8145-41feb8c48c1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5a9f5f9cda14111a4a7250495492c16'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:32.418025 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 954/1899] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:32 2021] DELETE /identity/v3/users/d5a9f5f9cda14111a4a7250495492c16 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:32.422413 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2360b-7844-4864-a6bf-a20d43bf64b5 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:32.422856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2360b-7844-4864-a6bf-a20d43bf64b5 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:32.423044 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2360b-7844-4864-a6bf-a20d43bf64b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:32.439452 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-94f2360b-7844-4864-a6bf-a20d43bf64b5 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:32.440633 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-94f2360b-7844-4864-a6bf-a20d43bf64b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:32.497481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 946/1900] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:32.507716 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2fc11-45f7-46d4-8145-41feb8c48c1c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:32.509136 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-cfa2fc11-45f7-46d4-8145-41feb8c48c1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:32.565585 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa2fc11-45f7-46d4-8145-41feb8c48c1c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:32.569685 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a2be1-fb15-4330-8196-9f9b475be19d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:32.570360 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a2be1-fb15-4330-8196-9f9b475be19d service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:32.570639 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a2be1-fb15-4330-8196-9f9b475be19d service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:32.570909 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52a2be1-fb15-4330-8196-9f9b475be19d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:32.579932 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a2be1-fb15-4330-8196-9f9b475be19d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:32.583619 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52a2be1-fb15-4330-8196-9f9b475be19d service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:32.593662 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 955/1901] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:32.899034 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2360b-7844-4864-a6bf-a20d43bf64b5 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:32.901227 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-94f2360b-7844-4864-a6bf-a20d43bf64b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:32.930094 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2360b-7844-4864-a6bf-a20d43bf64b5 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:32.934631 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ac962-dbf5-43e4-90e7-1f358ffbfd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:32.935578 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ac962-dbf5-43e4-90e7-1f358ffbfd62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:32.935936 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ac962-dbf5-43e4-90e7-1f358ffbfd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:32.936304 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ac962-dbf5-43e4-90e7-1f358ffbfd62 admin admin] PATH_INFO: `/v3/projects/9e1acd455c3540be90353dc73fd3bdbb` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:32.937725 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ac962-dbf5-43e4-90e7-1f358ffbfd62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e1acd455c3540be90353dc73fd3bdbb)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:32.939894 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ac962-dbf5-43e4-90e7-1f358ffbfd62 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:32.994647 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-4d2ac962-dbf5-43e4-90e7-1f358ffbfd62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e1acd455c3540be90353dc73fd3bdbb', 'request_id': 'req-4d2ac962-dbf5-43e4-90e7-1f358ffbfd62'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:33.000985 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-4d2ac962-dbf5-43e4-90e7-1f358ffbfd62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e1acd455c3540be90353dc73fd3bdbb', 'request_id': 'req-4d2ac962-dbf5-43e4-90e7-1f358ffbfd62'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:33.010273 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-4d2ac962-dbf5-43e4-90e7-1f358ffbfd62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e1acd455c3540be90353dc73fd3bdbb', 'request_id': 'req-4d2ac962-dbf5-43e4-90e7-1f358ffbfd62'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:33.022750 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-4d2ac962-dbf5-43e4-90e7-1f358ffbfd62 admin admin] The token cache is being invalidate because project 9e1acd455c3540be90353dc73fd3bdbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:33.023067 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-4d2ac962-dbf5-43e4-90e7-1f358ffbfd62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:33.023801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-4d2ac962-dbf5-43e4-90e7-1f358ffbfd62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:33.025830 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 947/1902] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:32 2021] DELETE /identity/v3/projects/9e1acd455c3540be90353dc73fd3bdbb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:33.030314 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a2be1-fb15-4330-8196-9f9b475be19d service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:33.041494 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52a2be1-fb15-4330-8196-9f9b475be19d service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:33.107703 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0cec9-cf2f-4d02-a786-f37e8dec368d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:33.108584 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0cec9-cf2f-4d02-a786-f37e8dec368d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:33.108868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0cec9-cf2f-4d02-a786-f37e8dec368d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:33.109144 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0cec9-cf2f-4d02-a786-f37e8dec368d admin admin] PATH_INFO: `/v3/users/9bea4a5067864f4d9cb0da1d5d24fdb5` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:33.111371 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0cec9-cf2f-4d02-a786-f37e8dec368d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bea4a5067864f4d9cb0da1d5d24fdb5)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:33.114362 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0cec9-cf2f-4d02-a786-f37e8dec368d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:33.199806 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-96e0cec9-cf2f-4d02-a786-f37e8dec368d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bea4a5067864f4d9cb0da1d5d24fdb5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:33.201142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-96e0cec9-cf2f-4d02-a786-f37e8dec368d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bea4a5067864f4d9cb0da1d5d24fdb5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:33.229240 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-96e0cec9-cf2f-4d02-a786-f37e8dec368d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bea4a5067864f4d9cb0da1d5d24fdb5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:33.230005 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-96e0cec9-cf2f-4d02-a786-f37e8dec368d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bea4a5067864f4d9cb0da1d5d24fdb5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:33.239312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-96e0cec9-cf2f-4d02-a786-f37e8dec368d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bea4a5067864f4d9cb0da1d5d24fdb5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:33.254633 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 956/1903] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:33 2021] DELETE /identity/v3/users/9bea4a5067864f4d9cb0da1d5d24fdb5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:33.698016 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ac962-dbf5-43e4-90e7-1f358ffbfd62 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:33.699546 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-4d2ac962-dbf5-43e4-90e7-1f358ffbfd62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:33.716205 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ac962-dbf5-43e4-90e7-1f358ffbfd62 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:33.778450 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c6d68-d0b6-4ff1-b3f0-0739cfade43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:33.779509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c6d68-d0b6-4ff1-b3f0-0739cfade43c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:33.779781 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c6d68-d0b6-4ff1-b3f0-0739cfade43c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:33.780069 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c6d68-d0b6-4ff1-b3f0-0739cfade43c admin admin] PATH_INFO: `/v3/projects/dd8fb58756374423a2f09357e26adca4` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:33.781292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c6d68-d0b6-4ff1-b3f0-0739cfade43c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd8fb58756374423a2f09357e26adca4)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:33.783297 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c6d68-d0b6-4ff1-b3f0-0739cfade43c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:33.836918 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d71c6d68-d0b6-4ff1-b3f0-0739cfade43c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd8fb58756374423a2f09357e26adca4', 'request_id': 'req-d71c6d68-d0b6-4ff1-b3f0-0739cfade43c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:33.843369 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d71c6d68-d0b6-4ff1-b3f0-0739cfade43c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd8fb58756374423a2f09357e26adca4', 'request_id': 'req-d71c6d68-d0b6-4ff1-b3f0-0739cfade43c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:33.852218 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d71c6d68-d0b6-4ff1-b3f0-0739cfade43c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd8fb58756374423a2f09357e26adca4', 'request_id': 'req-d71c6d68-d0b6-4ff1-b3f0-0739cfade43c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:33.864665 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d71c6d68-d0b6-4ff1-b3f0-0739cfade43c admin admin] The token cache is being invalidate because project dd8fb58756374423a2f09357e26adca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:33.864960 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d71c6d68-d0b6-4ff1-b3f0-0739cfade43c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:33.865613 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d71c6d68-d0b6-4ff1-b3f0-0739cfade43c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:33.867170 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 948/1904] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:33 2021] DELETE /identity/v3/projects/dd8fb58756374423a2f09357e26adca4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:33.873273 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3457264-6172-4154-8553-8ab825256d24 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:33.873737 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3457264-6172-4154-8553-8ab825256d24 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:33.874022 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3457264-6172-4154-8553-8ab825256d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:33.892274 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-b3457264-6172-4154-8553-8ab825256d24 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:33.893984 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b3457264-6172-4154-8553-8ab825256d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:33.952642 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 957/1905] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:33.960521 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516fd57-704a-4c02-9c66-42e56e7660b6 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:33.960815 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516fd57-704a-4c02-9c66-42e56e7660b6 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:33.961105 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516fd57-704a-4c02-9c66-42e56e7660b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:33.979638 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-c516fd57-704a-4c02-9c66-42e56e7660b6 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:33.980840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-c516fd57-704a-4c02-9c66-42e56e7660b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:33.989430 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 949/1906] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:33.993575 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3457264-6172-4154-8553-8ab825256d24 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:34.003476 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3457264-6172-4154-8553-8ab825256d24 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:34.008044 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd38f1-9671-4813-8572-848fab5ed4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:34.008693 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd38f1-9671-4813-8572-848fab5ed4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:34.008976 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd38f1-9671-4813-8572-848fab5ed4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:34.009249 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd38f1-9671-4813-8572-848fab5ed4e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:34.010049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd38f1-9671-4813-8572-848fab5ed4e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:14:34.010416 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd38f1-9671-4813-8572-848fab5ed4e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:34.012021 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd38f1-9671-4813-8572-848fab5ed4e0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:34.023054 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 958/1907] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:14:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:14:34.027404 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516fd57-704a-4c02-9c66-42e56e7660b6 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:34.037017 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516fd57-704a-4c02-9c66-42e56e7660b6 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:34.041822 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3be5af-96da-4b3e-a06f-f55d08cc2c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:34.042495 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3be5af-96da-4b3e-a06f-f55d08cc2c97 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:34.042781 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3be5af-96da-4b3e-a06f-f55d08cc2c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:34.043092 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3be5af-96da-4b3e-a06f-f55d08cc2c97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:34.043781 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3be5af-96da-4b3e-a06f-f55d08cc2c97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:34.045724 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3be5af-96da-4b3e-a06f-f55d08cc2c97 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:34.077423 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 950/1908] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:34 2021] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:14:34.081860 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd38f1-9671-4813-8572-848fab5ed4e0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:34.091966 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd38f1-9671-4813-8572-848fab5ed4e0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:34.150419 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb018f5-350b-4375-bd95-54b856479b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:34.151095 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb018f5-350b-4375-bd95-54b856479b11 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:34.151379 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb018f5-350b-4375-bd95-54b856479b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:34.151655 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb018f5-350b-4375-bd95-54b856479b11 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:34.152353 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb018f5-350b-4375-bd95-54b856479b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:34.154323 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb018f5-350b-4375-bd95-54b856479b11 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:34.174583 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 959/1909] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:34 2021] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:34.179341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3be5af-96da-4b3e-a06f-f55d08cc2c97 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:34.189680 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3be5af-96da-4b3e-a06f-f55d08cc2c97 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:34.194457 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e86526-647f-4ffe-8e5f-07562d139855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:34.195115 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e86526-647f-4ffe-8e5f-07562d139855 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:34.195403 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e86526-647f-4ffe-8e5f-07562d139855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:34.195674 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e86526-647f-4ffe-8e5f-07562d139855 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:34.196417 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e86526-647f-4ffe-8e5f-07562d139855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:34.198061 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e86526-647f-4ffe-8e5f-07562d139855 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:34.209434 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 951/1910] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:34 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:34.213158 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb018f5-350b-4375-bd95-54b856479b11 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:34.223771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb018f5-350b-4375-bd95-54b856479b11 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:34.228779 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3e5c6-3e1e-476b-be6b-f98ab7880d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:34.229451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3e5c6-3e1e-476b-be6b-f98ab7880d3c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:34.229732 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3e5c6-3e1e-476b-be6b-f98ab7880d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:34.230035 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3e5c6-3e1e-476b-be6b-f98ab7880d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:34.230775 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3e5c6-3e1e-476b-be6b-f98ab7880d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:34.232360 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3e5c6-3e1e-476b-be6b-f98ab7880d3c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:34.242579 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 960/1911] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:34 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:14:34.246691 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e86526-647f-4ffe-8e5f-07562d139855 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:34.256811 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e86526-647f-4ffe-8e5f-07562d139855 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:34.261435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581145c-e4b3-4b24-89e6-861b3f5e631f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:34.262357 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581145c-e4b3-4b24-89e6-861b3f5e631f admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:34.262639 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581145c-e4b3-4b24-89e6-861b3f5e631f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:34.263134 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d581145c-e4b3-4b24-89e6-861b3f5e631f admin admin] PATH_INFO: `/v3/projects/8f9b04b390064205be22d86d9975bf0c/users/080874056dca4f4ab4c1a025722d3112/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:34.278598 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581145c-e4b3-4b24-89e6-861b3f5e631f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f9b04b390064205be22d86d9975bf0c, user_id=080874056dca4f4ab4c1a025722d3112, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:34.281394 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d581145c-e4b3-4b24-89e6-861b3f5e631f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:34.299608 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 952/1912] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:34 2021] PUT /identity/v3/projects/8f9b04b390064205be22d86d9975bf0c/users/080874056dca4f4ab4c1a025722d3112/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:34.309519 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cee68-aa28-420a-88ed-71a3e8754a7a None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:34.310050 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cee68-aa28-420a-88ed-71a3e8754a7a None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:34.310352 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221cee68-aa28-420a-88ed-71a3e8754a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:34.343150 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-221cee68-aa28-420a-88ed-71a3e8754a7a None None] MFA Rules not processed for user `080874056dca4f4ab4c1a025722d3112`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:34.344697 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-221cee68-aa28-420a-88ed-71a3e8754a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:34.431019 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 961/1913] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:34 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:34.435611 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581145c-e4b3-4b24-89e6-861b3f5e631f admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:34.514652 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d581145c-e4b3-4b24-89e6-861b3f5e631f admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:34.520953 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958929a-ec06-433e-959d-2ebfd79a12c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:34.522091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958929a-ec06-433e-959d-2ebfd79a12c2 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:34.522586 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958929a-ec06-433e-959d-2ebfd79a12c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:34.522971 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958929a-ec06-433e-959d-2ebfd79a12c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:34.523872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958929a-ec06-433e-959d-2ebfd79a12c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:34.526073 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958929a-ec06-433e-959d-2ebfd79a12c2 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:34.561825 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 953/1914] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:34 2021] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:34.566478 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cee68-aa28-420a-88ed-71a3e8754a7a None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:34.582502 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221cee68-aa28-420a-88ed-71a3e8754a7a None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:34.641589 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09781a1d-fd94-44db-b62a-73d4237cf351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:34.642710 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09781a1d-fd94-44db-b62a-73d4237cf351 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:34.643243 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09781a1d-fd94-44db-b62a-73d4237cf351 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:34.643543 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09781a1d-fd94-44db-b62a-73d4237cf351 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:34.644224 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09781a1d-fd94-44db-b62a-73d4237cf351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:34.646861 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09781a1d-fd94-44db-b62a-73d4237cf351 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:34.669169 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 962/1915] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:34 2021] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:34.674369 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958929a-ec06-433e-959d-2ebfd79a12c2 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:34.685435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958929a-ec06-433e-959d-2ebfd79a12c2 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:34.694301 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c810c1-97a1-43c6-bf50-7ae316217afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:34.695015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c810c1-97a1-43c6-bf50-7ae316217afd admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:34.695395 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c810c1-97a1-43c6-bf50-7ae316217afd admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:34.695718 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c810c1-97a1-43c6-bf50-7ae316217afd admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:34.696516 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c810c1-97a1-43c6-bf50-7ae316217afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:34.698926 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c810c1-97a1-43c6-bf50-7ae316217afd admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:34.716329 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 954/1916] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:34 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:34.718158 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09781a1d-fd94-44db-b62a-73d4237cf351 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:34.733051 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09781a1d-fd94-44db-b62a-73d4237cf351 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:34.742342 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d893d6f-95d3-4611-bde9-f5746a8ca432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:34.743265 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d893d6f-95d3-4611-bde9-f5746a8ca432 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:34.743551 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d893d6f-95d3-4611-bde9-f5746a8ca432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:34.743875 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d893d6f-95d3-4611-bde9-f5746a8ca432 admin admin] PATH_INFO: `/v3/projects/35196f210be845708c8cab11845cc92c/users/c8618e4258de456aafc896eff8f222a4/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:34.761843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d893d6f-95d3-4611-bde9-f5746a8ca432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35196f210be845708c8cab11845cc92c, user_id=c8618e4258de456aafc896eff8f222a4, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:34.764761 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d893d6f-95d3-4611-bde9-f5746a8ca432 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:34.781412 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 963/1917] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:34 2021] PUT /identity/v3/projects/35196f210be845708c8cab11845cc92c/users/c8618e4258de456aafc896eff8f222a4/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:34.786614 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c810c1-97a1-43c6-bf50-7ae316217afd admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:34.801709 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c810c1-97a1-43c6-bf50-7ae316217afd admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:34.818098 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d893d6f-95d3-4611-bde9-f5746a8ca432 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:34.820573 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-7d893d6f-95d3-4611-bde9-f5746a8ca432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:34.862771 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dc5d1-78b1-432f-bbd7-d6784b28c3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:34.863732 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dc5d1-78b1-432f-bbd7-d6784b28c3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:34.863732 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dc5d1-78b1-432f-bbd7-d6784b28c3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:34.863948 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dc5d1-78b1-432f-bbd7-d6784b28c3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:34.864954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00dc5d1-78b1-432f-bbd7-d6784b28c3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:34.866936 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00dc5d1-78b1-432f-bbd7-d6784b28c3a4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:34.887427 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 955/1918] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:34 2021] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:34.888832 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dc5d1-78b1-432f-bbd7-d6784b28c3a4 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:34.899019 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d893d6f-95d3-4611-bde9-f5746a8ca432 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:34.902479 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dc5d1-78b1-432f-bbd7-d6784b28c3a4 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:34.907904 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f725a-4930-4111-9dff-26ac0e4c3b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:34.909308 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f725a-4930-4111-9dff-26ac0e4c3b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:34.909745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f725a-4930-4111-9dff-26ac0e4c3b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:34.910127 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1f168-853a-4542-9c52-9fa2dd7536d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:34.910563 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f725a-4930-4111-9dff-26ac0e4c3b78 admin admin] PATH_INFO: `/v3/projects/35196f210be845708c8cab11845cc92c/users/c8618e4258de456aafc896eff8f222a4/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:34.911593 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1f168-853a-4542-9c52-9fa2dd7536d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:34.912506 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1f168-853a-4542-9c52-9fa2dd7536d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:34.913003 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1f168-853a-4542-9c52-9fa2dd7536d5 admin admin] PATH_INFO: `/v3/users/7f8ed256a4df4f6cabe18805ff506e98` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:34.913413 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f725a-4930-4111-9dff-26ac0e4c3b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35196f210be845708c8cab11845cc92c, user_id=c8618e4258de456aafc896eff8f222a4, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:34.914826 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1f168-853a-4542-9c52-9fa2dd7536d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f8ed256a4df4f6cabe18805ff506e98)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:34.917057 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0f725a-4930-4111-9dff-26ac0e4c3b78 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:34.925911 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1f168-853a-4542-9c52-9fa2dd7536d5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:34.933985 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 956/1919] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:34 2021] PUT /identity/v3/projects/35196f210be845708c8cab11845cc92c/users/c8618e4258de456aafc896eff8f222a4/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:34.946455 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c224e2-49a6-42b4-b97a-31b43890c310 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:34.946910 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c224e2-49a6-42b4-b97a-31b43890c310 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:34.947349 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c224e2-49a6-42b4-b97a-31b43890c310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:34.974660 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a1b1f168-853a-4542-9c52-9fa2dd7536d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f8ed256a4df4f6cabe18805ff506e98'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:34.975312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a1b1f168-853a-4542-9c52-9fa2dd7536d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f8ed256a4df4f6cabe18805ff506e98'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:34.975509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-54c224e2-49a6-42b4-b97a-31b43890c310 None None] MFA Rules not processed for user `c8618e4258de456aafc896eff8f222a4`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:34.976732 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-54c224e2-49a6-42b4-b97a-31b43890c310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:34.986894 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a1b1f168-853a-4542-9c52-9fa2dd7536d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f8ed256a4df4f6cabe18805ff506e98'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:34.987572 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a1b1f168-853a-4542-9c52-9fa2dd7536d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f8ed256a4df4f6cabe18805ff506e98'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:34.995382 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a1b1f168-853a-4542-9c52-9fa2dd7536d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f8ed256a4df4f6cabe18805ff506e98'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:35.008346 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 964/1920] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:34 2021] DELETE /identity/v3/users/7f8ed256a4df4f6cabe18805ff506e98 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:35.012924 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfe6b8-be52-4b54-9e9a-de92ad0528de None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:35.013287 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfe6b8-be52-4b54-9e9a-de92ad0528de None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:35.013635 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfe6b8-be52-4b54-9e9a-de92ad0528de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:35.030671 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-71dfe6b8-be52-4b54-9e9a-de92ad0528de None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:35.031889 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-71dfe6b8-be52-4b54-9e9a-de92ad0528de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:35.044675 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 957/1921] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:34 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:35.054999 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c224e2-49a6-42b4-b97a-31b43890c310 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:35.056396 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-54c224e2-49a6-42b4-b97a-31b43890c310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:35.091037 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 965/1922] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:35.102604 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfe6b8-be52-4b54-9e9a-de92ad0528de None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:35.104378 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-71dfe6b8-be52-4b54-9e9a-de92ad0528de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:35.112155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c224e2-49a6-42b4-b97a-31b43890c310 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:35.159460 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f406d-5a32-4c70-b69b-5a0ff2c09141 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:35.160050 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f406d-5a32-4c70-b69b-5a0ff2c09141 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:35.160330 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f406d-5a32-4c70-b69b-5a0ff2c09141 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:35.160502 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfe6b8-be52-4b54-9e9a-de92ad0528de None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:35.160630 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f406d-5a32-4c70-b69b-5a0ff2c09141 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:35.164231 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2c1bd-9320-4f3b-ab3a-0ddc46e0852e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:35.164881 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2c1bd-9320-4f3b-ab3a-0ddc46e0852e service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:35.165162 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2c1bd-9320-4f3b-ab3a-0ddc46e0852e service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:35.165823 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2c1bd-9320-4f3b-ab3a-0ddc46e0852e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:35.174326 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2c1bd-9320-4f3b-ab3a-0ddc46e0852e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:35.176312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2c1bd-9320-4f3b-ab3a-0ddc46e0852e service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:35.186033 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 966/1923] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:14:35.220220 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f406d-5a32-4c70-b69b-5a0ff2c09141 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:35.221661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f406d-5a32-4c70-b69b-5a0ff2c09141 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:35.231261 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 958/1924] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:35 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:14:35.467628 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2c1bd-9320-4f3b-ab3a-0ddc46e0852e service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:35.469200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-bfc2c1bd-9320-4f3b-ab3a-0ddc46e0852e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:35.483975 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2c1bd-9320-4f3b-ab3a-0ddc46e0852e service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:35.490465 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba224ab6-7ecf-446b-a8e0-9191b8489cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:35.491299 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba224ab6-7ecf-446b-a8e0-9191b8489cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:35.491701 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba224ab6-7ecf-446b-a8e0-9191b8489cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:35.491900 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba224ab6-7ecf-446b-a8e0-9191b8489cca admin admin] PATH_INFO: `/v3/projects/e0a255264a9d4006b443873b64738069` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:35.493106 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba224ab6-7ecf-446b-a8e0-9191b8489cca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a255264a9d4006b443873b64738069)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:35.495063 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba224ab6-7ecf-446b-a8e0-9191b8489cca admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:35.548322 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ba224ab6-7ecf-446b-a8e0-9191b8489cca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a255264a9d4006b443873b64738069', 'request_id': 'req-ba224ab6-7ecf-446b-a8e0-9191b8489cca'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:35.553736 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ba224ab6-7ecf-446b-a8e0-9191b8489cca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a255264a9d4006b443873b64738069', 'request_id': 'req-ba224ab6-7ecf-446b-a8e0-9191b8489cca'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:35.561711 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ba224ab6-7ecf-446b-a8e0-9191b8489cca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a255264a9d4006b443873b64738069', 'request_id': 'req-ba224ab6-7ecf-446b-a8e0-9191b8489cca'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:35.577319 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ba224ab6-7ecf-446b-a8e0-9191b8489cca admin admin] The token cache is being invalidate because project e0a255264a9d4006b443873b64738069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:35.577865 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ba224ab6-7ecf-446b-a8e0-9191b8489cca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:35.578666 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ba224ab6-7ecf-446b-a8e0-9191b8489cca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:35.585700 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 967/1925] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:35 2021] DELETE /identity/v3/projects/e0a255264a9d4006b443873b64738069 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:35.589968 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f406d-5a32-4c70-b69b-5a0ff2c09141 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:35.601192 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f406d-5a32-4c70-b69b-5a0ff2c09141 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:35.675427 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c84bb9-b192-49be-8dc8-f018c0b85866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:35.676861 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c84bb9-b192-49be-8dc8-f018c0b85866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:35.677072 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c84bb9-b192-49be-8dc8-f018c0b85866 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:35.677356 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c84bb9-b192-49be-8dc8-f018c0b85866 admin admin] PATH_INFO: `/v3/users/08d94e885b524292b355f26dbbedf370` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:35.683336 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c84bb9-b192-49be-8dc8-f018c0b85866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d94e885b524292b355f26dbbedf370)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:35.685513 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c84bb9-b192-49be-8dc8-f018c0b85866 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:35.752287 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b8c84bb9-b192-49be-8dc8-f018c0b85866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d94e885b524292b355f26dbbedf370'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:35.779033 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b8c84bb9-b192-49be-8dc8-f018c0b85866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d94e885b524292b355f26dbbedf370'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:35.799432 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b8c84bb9-b192-49be-8dc8-f018c0b85866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d94e885b524292b355f26dbbedf370'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:35.800360 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b8c84bb9-b192-49be-8dc8-f018c0b85866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d94e885b524292b355f26dbbedf370'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:35.820607 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b8c84bb9-b192-49be-8dc8-f018c0b85866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d94e885b524292b355f26dbbedf370'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:35.827732 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 959/1926] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:35 2021] DELETE /identity/v3/users/08d94e885b524292b355f26dbbedf370 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:36.231463 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba224ab6-7ecf-446b-a8e0-9191b8489cca admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:36.233120 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ba224ab6-7ecf-446b-a8e0-9191b8489cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:36.247703 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba224ab6-7ecf-446b-a8e0-9191b8489cca admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:36.330961 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64225b4b-1ad7-4ebc-a4e1-bc3b1f09a300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:36.332152 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64225b4b-1ad7-4ebc-a4e1-bc3b1f09a300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:36.332440 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64225b4b-1ad7-4ebc-a4e1-bc3b1f09a300 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:36.332721 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64225b4b-1ad7-4ebc-a4e1-bc3b1f09a300 admin admin] PATH_INFO: `/v3/projects/f22f8bdc7e3f41cfb35fbccc0446c83b` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:36.334858 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64225b4b-1ad7-4ebc-a4e1-bc3b1f09a300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f22f8bdc7e3f41cfb35fbccc0446c83b)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:36.337009 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64225b4b-1ad7-4ebc-a4e1-bc3b1f09a300 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:36.394412 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-64225b4b-1ad7-4ebc-a4e1-bc3b1f09a300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f22f8bdc7e3f41cfb35fbccc0446c83b', 'request_id': 'req-64225b4b-1ad7-4ebc-a4e1-bc3b1f09a300'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:36.400452 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-64225b4b-1ad7-4ebc-a4e1-bc3b1f09a300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f22f8bdc7e3f41cfb35fbccc0446c83b', 'request_id': 'req-64225b4b-1ad7-4ebc-a4e1-bc3b1f09a300'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:36.409125 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-64225b4b-1ad7-4ebc-a4e1-bc3b1f09a300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f22f8bdc7e3f41cfb35fbccc0446c83b', 'request_id': 'req-64225b4b-1ad7-4ebc-a4e1-bc3b1f09a300'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:36.422895 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-64225b4b-1ad7-4ebc-a4e1-bc3b1f09a300 admin admin] The token cache is being invalidate because project f22f8bdc7e3f41cfb35fbccc0446c83b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:36.423121 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-64225b4b-1ad7-4ebc-a4e1-bc3b1f09a300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:36.424369 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-64225b4b-1ad7-4ebc-a4e1-bc3b1f09a300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:36.426952 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 968/1927] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:36 2021] DELETE /identity/v3/projects/f22f8bdc7e3f41cfb35fbccc0446c83b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:36.433082 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bb04f-8964-4609-bc63-a44d506ccfad None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:36.433372 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bb04f-8964-4609-bc63-a44d506ccfad None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:36.433647 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bb04f-8964-4609-bc63-a44d506ccfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:36.453941 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-1f7bb04f-8964-4609-bc63-a44d506ccfad None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:36.455434 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1f7bb04f-8964-4609-bc63-a44d506ccfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:36.524344 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 960/1928] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:36.542657 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be33c3-3f51-4e8c-9c7a-5206b16177b0 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:36.543452 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be33c3-3f51-4e8c-9c7a-5206b16177b0 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:36.543943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be33c3-3f51-4e8c-9c7a-5206b16177b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:36.566732 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-a7be33c3-3f51-4e8c-9c7a-5206b16177b0 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:36.568086 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a7be33c3-3f51-4e8c-9c7a-5206b16177b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:36.579424 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 969/1929] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:36.584812 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bb04f-8964-4609-bc63-a44d506ccfad None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:36.599888 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bb04f-8964-4609-bc63-a44d506ccfad None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:36.606213 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7bb99-d272-4504-b843-851e3b9c9c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:36.607955 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7bb99-d272-4504-b843-851e3b9c9c7c admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:36.607955 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7bb99-d272-4504-b843-851e3b9c9c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:36.608163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7bb99-d272-4504-b843-851e3b9c9c7c admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:36.609680 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7bb99-d272-4504-b843-851e3b9c9c7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:14:36.610031 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7bb99-d272-4504-b843-851e3b9c9c7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:36.611679 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7bb99-d272-4504-b843-851e3b9c9c7c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:36.626007 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 961/1930] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:14:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:14:36.632054 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be33c3-3f51-4e8c-9c7a-5206b16177b0 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:36.642442 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be33c3-3f51-4e8c-9c7a-5206b16177b0 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:36.648600 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a6e19-2466-4508-9f7e-4b5b4f8bca27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:36.649624 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a6e19-2466-4508-9f7e-4b5b4f8bca27 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:36.649945 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a6e19-2466-4508-9f7e-4b5b4f8bca27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:36.650218 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a6e19-2466-4508-9f7e-4b5b4f8bca27 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:36.650931 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a6e19-2466-4508-9f7e-4b5b4f8bca27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:36.652845 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96a6e19-2466-4508-9f7e-4b5b4f8bca27 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:36.683826 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 970/1931] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:36 2021] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:36.687882 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7bb99-d272-4504-b843-851e3b9c9c7c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:36.700099 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7bb99-d272-4504-b843-851e3b9c9c7c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:36.717750 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a6e19-2466-4508-9f7e-4b5b4f8bca27 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:36.720091 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f96a6e19-2466-4508-9f7e-4b5b4f8bca27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:36.781671 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f979ef-d3fc-465d-92ab-f89288b821f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:36.782762 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f979ef-d3fc-465d-92ab-f89288b821f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:36.782864 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f979ef-d3fc-465d-92ab-f89288b821f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:36.783274 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f979ef-d3fc-465d-92ab-f89288b821f6 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:36.784001 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f979ef-d3fc-465d-92ab-f89288b821f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:36.789839 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f979ef-d3fc-465d-92ab-f89288b821f6 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:36.814734 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a6e19-2466-4508-9f7e-4b5b4f8bca27 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:36.816804 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 962/1932] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:36 2021] POST /identity/v3/users => generated 294 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:14:36.822006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cd818f-ea39-4035-b185-0c44e3f027a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:36.822125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f979ef-d3fc-465d-92ab-f89288b821f6 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:36.822216 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd818f-ea39-4035-b185-0c44e3f027a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:36.822216 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd818f-ea39-4035-b185-0c44e3f027a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:36.822216 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cd818f-ea39-4035-b185-0c44e3f027a6 admin admin] PATH_INFO: `/v3/users/080874056dca4f4ab4c1a025722d3112` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:36.823318 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd818f-ea39-4035-b185-0c44e3f027a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=080874056dca4f4ab4c1a025722d3112)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:36.827093 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cd818f-ea39-4035-b185-0c44e3f027a6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:36.837009 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f979ef-d3fc-465d-92ab-f89288b821f6 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:36.843713 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8b472-4c25-4471-b21f-aea86334d3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:36.844944 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8b472-4c25-4471-b21f-aea86334d3fd admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:36.846023 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8b472-4c25-4471-b21f-aea86334d3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:36.846790 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8b472-4c25-4471-b21f-aea86334d3fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:36.849299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8b472-4c25-4471-b21f-aea86334d3fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:36.851806 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8b472-4c25-4471-b21f-aea86334d3fd admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:36.865855 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 963/1933] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:36 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:36.871676 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8b472-4c25-4471-b21f-aea86334d3fd admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:36.886353 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b0cd818f-ea39-4035-b185-0c44e3f027a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '080874056dca4f4ab4c1a025722d3112'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:36.888071 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b0cd818f-ea39-4035-b185-0c44e3f027a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '080874056dca4f4ab4c1a025722d3112'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:36.891954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8b472-4c25-4471-b21f-aea86334d3fd admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:36.909361 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f21c6a-3873-4fa0-a466-071d8fd25b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:36.913731 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f21c6a-3873-4fa0-a466-071d8fd25b15 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:36.913731 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f21c6a-3873-4fa0-a466-071d8fd25b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:36.913731 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f21c6a-3873-4fa0-a466-071d8fd25b15 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:36.913731 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f21c6a-3873-4fa0-a466-071d8fd25b15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:36.914450 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f21c6a-3873-4fa0-a466-071d8fd25b15 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:36.924622 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b0cd818f-ea39-4035-b185-0c44e3f027a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '080874056dca4f4ab4c1a025722d3112'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:36.925601 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b0cd818f-ea39-4035-b185-0c44e3f027a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '080874056dca4f4ab4c1a025722d3112'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:36.927416 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 964/1934] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:36 2021] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:36.931421 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f21c6a-3873-4fa0-a466-071d8fd25b15 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:36.935132 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-87f21c6a-3873-4fa0-a466-071d8fd25b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:36.938420 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b0cd818f-ea39-4035-b185-0c44e3f027a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '080874056dca4f4ab4c1a025722d3112'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:36.952264 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f21c6a-3873-4fa0-a466-071d8fd25b15 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:36.956579 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 971/1935] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:36 2021] DELETE /identity/v3/users/080874056dca4f4ab4c1a025722d3112 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:36.960698 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e3c9eb-7b59-4e08-98f0-c9a50c2a0b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:36.961638 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3c9eb-7b59-4e08-98f0-c9a50c2a0b23 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:36.961873 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3c9eb-7b59-4e08-98f0-c9a50c2a0b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:36.962316 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3c9eb-7b59-4e08-98f0-c9a50c2a0b23 admin admin] PATH_INFO: `/v3/projects/e8a5e4e1ad2d4a919855625f1d5fba38/users/75da03cc2316417c82f9ae739e4eeb84/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:36.963379 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d2295-2876-4e26-9a6d-781b7596421a None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:36.963853 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d2295-2876-4e26-9a6d-781b7596421a None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:36.964368 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7d2295-2876-4e26-9a6d-781b7596421a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:36.984561 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-dd7d2295-2876-4e26-9a6d-781b7596421a None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:36.985786 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-dd7d2295-2876-4e26-9a6d-781b7596421a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:36.996411 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3c9eb-7b59-4e08-98f0-c9a50c2a0b23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8a5e4e1ad2d4a919855625f1d5fba38, user_id=75da03cc2316417c82f9ae739e4eeb84, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:36.999847 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e3c9eb-7b59-4e08-98f0-c9a50c2a0b23 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:37.019806 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 965/1936] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:36 2021] PUT /identity/v3/projects/e8a5e4e1ad2d4a919855625f1d5fba38/users/75da03cc2316417c82f9ae739e4eeb84/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:37.030286 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050ff3a-a6f5-45a3-b15f-c07772a36bad None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:37.030667 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050ff3a-a6f5-45a3-b15f-c07772a36bad None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:37.031077 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050ff3a-a6f5-45a3-b15f-c07772a36bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:37.059733 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 972/1937] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:37.062493 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-c050ff3a-a6f5-45a3-b15f-c07772a36bad None None] MFA Rules not processed for user `75da03cc2316417c82f9ae739e4eeb84`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:37.063980 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-c050ff3a-a6f5-45a3-b15f-c07772a36bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:37.066702 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d2295-2876-4e26-9a6d-781b7596421a None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:37.068690 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-dd7d2295-2876-4e26-9a6d-781b7596421a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:37.137944 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 966/1938] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:37 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:37.138633 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7d2295-2876-4e26-9a6d-781b7596421a None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:37.142885 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050ff3a-a6f5-45a3-b15f-c07772a36bad None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:37.201940 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc86fed-b4cd-45d6-bd7b-627231f374a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:37.202955 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc86fed-b4cd-45d6-bd7b-627231f374a4 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:37.203331 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc86fed-b4cd-45d6-bd7b-627231f374a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:37.203703 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc86fed-b4cd-45d6-bd7b-627231f374a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:37.215697 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050ff3a-a6f5-45a3-b15f-c07772a36bad None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:37.220355 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc04981-4d6c-42b9-9f59-caea2f885706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:37.221011 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc04981-4d6c-42b9-9f59-caea2f885706 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:37.221289 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc04981-4d6c-42b9-9f59-caea2f885706 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:37.221571 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc04981-4d6c-42b9-9f59-caea2f885706 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:37.222356 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc04981-4d6c-42b9-9f59-caea2f885706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:37.224535 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc04981-4d6c-42b9-9f59-caea2f885706 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:37.262427 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 967/1939] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:37 2021] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:37.263503 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc04981-4d6c-42b9-9f59-caea2f885706 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:37.266388 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc86fed-b4cd-45d6-bd7b-627231f374a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:37.268323 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc86fed-b4cd-45d6-bd7b-627231f374a4 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:37.282907 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 973/1940] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:37.332354 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc04981-4d6c-42b9-9f59-caea2f885706 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:37.338821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44a4f6-7869-42e3-b510-3892fdff039b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:37.339530 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a4f6-7869-42e3-b510-3892fdff039b admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:37.339820 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a4f6-7869-42e3-b510-3892fdff039b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:37.340147 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d44a4f6-7869-42e3-b510-3892fdff039b admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:37.340916 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44a4f6-7869-42e3-b510-3892fdff039b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:37.342934 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d44a4f6-7869-42e3-b510-3892fdff039b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:37.366096 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 968/1941] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:37 2021] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:37.370462 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc86fed-b4cd-45d6-bd7b-627231f374a4 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:37.380973 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc86fed-b4cd-45d6-bd7b-627231f374a4 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:37.388336 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f08f9-992f-461a-b5eb-719364c59eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:37.389259 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f08f9-992f-461a-b5eb-719364c59eeb admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:37.389698 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f08f9-992f-461a-b5eb-719364c59eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:37.390001 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f08f9-992f-461a-b5eb-719364c59eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:37.390896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f08f9-992f-461a-b5eb-719364c59eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:37.392576 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f08f9-992f-461a-b5eb-719364c59eeb admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:37.404714 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 974/1942] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:37 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:37.409209 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44a4f6-7869-42e3-b510-3892fdff039b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:37.421796 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d44a4f6-7869-42e3-b510-3892fdff039b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:37.427496 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286691a-c3b3-49d1-a9a4-a1adc9825113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:37.428407 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286691a-c3b3-49d1-a9a4-a1adc9825113 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:37.428688 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286691a-c3b3-49d1-a9a4-a1adc9825113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:37.428966 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286691a-c3b3-49d1-a9a4-a1adc9825113 admin admin] PATH_INFO: `/v3/projects/936a5466c7dd478fb43b88ad1106c5c2/users/3764ace98fa742e09a71e22b7ff78ef0/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:37.444490 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286691a-c3b3-49d1-a9a4-a1adc9825113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=936a5466c7dd478fb43b88ad1106c5c2, user_id=3764ace98fa742e09a71e22b7ff78ef0, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:37.447451 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286691a-c3b3-49d1-a9a4-a1adc9825113 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:37.467827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 969/1943] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:37 2021] PUT /identity/v3/projects/936a5466c7dd478fb43b88ad1106c5c2/users/3764ace98fa742e09a71e22b7ff78ef0/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:37.471779 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f08f9-992f-461a-b5eb-719364c59eeb admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:37.481566 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f08f9-992f-461a-b5eb-719364c59eeb admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:37.543761 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f107e5-bae8-4ea4-b38f-4f7b09da9280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:37.544429 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f107e5-bae8-4ea4-b38f-4f7b09da9280 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:37.544706 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f107e5-bae8-4ea4-b38f-4f7b09da9280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:37.545013 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f107e5-bae8-4ea4-b38f-4f7b09da9280 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:37.545738 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f107e5-bae8-4ea4-b38f-4f7b09da9280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:37.547457 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f107e5-bae8-4ea4-b38f-4f7b09da9280 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:37.558152 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 975/1944] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:37 2021] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:37.562368 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286691a-c3b3-49d1-a9a4-a1adc9825113 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:37.572978 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286691a-c3b3-49d1-a9a4-a1adc9825113 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:37.583194 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70119f11-9824-4d48-891c-c5ae71d449cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:37.583525 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f107e5-bae8-4ea4-b38f-4f7b09da9280 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:37.584099 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70119f11-9824-4d48-891c-c5ae71d449cd admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:37.584378 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70119f11-9824-4d48-891c-c5ae71d449cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:37.585040 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70119f11-9824-4d48-891c-c5ae71d449cd admin admin] PATH_INFO: `/v3/projects/936a5466c7dd478fb43b88ad1106c5c2/users/3764ace98fa742e09a71e22b7ff78ef0/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:37.585823 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-41f107e5-bae8-4ea4-b38f-4f7b09da9280 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:37.587304 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70119f11-9824-4d48-891c-c5ae71d449cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=936a5466c7dd478fb43b88ad1106c5c2, user_id=3764ace98fa742e09a71e22b7ff78ef0, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:37.590698 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70119f11-9824-4d48-891c-c5ae71d449cd admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:37.603215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 970/1945] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:37 2021] PUT /identity/v3/projects/936a5466c7dd478fb43b88ad1106c5c2/users/3764ace98fa742e09a71e22b7ff78ef0/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:37.611796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f107e5-bae8-4ea4-b38f-4f7b09da9280 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:37.614658 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef922c-9c43-446c-9c58-490341186d91 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:37.614812 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef922c-9c43-446c-9c58-490341186d91 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:37.615054 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef922c-9c43-446c-9c58-490341186d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:37.650158 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-dfef922c-9c43-446c-9c58-490341186d91 None None] MFA Rules not processed for user `3764ace98fa742e09a71e22b7ff78ef0`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:37.651388 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-dfef922c-9c43-446c-9c58-490341186d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:37.676971 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37233c27-6e11-4694-9018-f879e1fcb040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:37.677835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37233c27-6e11-4694-9018-f879e1fcb040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:37.678150 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37233c27-6e11-4694-9018-f879e1fcb040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:37.678424 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37233c27-6e11-4694-9018-f879e1fcb040 admin admin] PATH_INFO: `/v3/projects/8f9b04b390064205be22d86d9975bf0c` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:37.679624 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37233c27-6e11-4694-9018-f879e1fcb040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f9b04b390064205be22d86d9975bf0c)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:37.681539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37233c27-6e11-4694-9018-f879e1fcb040 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:37.724203 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 971/1946] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:37 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:37.728408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-37233c27-6e11-4694-9018-f879e1fcb040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f9b04b390064205be22d86d9975bf0c', 'request_id': 'req-37233c27-6e11-4694-9018-f879e1fcb040'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:37.733944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-37233c27-6e11-4694-9018-f879e1fcb040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f9b04b390064205be22d86d9975bf0c', 'request_id': 'req-37233c27-6e11-4694-9018-f879e1fcb040'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:37.735399 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef922c-9c43-446c-9c58-490341186d91 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:37.736786 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-dfef922c-9c43-446c-9c58-490341186d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:37.741986 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-37233c27-6e11-4694-9018-f879e1fcb040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f9b04b390064205be22d86d9975bf0c', 'request_id': 'req-37233c27-6e11-4694-9018-f879e1fcb040'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:37.754025 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-37233c27-6e11-4694-9018-f879e1fcb040 admin admin] The token cache is being invalidate because project 8f9b04b390064205be22d86d9975bf0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:37.754352 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-37233c27-6e11-4694-9018-f879e1fcb040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:37.755012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-37233c27-6e11-4694-9018-f879e1fcb040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:37.756578 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 976/1947] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:37 2021] DELETE /identity/v3/projects/8f9b04b390064205be22d86d9975bf0c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:37.760725 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37233c27-6e11-4694-9018-f879e1fcb040 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:37.762114 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-37233c27-6e11-4694-9018-f879e1fcb040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:37.802286 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef922c-9c43-446c-9c58-490341186d91 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:37.832549 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37233c27-6e11-4694-9018-f879e1fcb040 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:37.837661 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575b747-7f2a-4cd0-b6ad-877a24c647e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:37.839341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575b747-7f2a-4cd0-b6ad-877a24c647e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:37.839341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575b747-7f2a-4cd0-b6ad-877a24c647e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:37.839341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575b747-7f2a-4cd0-b6ad-877a24c647e6 admin admin] PATH_INFO: `/v3/users/c8618e4258de456aafc896eff8f222a4` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:37.840746 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575b747-7f2a-4cd0-b6ad-877a24c647e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8618e4258de456aafc896eff8f222a4)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:37.842810 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575b747-7f2a-4cd0-b6ad-877a24c647e6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:37.854418 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7755ae-f70c-41fd-9eff-bcb61bcb48df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:37.855067 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7755ae-f70c-41fd-9eff-bcb61bcb48df service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:37.855348 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7755ae-f70c-41fd-9eff-bcb61bcb48df service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:37.855622 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7755ae-f70c-41fd-9eff-bcb61bcb48df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:37.857431 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7d7755ae-f70c-41fd-9eff-bcb61bcb48df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:37.891711 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4575b747-7f2a-4cd0-b6ad-877a24c647e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8618e4258de456aafc896eff8f222a4'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:37.892408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4575b747-7f2a-4cd0-b6ad-877a24c647e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8618e4258de456aafc896eff8f222a4'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:37.904001 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4575b747-7f2a-4cd0-b6ad-877a24c647e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8618e4258de456aafc896eff8f222a4'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:37.904693 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4575b747-7f2a-4cd0-b6ad-877a24c647e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8618e4258de456aafc896eff8f222a4'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:37.913215 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4575b747-7f2a-4cd0-b6ad-877a24c647e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8618e4258de456aafc896eff8f222a4'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:37.924879 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7755ae-f70c-41fd-9eff-bcb61bcb48df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:37.927435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7755ae-f70c-41fd-9eff-bcb61bcb48df service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:37.929705 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 977/1948] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:37 2021] DELETE /identity/v3/users/c8618e4258de456aafc896eff8f222a4 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:37.957984 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 972/1949] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:37 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:37.976703 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575b747-7f2a-4cd0-b6ad-877a24c647e6 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:37.978473 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4575b747-7f2a-4cd0-b6ad-877a24c647e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:38.056005 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575b747-7f2a-4cd0-b6ad-877a24c647e6 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:38.062606 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b11b5c-885f-492d-8856-1ed3a232b18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:38.063692 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b11b5c-885f-492d-8856-1ed3a232b18d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:38.064396 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b11b5c-885f-492d-8856-1ed3a232b18d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:38.064939 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b11b5c-885f-492d-8856-1ed3a232b18d admin admin] PATH_INFO: `/v3/users/75da03cc2316417c82f9ae739e4eeb84` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:38.066405 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b11b5c-885f-492d-8856-1ed3a232b18d admin admin] RBAC: Authorizing `identity:delete_user(user_id=75da03cc2316417c82f9ae739e4eeb84)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:38.068765 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b11b5c-885f-492d-8856-1ed3a232b18d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:38.134261 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-11b11b5c-885f-492d-8856-1ed3a232b18d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75da03cc2316417c82f9ae739e4eeb84'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.135139 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-11b11b5c-885f-492d-8856-1ed3a232b18d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75da03cc2316417c82f9ae739e4eeb84'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.153888 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-11b11b5c-885f-492d-8856-1ed3a232b18d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75da03cc2316417c82f9ae739e4eeb84'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.154965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-11b11b5c-885f-492d-8856-1ed3a232b18d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75da03cc2316417c82f9ae739e4eeb84'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.166796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-11b11b5c-885f-492d-8856-1ed3a232b18d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75da03cc2316417c82f9ae739e4eeb84'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.183652 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 978/1950] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:37 2021] DELETE /identity/v3/users/75da03cc2316417c82f9ae739e4eeb84 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:38.188110 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4323f-31ce-49d8-9e92-f64c87ea87ab None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:38.188407 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4323f-31ce-49d8-9e92-f64c87ea87ab None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:38.188697 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4323f-31ce-49d8-9e92-f64c87ea87ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:38.212170 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-07a4323f-31ce-49d8-9e92-f64c87ea87ab None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:38.213439 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-07a4323f-31ce-49d8-9e92-f64c87ea87ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:38.307024 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 973/1951] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:38.318376 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b11b5c-885f-492d-8856-1ed3a232b18d admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:38.323577 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-11b11b5c-885f-492d-8856-1ed3a232b18d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:38.352125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4323f-31ce-49d8-9e92-f64c87ea87ab None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:38.353549 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-07a4323f-31ce-49d8-9e92-f64c87ea87ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:38.366590 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4323f-31ce-49d8-9e92-f64c87ea87ab None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:38.374508 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0858c3-6b8c-4129-8244-c27eb1369cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:38.374508 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0858c3-6b8c-4129-8244-c27eb1369cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:38.374508 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0858c3-6b8c-4129-8244-c27eb1369cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:38.374874 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0858c3-6b8c-4129-8244-c27eb1369cd8 admin admin] PATH_INFO: `/v3/projects/35196f210be845708c8cab11845cc92c` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:38.376915 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0858c3-6b8c-4129-8244-c27eb1369cd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35196f210be845708c8cab11845cc92c)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:38.379849 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0858c3-6b8c-4129-8244-c27eb1369cd8 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:38.388731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b11b5c-885f-492d-8856-1ed3a232b18d admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:38.396305 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64def088-6d58-4585-9e14-37fd1006332a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:38.397221 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64def088-6d58-4585-9e14-37fd1006332a service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:38.397661 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64def088-6d58-4585-9e14-37fd1006332a service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:38.398247 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64def088-6d58-4585-9e14-37fd1006332a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:38.408409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64def088-6d58-4585-9e14-37fd1006332a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:38.410836 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64def088-6d58-4585-9e14-37fd1006332a service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:38.421950 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 979/1952] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:38.433359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-aa0858c3-6b8c-4129-8244-c27eb1369cd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35196f210be845708c8cab11845cc92c', 'request_id': 'req-aa0858c3-6b8c-4129-8244-c27eb1369cd8'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.439414 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-aa0858c3-6b8c-4129-8244-c27eb1369cd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35196f210be845708c8cab11845cc92c', 'request_id': 'req-aa0858c3-6b8c-4129-8244-c27eb1369cd8'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.444376 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64def088-6d58-4585-9e14-37fd1006332a service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:38.446045 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-64def088-6d58-4585-9e14-37fd1006332a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:38.451475 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-aa0858c3-6b8c-4129-8244-c27eb1369cd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35196f210be845708c8cab11845cc92c', 'request_id': 'req-aa0858c3-6b8c-4129-8244-c27eb1369cd8'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.459653 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64def088-6d58-4585-9e14-37fd1006332a service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:38.465680 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-aa0858c3-6b8c-4129-8244-c27eb1369cd8 admin admin] The token cache is being invalidate because project 35196f210be845708c8cab11845cc92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:38.466140 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-aa0858c3-6b8c-4129-8244-c27eb1369cd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.466880 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-aa0858c3-6b8c-4129-8244-c27eb1369cd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.468945 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 974/1953] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:38 2021] DELETE /identity/v3/projects/35196f210be845708c8cab11845cc92c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:38.474707 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6e78c-be9f-414d-9df5-8ef7cd8ef5b3 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:38.474995 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6e78c-be9f-414d-9df5-8ef7cd8ef5b3 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:38.475295 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6e78c-be9f-414d-9df5-8ef7cd8ef5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:38.497024 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-83c6e78c-be9f-414d-9df5-8ef7cd8ef5b3 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:38.498417 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-83c6e78c-be9f-414d-9df5-8ef7cd8ef5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:38.528731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545606c-85ee-4acd-beca-b6cdc6ffb508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:38.529624 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545606c-85ee-4acd-beca-b6cdc6ffb508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:38.529948 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545606c-85ee-4acd-beca-b6cdc6ffb508 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:38.530374 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545606c-85ee-4acd-beca-b6cdc6ffb508 admin admin] PATH_INFO: `/v3/users/61e9e5f0e85a443bbc6b4f43c27e79a8` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:38.531498 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545606c-85ee-4acd-beca-b6cdc6ffb508 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61e9e5f0e85a443bbc6b4f43c27e79a8)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:38.533467 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545606c-85ee-4acd-beca-b6cdc6ffb508 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:38.567879 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 975/1954] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:38.577147 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47090876-cd64-465b-8a47-576f928a7669 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:38.577601 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47090876-cd64-465b-8a47-576f928a7669 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:38.579429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47090876-cd64-465b-8a47-576f928a7669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:38.606426 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7545606c-85ee-4acd-beca-b6cdc6ffb508 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61e9e5f0e85a443bbc6b4f43c27e79a8'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.607183 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7545606c-85ee-4acd-beca-b6cdc6ffb508 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61e9e5f0e85a443bbc6b4f43c27e79a8'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.610971 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-47090876-cd64-465b-8a47-576f928a7669 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:38.611909 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-47090876-cd64-465b-8a47-576f928a7669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:38.622489 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 976/1955] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:38.625289 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7545606c-85ee-4acd-beca-b6cdc6ffb508 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61e9e5f0e85a443bbc6b4f43c27e79a8'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.626360 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7545606c-85ee-4acd-beca-b6cdc6ffb508 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61e9e5f0e85a443bbc6b4f43c27e79a8'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.626914 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47090876-cd64-465b-8a47-576f928a7669 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:38.635696 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7545606c-85ee-4acd-beca-b6cdc6ffb508 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61e9e5f0e85a443bbc6b4f43c27e79a8'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.636663 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47090876-cd64-465b-8a47-576f928a7669 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:38.641466 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420d854-3e3d-4d8e-82aa-b3041178d85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:38.642158 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420d854-3e3d-4d8e-82aa-b3041178d85a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:38.642442 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420d854-3e3d-4d8e-82aa-b3041178d85a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:38.642720 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b420d854-3e3d-4d8e-82aa-b3041178d85a admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:38.643466 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420d854-3e3d-4d8e-82aa-b3041178d85a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:14:38.643768 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420d854-3e3d-4d8e-82aa-b3041178d85a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:38.645410 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b420d854-3e3d-4d8e-82aa-b3041178d85a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:38.650272 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 980/1956] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:38 2021] DELETE /identity/v3/users/61e9e5f0e85a443bbc6b4f43c27e79a8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:38.654434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cac54-f754-45dc-abcc-aedbeaf1a9f7 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:38.654786 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cac54-f754-45dc-abcc-aedbeaf1a9f7 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:38.655612 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cac54-f754-45dc-abcc-aedbeaf1a9f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:38.664160 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 977/1957] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:14:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:14:38.666291 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420d854-3e3d-4d8e-82aa-b3041178d85a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:38.668749 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-b420d854-3e3d-4d8e-82aa-b3041178d85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:38.676780 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-d74cac54-f754-45dc-abcc-aedbeaf1a9f7 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:38.678115 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-d74cac54-f754-45dc-abcc-aedbeaf1a9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:38.682978 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b420d854-3e3d-4d8e-82aa-b3041178d85a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:38.747189 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a807a52-15c1-468e-8e7e-4859998fedc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:38.747866 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a807a52-15c1-468e-8e7e-4859998fedc1 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:38.748151 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a807a52-15c1-468e-8e7e-4859998fedc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:38.748498 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a807a52-15c1-468e-8e7e-4859998fedc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:38.749141 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a807a52-15c1-468e-8e7e-4859998fedc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:38.751199 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a807a52-15c1-468e-8e7e-4859998fedc1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:38.756884 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 981/1958] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:38.756884 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cac54-f754-45dc-abcc-aedbeaf1a9f7 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:38.758203 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-d74cac54-f754-45dc-abcc-aedbeaf1a9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:38.775995 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cac54-f754-45dc-abcc-aedbeaf1a9f7 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:38.779944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58297351-3218-48eb-a776-98f536584bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:38.780824 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58297351-3218-48eb-a776-98f536584bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:38.781105 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58297351-3218-48eb-a776-98f536584bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:38.781383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58297351-3218-48eb-a776-98f536584bf7 admin admin] PATH_INFO: `/v3/projects/e8a5e4e1ad2d4a919855625f1d5fba38` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:38.782636 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58297351-3218-48eb-a776-98f536584bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8a5e4e1ad2d4a919855625f1d5fba38)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:38.784557 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58297351-3218-48eb-a776-98f536584bf7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:38.786429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 978/1959] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:38 2021] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:38.787267 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a807a52-15c1-468e-8e7e-4859998fedc1 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:38.788929 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-5a807a52-15c1-468e-8e7e-4859998fedc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:38.833844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-58297351-3218-48eb-a776-98f536584bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8a5e4e1ad2d4a919855625f1d5fba38', 'request_id': 'req-58297351-3218-48eb-a776-98f536584bf7'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.839386 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-58297351-3218-48eb-a776-98f536584bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8a5e4e1ad2d4a919855625f1d5fba38', 'request_id': 'req-58297351-3218-48eb-a776-98f536584bf7'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.847095 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-58297351-3218-48eb-a776-98f536584bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8a5e4e1ad2d4a919855625f1d5fba38', 'request_id': 'req-58297351-3218-48eb-a776-98f536584bf7'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.848815 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a807a52-15c1-468e-8e7e-4859998fedc1 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:38.858376 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-58297351-3218-48eb-a776-98f536584bf7 admin admin] The token cache is being invalidate because project e8a5e4e1ad2d4a919855625f1d5fba38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:38.858747 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-58297351-3218-48eb-a776-98f536584bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.859388 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-58297351-3218-48eb-a776-98f536584bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:38.860941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 982/1960] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:38 2021] DELETE /identity/v3/projects/e8a5e4e1ad2d4a919855625f1d5fba38 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:38.861680 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58297351-3218-48eb-a776-98f536584bf7 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:38.863658 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-58297351-3218-48eb-a776-98f536584bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:38.896703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82781fa2-4a78-40a2-84da-dbe9ecbdfd01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:38.897354 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82781fa2-4a78-40a2-84da-dbe9ecbdfd01 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:38.897639 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82781fa2-4a78-40a2-84da-dbe9ecbdfd01 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:38.897950 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82781fa2-4a78-40a2-84da-dbe9ecbdfd01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:38.899932 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-82781fa2-4a78-40a2-84da-dbe9ecbdfd01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:38.927704 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58297351-3218-48eb-a776-98f536584bf7 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:38.932352 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9164e8e-49e9-4da3-86ca-2536442d45c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:38.933026 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9164e8e-49e9-4da3-86ca-2536442d45c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:38.933305 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9164e8e-49e9-4da3-86ca-2536442d45c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:38.933578 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9164e8e-49e9-4da3-86ca-2536442d45c5 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:38.934298 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9164e8e-49e9-4da3-86ca-2536442d45c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:38.936220 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9164e8e-49e9-4da3-86ca-2536442d45c5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:38.956442 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 983/1961] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:38 2021] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:38.960679 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9164e8e-49e9-4da3-86ca-2536442d45c5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:38.961501 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82781fa2-4a78-40a2-84da-dbe9ecbdfd01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:38.962828 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b9164e8e-49e9-4da3-86ca-2536442d45c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:38.963082 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82781fa2-4a78-40a2-84da-dbe9ecbdfd01 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:38.973043 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 979/1962] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:38.973862 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82781fa2-4a78-40a2-84da-dbe9ecbdfd01 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:38.976398 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9164e8e-49e9-4da3-86ca-2536442d45c5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:38.982591 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76794ac0-4d10-4257-a283-0650e3301a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:38.983222 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82781fa2-4a78-40a2-84da-dbe9ecbdfd01 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:38.983355 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76794ac0-4d10-4257-a283-0650e3301a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:38.983506 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76794ac0-4d10-4257-a283-0650e3301a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:38.983789 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76794ac0-4d10-4257-a283-0650e3301a21 admin admin] PATH_INFO: `/v3/users/3764ace98fa742e09a71e22b7ff78ef0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:38.985027 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76794ac0-4d10-4257-a283-0650e3301a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3764ace98fa742e09a71e22b7ff78ef0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:38.987132 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76794ac0-4d10-4257-a283-0650e3301a21 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:38.989075 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e0499-3d44-4f11-8d84-75dc9ec31387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:38.989957 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0499-3d44-4f11-8d84-75dc9ec31387 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:38.990386 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0499-3d44-4f11-8d84-75dc9ec31387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:38.990806 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0499-3d44-4f11-8d84-75dc9ec31387 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:38.991695 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e0499-3d44-4f11-8d84-75dc9ec31387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:38.993527 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9e0499-3d44-4f11-8d84-75dc9ec31387 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:39.006614 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 980/1963] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:38 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:39.011160 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e0499-3d44-4f11-8d84-75dc9ec31387 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:39.038469 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e0499-3d44-4f11-8d84-75dc9ec31387 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:39.052360 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5587bc-cbd5-448f-95d5-a02367181a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:39.054699 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5587bc-cbd5-448f-95d5-a02367181a6c admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:39.054995 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5587bc-cbd5-448f-95d5-a02367181a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:39.057013 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5587bc-cbd5-448f-95d5-a02367181a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:39.059317 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5587bc-cbd5-448f-95d5-a02367181a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:39.062336 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5587bc-cbd5-448f-95d5-a02367181a6c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:39.062973 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-76794ac0-4d10-4257-a283-0650e3301a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3764ace98fa742e09a71e22b7ff78ef0'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:39.064101 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-76794ac0-4d10-4257-a283-0650e3301a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3764ace98fa742e09a71e22b7ff78ef0'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:39.078356 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 981/1964] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:39 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:39.079883 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-76794ac0-4d10-4257-a283-0650e3301a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3764ace98fa742e09a71e22b7ff78ef0'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:39.080920 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-76794ac0-4d10-4257-a283-0650e3301a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3764ace98fa742e09a71e22b7ff78ef0'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:39.083202 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5587bc-cbd5-448f-95d5-a02367181a6c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:39.085392 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8a5587bc-cbd5-448f-95d5-a02367181a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:39.089539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-76794ac0-4d10-4257-a283-0650e3301a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3764ace98fa742e09a71e22b7ff78ef0'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:39.103702 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 984/1965] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:38 2021] DELETE /identity/v3/users/3764ace98fa742e09a71e22b7ff78ef0 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:39.115820 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5587bc-cbd5-448f-95d5-a02367181a6c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:39.162465 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea249d6d-1b0a-463d-803a-822932ff3d39 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:39.162768 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea249d6d-1b0a-463d-803a-822932ff3d39 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:39.163701 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea249d6d-1b0a-463d-803a-822932ff3d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:39.181012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-ea249d6d-1b0a-463d-803a-822932ff3d39 None None] MFA Rules not processed for user `63baa45ff6a84614ac4656f6c7c6be2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:39.182295 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ea249d6d-1b0a-463d-803a-822932ff3d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:39.182747 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9947e-e749-4716-b111-59622c0144fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:39.183759 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9947e-e749-4716-b111-59622c0144fe admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:39.184142 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9947e-e749-4716-b111-59622c0144fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:39.184498 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9947e-e749-4716-b111-59622c0144fe admin admin] PATH_INFO: `/v3/projects/9e74e94fe7a243cd8ce601baa35daaa7/users/b6297514861943ba84efd7389e047a6d/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:39.213845 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9947e-e749-4716-b111-59622c0144fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e74e94fe7a243cd8ce601baa35daaa7, user_id=b6297514861943ba84efd7389e047a6d, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:39.223724 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9947e-e749-4716-b111-59622c0144fe admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:39.242621 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 985/1966] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:39 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:39.245583 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 982/1967] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:39 2021] PUT /identity/v3/projects/9e74e94fe7a243cd8ce601baa35daaa7/users/b6297514861943ba84efd7389e047a6d/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:39.258473 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9e089-5084-42a2-a2d6-c7fe980408ab None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:39.258684 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9e089-5084-42a2-a2d6-c7fe980408ab None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:39.258965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9e089-5084-42a2-a2d6-c7fe980408ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:39.316524 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-30a9e089-5084-42a2-a2d6-c7fe980408ab None None] MFA Rules not processed for user `b6297514861943ba84efd7389e047a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:39.318000 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-30a9e089-5084-42a2-a2d6-c7fe980408ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:39.404052 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 986/1968] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:39 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:39.414884 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9947e-e749-4716-b111-59622c0144fe admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:39.416707 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-31a9947e-e749-4716-b111-59622c0144fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:39.465244 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9e089-5084-42a2-a2d6-c7fe980408ab None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:39.466811 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-30a9e089-5084-42a2-a2d6-c7fe980408ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:39.507633 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9947e-e749-4716-b111-59622c0144fe admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:39.512585 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96a63c-3b21-47d1-b9a0-491af2bba184 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:39.513433 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96a63c-3b21-47d1-b9a0-491af2bba184 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:39.514034 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96a63c-3b21-47d1-b9a0-491af2bba184 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:39.514467 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96a63c-3b21-47d1-b9a0-491af2bba184 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:39.542598 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96a63c-3b21-47d1-b9a0-491af2bba184 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:39.545390 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96a63c-3b21-47d1-b9a0-491af2bba184 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:39.568810 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 983/1969] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:39 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:39.586643 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9e089-5084-42a2-a2d6-c7fe980408ab None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:39.603806 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07032f74-2288-460a-926a-24c433051101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:39.604690 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07032f74-2288-460a-926a-24c433051101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:39.604979 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07032f74-2288-460a-926a-24c433051101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:39.605256 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07032f74-2288-460a-926a-24c433051101 admin admin] PATH_INFO: `/v3/projects/0fa5746ea18e41c6a8da2ad9cdaa8752` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:39.606643 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07032f74-2288-460a-926a-24c433051101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fa5746ea18e41c6a8da2ad9cdaa8752)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:39.609271 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07032f74-2288-460a-926a-24c433051101 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:39.635720 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96a63c-3b21-47d1-b9a0-491af2bba184 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:39.637243 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-aa96a63c-3b21-47d1-b9a0-491af2bba184 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:39.655656 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96a63c-3b21-47d1-b9a0-491af2bba184 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:39.684633 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-07032f74-2288-460a-926a-24c433051101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fa5746ea18e41c6a8da2ad9cdaa8752', 'request_id': 'req-07032f74-2288-460a-926a-24c433051101'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:39.694323 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-07032f74-2288-460a-926a-24c433051101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fa5746ea18e41c6a8da2ad9cdaa8752', 'request_id': 'req-07032f74-2288-460a-926a-24c433051101'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:39.704298 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-07032f74-2288-460a-926a-24c433051101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fa5746ea18e41c6a8da2ad9cdaa8752', 'request_id': 'req-07032f74-2288-460a-926a-24c433051101'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:39.718653 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-07032f74-2288-460a-926a-24c433051101 admin admin] The token cache is being invalidate because project 0fa5746ea18e41c6a8da2ad9cdaa8752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:39.719645 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-07032f74-2288-460a-926a-24c433051101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:39.719949 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-07032f74-2288-460a-926a-24c433051101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:39.724437 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 987/1970] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:39 2021] DELETE /identity/v3/projects/0fa5746ea18e41c6a8da2ad9cdaa8752 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:39.729782 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a566a3-1bd9-4a7c-abe7-a941a5e3822d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:39.730703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a566a3-1bd9-4a7c-abe7-a941a5e3822d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:39.732541 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71582497-8393-4b2d-9541-7a252ea6a94b None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:39.732828 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71582497-8393-4b2d-9541-7a252ea6a94b None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:39.733112 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71582497-8393-4b2d-9541-7a252ea6a94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:39.734218 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a566a3-1bd9-4a7c-abe7-a941a5e3822d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:39.734735 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a566a3-1bd9-4a7c-abe7-a941a5e3822d admin admin] PATH_INFO: `/v3/projects/936a5466c7dd478fb43b88ad1106c5c2` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:39.739047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a566a3-1bd9-4a7c-abe7-a941a5e3822d admin admin] RBAC: Authorizing `identity:delete_project(project_id=936a5466c7dd478fb43b88ad1106c5c2)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:39.741072 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a566a3-1bd9-4a7c-abe7-a941a5e3822d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:39.757709 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-71582497-8393-4b2d-9541-7a252ea6a94b None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:39.759427 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-71582497-8393-4b2d-9541-7a252ea6a94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:39.771233 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 988/1971] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:39.784529 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73f7e9-f84a-4613-ba20-5c5aa326ab37 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:39.784872 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73f7e9-f84a-4613-ba20-5c5aa326ab37 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:39.785155 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f73f7e9-f84a-4613-ba20-5c5aa326ab37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:39.805503 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-45a566a3-1bd9-4a7c-abe7-a941a5e3822d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '936a5466c7dd478fb43b88ad1106c5c2', 'request_id': 'req-45a566a3-1bd9-4a7c-abe7-a941a5e3822d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:39.806398 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-8f73f7e9-f84a-4613-ba20-5c5aa326ab37 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:39.807682 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-8f73f7e9-f84a-4613-ba20-5c5aa326ab37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:39.813674 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-45a566a3-1bd9-4a7c-abe7-a941a5e3822d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '936a5466c7dd478fb43b88ad1106c5c2', 'request_id': 'req-45a566a3-1bd9-4a7c-abe7-a941a5e3822d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:39.826441 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-45a566a3-1bd9-4a7c-abe7-a941a5e3822d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '936a5466c7dd478fb43b88ad1106c5c2', 'request_id': 'req-45a566a3-1bd9-4a7c-abe7-a941a5e3822d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:39.842565 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-45a566a3-1bd9-4a7c-abe7-a941a5e3822d admin admin] The token cache is being invalidate because project 936a5466c7dd478fb43b88ad1106c5c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:39.842877 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-45a566a3-1bd9-4a7c-abe7-a941a5e3822d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:39.843595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-45a566a3-1bd9-4a7c-abe7-a941a5e3822d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:39.845208 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 984/1972] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:39 2021] DELETE /identity/v3/projects/936a5466c7dd478fb43b88ad1106c5c2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:39.851553 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ff667-0b96-4182-8563-0046569739ad None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:39.852165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ff667-0b96-4182-8563-0046569739ad None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:39.852165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4ff667-0b96-4182-8563-0046569739ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:39.879257 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-1c4ff667-0b96-4182-8563-0046569739ad None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:39.880588 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1c4ff667-0b96-4182-8563-0046569739ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:39.911812 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 989/1973] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:39.917055 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73f7e9-f84a-4613-ba20-5c5aa326ab37 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:39.926934 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f73f7e9-f84a-4613-ba20-5c5aa326ab37 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:39.931595 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7241e3-4868-4b3a-b8f6-51950c91759b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:39.933072 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7241e3-4868-4b3a-b8f6-51950c91759b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:39.933737 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7241e3-4868-4b3a-b8f6-51950c91759b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:39.934133 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7241e3-4868-4b3a-b8f6-51950c91759b admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:39.935166 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7241e3-4868-4b3a-b8f6-51950c91759b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:14:39.935674 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7241e3-4868-4b3a-b8f6-51950c91759b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:39.939175 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7241e3-4868-4b3a-b8f6-51950c91759b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:39.958073 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 985/1974] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:39.968107 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae807d7-ee65-4804-ba9d-53339d7807c5 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:39.968637 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae807d7-ee65-4804-ba9d-53339d7807c5 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:39.969005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae807d7-ee65-4804-ba9d-53339d7807c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:39.969986 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 990/1975] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:14:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:14:39.971152 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7241e3-4868-4b3a-b8f6-51950c91759b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:39.984854 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7241e3-4868-4b3a-b8f6-51950c91759b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:39.996803 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-9ae807d7-ee65-4804-ba9d-53339d7807c5 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:39.998044 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-9ae807d7-ee65-4804-ba9d-53339d7807c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:40.001352 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0585a26-2cbc-49e9-a188-a39b5d132f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:40.008608 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0585a26-2cbc-49e9-a188-a39b5d132f83 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.009067 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0585a26-2cbc-49e9-a188-a39b5d132f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.009444 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0585a26-2cbc-49e9-a188-a39b5d132f83 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.010593 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0585a26-2cbc-49e9-a188-a39b5d132f83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:40.012938 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 986/1976] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:40.013188 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0585a26-2cbc-49e9-a188-a39b5d132f83 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:40.017223 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae807d7-ee65-4804-ba9d-53339d7807c5 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:40.026661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae807d7-ee65-4804-ba9d-53339d7807c5 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:40.035308 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add69236-2b98-486e-a3c4-a6c516c78d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:40.036462 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add69236-2b98-486e-a3c4-a6c516c78d50 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.036979 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add69236-2b98-486e-a3c4-a6c516c78d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.037349 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add69236-2b98-486e-a3c4-a6c516c78d50 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.038186 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add69236-2b98-486e-a3c4-a6c516c78d50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:14:40.038723 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add69236-2b98-486e-a3c4-a6c516c78d50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:40.040934 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add69236-2b98-486e-a3c4-a6c516c78d50 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:40.055103 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 991/1977] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:39 2021] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:40.056954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 987/1978] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:14:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:14:40.061479 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0585a26-2cbc-49e9-a188-a39b5d132f83 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:40.068595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add69236-2b98-486e-a3c4-a6c516c78d50 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:40.085786 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add69236-2b98-486e-a3c4-a6c516c78d50 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:40.168797 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0585a26-2cbc-49e9-a188-a39b5d132f83 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:40.174843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca521cf-f1e2-4593-811f-155d8e317a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:40.175715 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca521cf-f1e2-4593-811f-155d8e317a69 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.176081 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca521cf-f1e2-4593-811f-155d8e317a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.176425 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca521cf-f1e2-4593-811f-155d8e317a69 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.177205 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca521cf-f1e2-4593-811f-155d8e317a69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:40.179394 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca521cf-f1e2-4593-811f-155d8e317a69 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:40.196111 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6efcd7-58d8-492b-9ffa-94c8efcffd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:40.196789 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6efcd7-58d8-492b-9ffa-94c8efcffd57 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.197071 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6efcd7-58d8-492b-9ffa-94c8efcffd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.197347 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6efcd7-58d8-492b-9ffa-94c8efcffd57 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.198203 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6efcd7-58d8-492b-9ffa-94c8efcffd57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:40.200706 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6efcd7-58d8-492b-9ffa-94c8efcffd57 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:40.227212 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 992/1979] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:40 2021] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:40.231020 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca521cf-f1e2-4593-811f-155d8e317a69 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:40.232233 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 988/1980] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:40 2021] POST /identity/v3/projects => generated 393 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:14:40.236277 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6efcd7-58d8-492b-9ffa-94c8efcffd57 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:40.244907 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca521cf-f1e2-4593-811f-155d8e317a69 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:40.304820 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6efcd7-58d8-492b-9ffa-94c8efcffd57 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:40.305946 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013ff71-d10d-4778-9a8f-5dca8d5ac6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:40.306697 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013ff71-d10d-4778-9a8f-5dca8d5ac6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.306985 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013ff71-d10d-4778-9a8f-5dca8d5ac6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.307262 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013ff71-d10d-4778-9a8f-5dca8d5ac6f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.308012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013ff71-d10d-4778-9a8f-5dca8d5ac6f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:40.309676 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013ff71-d10d-4778-9a8f-5dca8d5ac6f0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:40.310741 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2c4ac-ec8a-4044-b2d9-3fe7c32e0ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:40.311407 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2c4ac-ec8a-4044-b2d9-3fe7c32e0ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.311690 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2c4ac-ec8a-4044-b2d9-3fe7c32e0ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.311971 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2c4ac-ec8a-4044-b2d9-3fe7c32e0ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.312684 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2c4ac-ec8a-4044-b2d9-3fe7c32e0ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:40.314632 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d2c4ac-ec8a-4044-b2d9-3fe7c32e0ac1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:40.324352 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 993/1981] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:40 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:40.328753 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013ff71-d10d-4778-9a8f-5dca8d5ac6f0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:40.340414 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013ff71-d10d-4778-9a8f-5dca8d5ac6f0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:40.343777 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 989/1982] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:40 2021] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:14:40.345015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2c4ac-ec8a-4044-b2d9-3fe7c32e0ac1 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:40.351135 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a647b9-c55d-4bfe-9881-0a98bdad890d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:40.352546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a647b9-c55d-4bfe-9881-0a98bdad890d admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.352835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a647b9-c55d-4bfe-9881-0a98bdad890d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.353122 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a647b9-c55d-4bfe-9881-0a98bdad890d admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.354233 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a647b9-c55d-4bfe-9881-0a98bdad890d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:40.356051 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a647b9-c55d-4bfe-9881-0a98bdad890d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:40.356636 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2c4ac-ec8a-4044-b2d9-3fe7c32e0ac1 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:40.361672 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a51aa-8ce4-48cf-97ec-5be0cc8b560a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:40.362588 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a51aa-8ce4-48cf-97ec-5be0cc8b560a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.363729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a51aa-8ce4-48cf-97ec-5be0cc8b560a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.364188 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a51aa-8ce4-48cf-97ec-5be0cc8b560a admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.365106 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a51aa-8ce4-48cf-97ec-5be0cc8b560a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:40.366941 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a51aa-8ce4-48cf-97ec-5be0cc8b560a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:40.367409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 994/1983] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:40 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:40.371685 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a647b9-c55d-4bfe-9881-0a98bdad890d admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:40.377557 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 990/1984] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:40 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:14:40.381860 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a51aa-8ce4-48cf-97ec-5be0cc8b560a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:40.382168 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a647b9-c55d-4bfe-9881-0a98bdad890d admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:40.387012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d66892-0f08-44cf-9202-30d86a54affe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:40.387910 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d66892-0f08-44cf-9202-30d86a54affe admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.388192 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d66892-0f08-44cf-9202-30d86a54affe admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.388460 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d66892-0f08-44cf-9202-30d86a54affe admin admin] PATH_INFO: `/v3/projects/ab82399312204a7785fb1adf6c70e0ba/users/96f3dd60e23c44cd8465c22750c86e38/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.392619 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a51aa-8ce4-48cf-97ec-5be0cc8b560a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:40.399338 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c1e35-a50c-4473-8fa9-3ae21983e5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:40.400166 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c1e35-a50c-4473-8fa9-3ae21983e5b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.400674 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c1e35-a50c-4473-8fa9-3ae21983e5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.401170 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470c1e35-a50c-4473-8fa9-3ae21983e5b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.402055 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c1e35-a50c-4473-8fa9-3ae21983e5b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:40.404216 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470c1e35-a50c-4473-8fa9-3ae21983e5b9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:40.406506 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d66892-0f08-44cf-9202-30d86a54affe admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab82399312204a7785fb1adf6c70e0ba, user_id=96f3dd60e23c44cd8465c22750c86e38, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:40.409270 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d66892-0f08-44cf-9202-30d86a54affe admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:40.420272 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 991/1985] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:40 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:14:40.424492 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c1e35-a50c-4473-8fa9-3ae21983e5b9 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:40.429543 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 995/1986] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:40 2021] PUT /identity/v3/projects/ab82399312204a7785fb1adf6c70e0ba/users/96f3dd60e23c44cd8465c22750c86e38/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:40.435204 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470c1e35-a50c-4473-8fa9-3ae21983e5b9 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:40.442572 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09aab15-43b5-41c9-bcb3-6ee1a21024b8 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.443254 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09aab15-43b5-41c9-bcb3-6ee1a21024b8 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.443894 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09aab15-43b5-41c9-bcb3-6ee1a21024b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.476854 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e09aab15-43b5-41c9-bcb3-6ee1a21024b8 None None] MFA Rules not processed for user `96f3dd60e23c44cd8465c22750c86e38`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:40.478279 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e09aab15-43b5-41c9-bcb3-6ee1a21024b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:40.499169 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca22f1-61f3-4327-b0ce-34af56a31b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:40.500106 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca22f1-61f3-4327-b0ce-34af56a31b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.500422 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca22f1-61f3-4327-b0ce-34af56a31b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.500702 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca22f1-61f3-4327-b0ce-34af56a31b75 admin admin] PATH_INFO: `/v3/projects/cbc8761e238f45f68c3223b8c4595eef/users/4100620288484a928f6af9097ad6e70f/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.518659 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca22f1-61f3-4327-b0ce-34af56a31b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbc8761e238f45f68c3223b8c4595eef, user_id=4100620288484a928f6af9097ad6e70f, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:40.521791 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca22f1-61f3-4327-b0ce-34af56a31b75 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:40.536451 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 992/1987] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:40 2021] PUT /identity/v3/projects/cbc8761e238f45f68c3223b8c4595eef/users/4100620288484a928f6af9097ad6e70f/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:40.547001 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3be16-5d39-4e64-aa7d-86b8c389035d None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.547292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3be16-5d39-4e64-aa7d-86b8c389035d None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.547566 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3be16-5d39-4e64-aa7d-86b8c389035d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.553472 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 996/1988] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:40 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:40.558024 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09aab15-43b5-41c9-bcb3-6ee1a21024b8 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:40.574012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09aab15-43b5-41c9-bcb3-6ee1a21024b8 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:40.580964 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-40c3be16-5d39-4e64-aa7d-86b8c389035d None None] MFA Rules not processed for user `4100620288484a928f6af9097ad6e70f`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:40.582383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-40c3be16-5d39-4e64-aa7d-86b8c389035d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:40.663059 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29a528-c7d0-4225-89da-49b95ffd7fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:40.663757 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29a528-c7d0-4225-89da-49b95ffd7fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.664069 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29a528-c7d0-4225-89da-49b95ffd7fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.664340 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f29a528-c7d0-4225-89da-49b95ffd7fe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.665174 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29a528-c7d0-4225-89da-49b95ffd7fe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:40.667158 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f29a528-c7d0-4225-89da-49b95ffd7fe0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:40.671919 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 993/1989] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:40 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:40.676143 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3be16-5d39-4e64-aa7d-86b8c389035d None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:40.688861 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c3be16-5d39-4e64-aa7d-86b8c389035d None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:40.695448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715a15d-3e16-45ac-a38c-55ac92534552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:40.696157 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715a15d-3e16-45ac-a38c-55ac92534552 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.696437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715a15d-3e16-45ac-a38c-55ac92534552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.696725 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715a15d-3e16-45ac-a38c-55ac92534552 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.697782 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715a15d-3e16-45ac-a38c-55ac92534552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:40.699757 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715a15d-3e16-45ac-a38c-55ac92534552 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:40.707980 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 997/1990] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:40 2021] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:40.712779 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29a528-c7d0-4225-89da-49b95ffd7fe0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:40.745144 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 994/1991] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:40 2021] POST /identity/v3/projects => generated 393 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:14:40.749452 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715a15d-3e16-45ac-a38c-55ac92534552 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:40.808981 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f29a528-c7d0-4225-89da-49b95ffd7fe0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:40.824404 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715a15d-3e16-45ac-a38c-55ac92534552 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:40.829399 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784f5c2-fab1-4b10-a9bf-cdebac4b16b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:40.830485 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784f5c2-fab1-4b10-a9bf-cdebac4b16b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.830768 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784f5c2-fab1-4b10-a9bf-cdebac4b16b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.831039 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784f5c2-fab1-4b10-a9bf-cdebac4b16b5 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.832307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784f5c2-fab1-4b10-a9bf-cdebac4b16b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:40.834255 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784f5c2-fab1-4b10-a9bf-cdebac4b16b5 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:40.854935 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 995/1992] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:40 2021] POST /identity/v3/users => generated 303 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:40.859002 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784f5c2-fab1-4b10-a9bf-cdebac4b16b5 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:40.868716 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784f5c2-fab1-4b10-a9bf-cdebac4b16b5 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:40.873747 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64d581-b0e0-41ac-804a-ecdb5f267fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:40.874492 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64d581-b0e0-41ac-804a-ecdb5f267fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.874776 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64d581-b0e0-41ac-804a-ecdb5f267fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.874943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55122a9-b7b6-4eb8-ba5d-b159fdb140f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:40.875061 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d64d581-b0e0-41ac-804a-ecdb5f267fc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.875782 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64d581-b0e0-41ac-804a-ecdb5f267fc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:40.875921 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55122a9-b7b6-4eb8-ba5d-b159fdb140f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.876209 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55122a9-b7b6-4eb8-ba5d-b159fdb140f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.876486 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55122a9-b7b6-4eb8-ba5d-b159fdb140f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.877196 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55122a9-b7b6-4eb8-ba5d-b159fdb140f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:40.877363 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d64d581-b0e0-41ac-804a-ecdb5f267fc7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:40.880666 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55122a9-b7b6-4eb8-ba5d-b159fdb140f3 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:40.888259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 996/1993] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:40 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:14:40.892491 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64d581-b0e0-41ac-804a-ecdb5f267fc7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:40.904403 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d64d581-b0e0-41ac-804a-ecdb5f267fc7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:40.905937 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 998/1994] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:40 2021] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:40.909776 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b899b-9173-4d72-8299-f323e21837a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:40.910405 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55122a9-b7b6-4eb8-ba5d-b159fdb140f3 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:40.910534 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b899b-9173-4d72-8299-f323e21837a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.910797 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b899b-9173-4d72-8299-f323e21837a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.911082 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2b899b-9173-4d72-8299-f323e21837a8 admin admin] PATH_INFO: `/v3/projects/77647b4384584d9ba779bb5d7a436fe1/users/01ba4c0be28b494eaee65535dbfa5ee9/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.921142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55122a9-b7b6-4eb8-ba5d-b159fdb140f3 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:40.926103 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea1081-2713-4c6a-8ee3-83dbcebd55a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:40.926896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea1081-2713-4c6a-8ee3-83dbcebd55a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:40.927279 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea1081-2713-4c6a-8ee3-83dbcebd55a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:40.927405 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b899b-9173-4d72-8299-f323e21837a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77647b4384584d9ba779bb5d7a436fe1, user_id=01ba4c0be28b494eaee65535dbfa5ee9, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:40.927731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beea1081-2713-4c6a-8ee3-83dbcebd55a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:40.928563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea1081-2713-4c6a-8ee3-83dbcebd55a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:40.930055 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2b899b-9173-4d72-8299-f323e21837a8 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:40.930447 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beea1081-2713-4c6a-8ee3-83dbcebd55a6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:40.940750 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 999/1995] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:40 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:14:40.945238 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea1081-2713-4c6a-8ee3-83dbcebd55a6 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:40.947137 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 997/1996] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:40 2021] PUT /identity/v3/projects/77647b4384584d9ba779bb5d7a436fe1/users/01ba4c0be28b494eaee65535dbfa5ee9/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:40.950915 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b899b-9173-4d72-8299-f323e21837a8 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:40.957464 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beea1081-2713-4c6a-8ee3-83dbcebd55a6 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:41.013665 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2b899b-9173-4d72-8299-f323e21837a8 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:41.017801 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea0b1c-a830-4b21-8cf4-380b229af88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:41.017801 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea0b1c-a830-4b21-8cf4-380b229af88c admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:41.017801 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea0b1c-a830-4b21-8cf4-380b229af88c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:41.017801 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea0b1c-a830-4b21-8cf4-380b229af88c admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:41.018182 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea0b1c-a830-4b21-8cf4-380b229af88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:41.019167 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ea0b1c-a830-4b21-8cf4-380b229af88c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:41.021822 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be92a09-ccce-41c5-b863-a231d49c6f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:41.022536 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be92a09-ccce-41c5-b863-a231d49c6f43 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:41.022965 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be92a09-ccce-41c5-b863-a231d49c6f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:41.023250 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be92a09-ccce-41c5-b863-a231d49c6f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:41.023993 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be92a09-ccce-41c5-b863-a231d49c6f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:41.025576 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be92a09-ccce-41c5-b863-a231d49c6f43 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:41.029575 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1000/1997] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:40 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:14:41.033671 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea0b1c-a830-4b21-8cf4-380b229af88c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:41.036188 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 998/1998] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:40 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:14:41.039906 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be92a09-ccce-41c5-b863-a231d49c6f43 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:41.043093 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea0b1c-a830-4b21-8cf4-380b229af88c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:41.047636 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716850d9-8f1f-4a19-9983-ea6b48af046c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:41.048495 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716850d9-8f1f-4a19-9983-ea6b48af046c admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:41.048778 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716850d9-8f1f-4a19-9983-ea6b48af046c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:41.049055 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716850d9-8f1f-4a19-9983-ea6b48af046c admin admin] PATH_INFO: `/v3/projects/4bd96c93bf5c4fab82456748fdad80fa/users/7c90f9ac02ed43a8bdb32f879c771437/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:41.049283 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be92a09-ccce-41c5-b863-a231d49c6f43 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:41.054821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62401af7-877b-4fe0-85b3-c4ed7979d28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:41.055668 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62401af7-877b-4fe0-85b3-c4ed7979d28f admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:41.055947 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62401af7-877b-4fe0-85b3-c4ed7979d28f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:41.056220 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62401af7-877b-4fe0-85b3-c4ed7979d28f admin admin] PATH_INFO: `/v3/projects/77647b4384584d9ba779bb5d7a436fe1/users/01ba4c0be28b494eaee65535dbfa5ee9/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:41.058386 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62401af7-877b-4fe0-85b3-c4ed7979d28f admin admin] RBAC: Authorizing `identity:create_grant(project_id=77647b4384584d9ba779bb5d7a436fe1, user_id=01ba4c0be28b494eaee65535dbfa5ee9, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:41.061197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62401af7-877b-4fe0-85b3-c4ed7979d28f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:41.064403 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716850d9-8f1f-4a19-9983-ea6b48af046c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bd96c93bf5c4fab82456748fdad80fa, user_id=7c90f9ac02ed43a8bdb32f879c771437, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:41.067691 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716850d9-8f1f-4a19-9983-ea6b48af046c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:41.072351 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 999/1999] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:41 2021] PUT /identity/v3/projects/77647b4384584d9ba779bb5d7a436fe1/users/01ba4c0be28b494eaee65535dbfa5ee9/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:41.081344 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1001/2000] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:41 2021] PUT /identity/v3/projects/4bd96c93bf5c4fab82456748fdad80fa/users/7c90f9ac02ed43a8bdb32f879c771437/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:41.083265 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213674-b2ab-45ca-b75f-f0d1311ace11 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:41.083554 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213674-b2ab-45ca-b75f-f0d1311ace11 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:41.083831 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d213674-b2ab-45ca-b75f-f0d1311ace11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:41.093035 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d1a2f-cf0a-49ef-a803-7247f960cb8f None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:41.093324 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d1a2f-cf0a-49ef-a803-7247f960cb8f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:41.093605 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d1a2f-cf0a-49ef-a803-7247f960cb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:41.119520 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-3d213674-b2ab-45ca-b75f-f0d1311ace11 None None] MFA Rules not processed for user `01ba4c0be28b494eaee65535dbfa5ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:41.120777 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3d213674-b2ab-45ca-b75f-f0d1311ace11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:41.121379 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-a60d1a2f-cf0a-49ef-a803-7247f960cb8f None None] MFA Rules not processed for user `7c90f9ac02ed43a8bdb32f879c771437`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:41.122769 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a60d1a2f-cf0a-49ef-a803-7247f960cb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:41.193330 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1000/2001] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:41 2021] POST /identity/v3/auth/tokens => generated 3480 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:41.197147 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9681ffc-4707-4563-ad1e-7f0ae9be749f None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:41.197147 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9681ffc-4707-4563-ad1e-7f0ae9be749f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:41.197147 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9681ffc-4707-4563-ad1e-7f0ae9be749f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:41.198464 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1002/2002] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:41 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:41.202710 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d1a2f-cf0a-49ef-a803-7247f960cb8f None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:41.214989 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-e9681ffc-4707-4563-ad1e-7f0ae9be749f None None] MFA Rules not processed for user `b6297514861943ba84efd7389e047a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:41.216181 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e9681ffc-4707-4563-ad1e-7f0ae9be749f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:41.276215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1001/2003] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:41 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:41.277224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9681ffc-4707-4563-ad1e-7f0ae9be749f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:41.278648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e9681ffc-4707-4563-ad1e-7f0ae9be749f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:41.283319 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d1a2f-cf0a-49ef-a803-7247f960cb8f None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:41.288882 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abc542-4e5c-434c-b862-d22d577c0f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:41.289751 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abc542-4e5c-434c-b862-d22d577c0f98 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:41.290349 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abc542-4e5c-434c-b862-d22d577c0f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:41.290781 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abc542-4e5c-434c-b862-d22d577c0f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:41.291677 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abc542-4e5c-434c-b862-d22d577c0f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:41.293789 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abc542-4e5c-434c-b862-d22d577c0f98 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:41.330155 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1003/2004] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:41 2021] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:41.334265 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abc542-4e5c-434c-b862-d22d577c0f98 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:41.376667 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9681ffc-4707-4563-ad1e-7f0ae9be749f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:41.406689 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abc542-4e5c-434c-b862-d22d577c0f98 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:41.412617 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6572c41-28cd-4799-bb39-f3310392f09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:41.413368 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6572c41-28cd-4799-bb39-f3310392f09f admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:41.414225 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6572c41-28cd-4799-bb39-f3310392f09f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:41.414225 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6572c41-28cd-4799-bb39-f3310392f09f admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:41.414877 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6572c41-28cd-4799-bb39-f3310392f09f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:41.417018 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6572c41-28cd-4799-bb39-f3310392f09f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:41.445041 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1004/2005] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:41 2021] POST /identity/v3/users => generated 295 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:41.446863 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6572c41-28cd-4799-bb39-f3310392f09f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:41.456628 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcb0dc-d792-41f5-8065-38a79a22d261 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:41.457807 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcb0dc-d792-41f5-8065-38a79a22d261 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:41.458421 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6572c41-28cd-4799-bb39-f3310392f09f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:41.459095 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcb0dc-d792-41f5-8065-38a79a22d261 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:41.459384 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bcb0dc-d792-41f5-8065-38a79a22d261 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:41.465781 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaf444-292c-4887-a32d-756c40bf95c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:41.466517 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf444-292c-4887-a32d-756c40bf95c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:41.466802 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf444-292c-4887-a32d-756c40bf95c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:41.467081 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcaf444-292c-4887-a32d-756c40bf95c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:41.467835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaf444-292c-4887-a32d-756c40bf95c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:41.469517 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcaf444-292c-4887-a32d-756c40bf95c8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:41.481979 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1005/2006] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:41 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:41.483958 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaf444-292c-4887-a32d-756c40bf95c8 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:41.503249 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcaf444-292c-4887-a32d-756c40bf95c8 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:41.513484 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91911621-22d7-4e65-bfe7-7a5b10421934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:41.514938 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91911621-22d7-4e65-bfe7-7a5b10421934 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:41.515183 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91911621-22d7-4e65-bfe7-7a5b10421934 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:41.515641 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91911621-22d7-4e65-bfe7-7a5b10421934 admin admin] PATH_INFO: `/v3/projects/e243e3885abe4138888ba93c72f05b54/users/98436391911c4f1d8eba8411a238aa24/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:41.536204 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91911621-22d7-4e65-bfe7-7a5b10421934 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e243e3885abe4138888ba93c72f05b54, user_id=98436391911c4f1d8eba8411a238aa24, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:41.536507 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcb0dc-d792-41f5-8065-38a79a22d261 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:41.538011 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bcb0dc-d792-41f5-8065-38a79a22d261 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:41.538930 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91911621-22d7-4e65-bfe7-7a5b10421934 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:41.551488 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1002/2007] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:41 2021] GET /identity/v3/auth/tokens => generated 3480 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:41.561891 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1006/2008] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:41 2021] PUT /identity/v3/projects/e243e3885abe4138888ba93c72f05b54/users/98436391911c4f1d8eba8411a238aa24/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:41.566544 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcb0dc-d792-41f5-8065-38a79a22d261 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:41.586523 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bcb0dc-d792-41f5-8065-38a79a22d261 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:41.600669 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91911621-22d7-4e65-bfe7-7a5b10421934 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:41.604380 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-91911621-22d7-4e65-bfe7-7a5b10421934 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:41.688898 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf853de-59d5-4afc-9e1e-acf1b015c6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:41.689702 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf853de-59d5-4afc-9e1e-acf1b015c6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:41.690137 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf853de-59d5-4afc-9e1e-acf1b015c6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:41.690241 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91911621-22d7-4e65-bfe7-7a5b10421934 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:41.691692 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf853de-59d5-4afc-9e1e-acf1b015c6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:41.692518 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf853de-59d5-4afc-9e1e-acf1b015c6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:41.694235 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf853de-59d5-4afc-9e1e-acf1b015c6e7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:41.695894 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0299e7a-2fe4-4968-96ca-79bae2b3046a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:41.696649 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0299e7a-2fe4-4968-96ca-79bae2b3046a service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:41.697031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0299e7a-2fe4-4968-96ca-79bae2b3046a service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:41.697407 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0299e7a-2fe4-4968-96ca-79bae2b3046a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:41.705974 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1003/2009] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:41 2021] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:41.710183 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf853de-59d5-4afc-9e1e-acf1b015c6e7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:41.725624 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf853de-59d5-4afc-9e1e-acf1b015c6e7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:41.730457 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d544a-7f31-4c18-95a6-71767c531c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:41.731397 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d544a-7f31-4c18-95a6-71767c531c14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:41.731682 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d544a-7f31-4c18-95a6-71767c531c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:41.731963 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d544a-7f31-4c18-95a6-71767c531c14 admin admin] PATH_INFO: `/v3/projects/e243e3885abe4138888ba93c72f05b54/users/98436391911c4f1d8eba8411a238aa24/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:41.734077 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d544a-7f31-4c18-95a6-71767c531c14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e243e3885abe4138888ba93c72f05b54, user_id=98436391911c4f1d8eba8411a238aa24, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:41.736746 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d544a-7f31-4c18-95a6-71767c531c14 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:41.748450 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1004/2010] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:41 2021] PUT /identity/v3/projects/e243e3885abe4138888ba93c72f05b54/users/98436391911c4f1d8eba8411a238aa24/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:41.763549 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcbbd1-dcb2-4829-ac71-a776c42d2824 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:41.764040 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcbbd1-dcb2-4829-ac71-a776c42d2824 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:41.764469 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcbbd1-dcb2-4829-ac71-a776c42d2824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:41.793880 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0299e7a-2fe4-4968-96ca-79bae2b3046a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:41.795802 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0299e7a-2fe4-4968-96ca-79bae2b3046a service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:41.807761 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1007/2011] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:41 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:41.812858 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-12bcbbd1-dcb2-4829-ac71-a776c42d2824 None None] MFA Rules not processed for user `98436391911c4f1d8eba8411a238aa24`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:41.819635 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-12bcbbd1-dcb2-4829-ac71-a776c42d2824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:41.924435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1005/2012] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:41 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:41.938301 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0299e7a-2fe4-4968-96ca-79bae2b3046a service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:41.954452 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0299e7a-2fe4-4968-96ca-79bae2b3046a service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:42.047878 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bad4d4-f9c9-4db7-b795-0f882c9b3018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:42.048558 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bad4d4-f9c9-4db7-b795-0f882c9b3018 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:42.048834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bad4d4-f9c9-4db7-b795-0f882c9b3018 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:42.049108 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bad4d4-f9c9-4db7-b795-0f882c9b3018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:42.160784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bad4d4-f9c9-4db7-b795-0f882c9b3018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:42.163568 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bad4d4-f9c9-4db7-b795-0f882c9b3018 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:42.178136 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1008/2013] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:41 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:43.866868 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcbbd1-dcb2-4829-ac71-a776c42d2824 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:43.878491 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcbbd1-dcb2-4829-ac71-a776c42d2824 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:43.890413 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595968f4-ef13-4b0d-8e98-3be3f6ee5453 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:43.891070 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595968f4-ef13-4b0d-8e98-3be3f6ee5453 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:43.891352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595968f4-ef13-4b0d-8e98-3be3f6ee5453 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:43.891625 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595968f4-ef13-4b0d-8e98-3be3f6ee5453 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:43.963146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595968f4-ef13-4b0d-8e98-3be3f6ee5453 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:43.964601 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595968f4-ef13-4b0d-8e98-3be3f6ee5453 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:43.974502 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1006/2014] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:43 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:44.692564 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bad4d4-f9c9-4db7-b795-0f882c9b3018 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:44.701307 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bad4d4-f9c9-4db7-b795-0f882c9b3018 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:44.705471 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dd1a9d-6cae-41dc-ae24-71a60f1749ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:44.706249 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd1a9d-6cae-41dc-ae24-71a60f1749ce service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:44.707140 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd1a9d-6cae-41dc-ae24-71a60f1749ce service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:44.707499 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dd1a9d-6cae-41dc-ae24-71a60f1749ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:44.718115 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd1a9d-6cae-41dc-ae24-71a60f1749ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:44.719555 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dd1a9d-6cae-41dc-ae24-71a60f1749ce service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:44.730408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1009/2015] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:44 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:45.499183 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595968f4-ef13-4b0d-8e98-3be3f6ee5453 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:45.566912 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595968f4-ef13-4b0d-8e98-3be3f6ee5453 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:45.572292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b79bb-cff7-44ee-9712-707b6513c4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:45.573248 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b79bb-cff7-44ee-9712-707b6513c4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:45.573597 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b79bb-cff7-44ee-9712-707b6513c4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:45.573990 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b79bb-cff7-44ee-9712-707b6513c4c6 admin admin] PATH_INFO: `/v3/users/4100620288484a928f6af9097ad6e70f` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:45.575592 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b79bb-cff7-44ee-9712-707b6513c4c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4100620288484a928f6af9097ad6e70f)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:45.577627 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b79bb-cff7-44ee-9712-707b6513c4c6 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:45.646041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b25b79bb-cff7-44ee-9712-707b6513c4c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4100620288484a928f6af9097ad6e70f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:45.653393 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b25b79bb-cff7-44ee-9712-707b6513c4c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4100620288484a928f6af9097ad6e70f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:45.661112 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b25b79bb-cff7-44ee-9712-707b6513c4c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4100620288484a928f6af9097ad6e70f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:45.661780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b25b79bb-cff7-44ee-9712-707b6513c4c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4100620288484a928f6af9097ad6e70f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:45.675759 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b25b79bb-cff7-44ee-9712-707b6513c4c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4100620288484a928f6af9097ad6e70f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:45.684087 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1007/2016] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:45 2021] DELETE /identity/v3/users/4100620288484a928f6af9097ad6e70f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:45.689117 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae666124-7852-4fe9-b69f-6cf0aa86f38b None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:45.689403 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae666124-7852-4fe9-b69f-6cf0aa86f38b None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:45.689676 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae666124-7852-4fe9-b69f-6cf0aa86f38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:45.711743 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-ae666124-7852-4fe9-b69f-6cf0aa86f38b None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:45.713016 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ae666124-7852-4fe9-b69f-6cf0aa86f38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:45.790266 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1010/2017] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:45.802817 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b79bb-cff7-44ee-9712-707b6513c4c6 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:45.804288 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-b25b79bb-cff7-44ee-9712-707b6513c4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:45.905526 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b79bb-cff7-44ee-9712-707b6513c4c6 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:45.909461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4628ca2-836c-4848-86c4-01a8d9d839f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:45.910610 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4628ca2-836c-4848-86c4-01a8d9d839f2 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:45.911047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4628ca2-836c-4848-86c4-01a8d9d839f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:45.911856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4628ca2-836c-4848-86c4-01a8d9d839f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:45.927192 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4628ca2-836c-4848-86c4-01a8d9d839f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:45.928916 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4628ca2-836c-4848-86c4-01a8d9d839f2 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:45.944165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1008/2018] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:46.841087 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae666124-7852-4fe9-b69f-6cf0aa86f38b None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:46.842743 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ae666124-7852-4fe9-b69f-6cf0aa86f38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:46.868212 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae666124-7852-4fe9-b69f-6cf0aa86f38b None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:46.873511 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63de9f-f0c7-4e43-8627-3b181e340ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:46.875051 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63de9f-f0c7-4e43-8627-3b181e340ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:46.875903 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63de9f-f0c7-4e43-8627-3b181e340ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:46.876428 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63de9f-f0c7-4e43-8627-3b181e340ea3 admin admin] PATH_INFO: `/v3/projects/cbc8761e238f45f68c3223b8c4595eef` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:46.877649 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63de9f-f0c7-4e43-8627-3b181e340ea3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbc8761e238f45f68c3223b8c4595eef)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:46.879660 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d63de9f-f0c7-4e43-8627-3b181e340ea3 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:46.947417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-9d63de9f-f0c7-4e43-8627-3b181e340ea3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbc8761e238f45f68c3223b8c4595eef', 'request_id': 'req-9d63de9f-f0c7-4e43-8627-3b181e340ea3'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:46.952975 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-9d63de9f-f0c7-4e43-8627-3b181e340ea3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbc8761e238f45f68c3223b8c4595eef', 'request_id': 'req-9d63de9f-f0c7-4e43-8627-3b181e340ea3'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:46.964280 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-9d63de9f-f0c7-4e43-8627-3b181e340ea3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbc8761e238f45f68c3223b8c4595eef', 'request_id': 'req-9d63de9f-f0c7-4e43-8627-3b181e340ea3'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:46.976483 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-9d63de9f-f0c7-4e43-8627-3b181e340ea3 admin admin] The token cache is being invalidate because project cbc8761e238f45f68c3223b8c4595eef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:46.976823 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-9d63de9f-f0c7-4e43-8627-3b181e340ea3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:46.977484 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-9d63de9f-f0c7-4e43-8627-3b181e340ea3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:46.979391 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1011/2019] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:46 2021] DELETE /identity/v3/projects/cbc8761e238f45f68c3223b8c4595eef => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:46.983140 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4628ca2-836c-4848-86c4-01a8d9d839f2 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:46.992677 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4628ca2-836c-4848-86c4-01a8d9d839f2 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:47.050277 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ecceba-bf31-4fe9-a3df-49f979d67f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:47.051178 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecceba-bf31-4fe9-a3df-49f979d67f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:47.051465 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecceba-bf31-4fe9-a3df-49f979d67f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:47.051744 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ecceba-bf31-4fe9-a3df-49f979d67f00 admin admin] PATH_INFO: `/v3/users/01ba4c0be28b494eaee65535dbfa5ee9` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:47.053003 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecceba-bf31-4fe9-a3df-49f979d67f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01ba4c0be28b494eaee65535dbfa5ee9)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:47.055087 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ecceba-bf31-4fe9-a3df-49f979d67f00 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:47.102026 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f5ecceba-bf31-4fe9-a3df-49f979d67f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ba4c0be28b494eaee65535dbfa5ee9'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:47.111274 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f5ecceba-bf31-4fe9-a3df-49f979d67f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ba4c0be28b494eaee65535dbfa5ee9'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:47.118362 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f5ecceba-bf31-4fe9-a3df-49f979d67f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ba4c0be28b494eaee65535dbfa5ee9'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:47.119057 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f5ecceba-bf31-4fe9-a3df-49f979d67f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ba4c0be28b494eaee65535dbfa5ee9'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:47.131674 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f5ecceba-bf31-4fe9-a3df-49f979d67f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ba4c0be28b494eaee65535dbfa5ee9'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:47.137612 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1009/2020] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:46 2021] DELETE /identity/v3/users/01ba4c0be28b494eaee65535dbfa5ee9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:47.436368 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63de9f-f0c7-4e43-8627-3b181e340ea3 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:47.438898 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-9d63de9f-f0c7-4e43-8627-3b181e340ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:47.461222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63de9f-f0c7-4e43-8627-3b181e340ea3 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:47.550657 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380b9c4-2a4a-4651-811b-abcfe0554e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:47.552081 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380b9c4-2a4a-4651-811b-abcfe0554e9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:47.552606 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380b9c4-2a4a-4651-811b-abcfe0554e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:47.553102 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380b9c4-2a4a-4651-811b-abcfe0554e9d admin admin] PATH_INFO: `/v3/projects/77647b4384584d9ba779bb5d7a436fe1` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:47.555014 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380b9c4-2a4a-4651-811b-abcfe0554e9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=77647b4384584d9ba779bb5d7a436fe1)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:47.557212 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380b9c4-2a4a-4651-811b-abcfe0554e9d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:47.633637 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8380b9c4-2a4a-4651-811b-abcfe0554e9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77647b4384584d9ba779bb5d7a436fe1', 'request_id': 'req-8380b9c4-2a4a-4651-811b-abcfe0554e9d'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:47.640266 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8380b9c4-2a4a-4651-811b-abcfe0554e9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77647b4384584d9ba779bb5d7a436fe1', 'request_id': 'req-8380b9c4-2a4a-4651-811b-abcfe0554e9d'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:47.658033 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8380b9c4-2a4a-4651-811b-abcfe0554e9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77647b4384584d9ba779bb5d7a436fe1', 'request_id': 'req-8380b9c4-2a4a-4651-811b-abcfe0554e9d'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:47.677536 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8380b9c4-2a4a-4651-811b-abcfe0554e9d admin admin] The token cache is being invalidate because project 77647b4384584d9ba779bb5d7a436fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:47.679314 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8380b9c4-2a4a-4651-811b-abcfe0554e9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:47.680982 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8380b9c4-2a4a-4651-811b-abcfe0554e9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:47.691976 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1012/2021] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:47 2021] DELETE /identity/v3/projects/77647b4384584d9ba779bb5d7a436fe1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:47.692927 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f7764-ddde-47fd-b09b-0354017e4074 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:47.693221 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f7764-ddde-47fd-b09b-0354017e4074 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:47.693498 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f7764-ddde-47fd-b09b-0354017e4074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:47.731586 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-189f7764-ddde-47fd-b09b-0354017e4074 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:47.732823 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-189f7764-ddde-47fd-b09b-0354017e4074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:47.825255 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1010/2022] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:47.833275 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf327c-47a6-45f6-932c-8b6aea1be70f None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:47.833564 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf327c-47a6-45f6-932c-8b6aea1be70f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:47.833839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf327c-47a6-45f6-932c-8b6aea1be70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:47.868300 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-9aaf327c-47a6-45f6-932c-8b6aea1be70f None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:47.869552 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-9aaf327c-47a6-45f6-932c-8b6aea1be70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:47.882974 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1013/2023] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:47.888047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f7764-ddde-47fd-b09b-0354017e4074 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:47.900821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f7764-ddde-47fd-b09b-0354017e4074 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:47.906872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206dac7-5bbc-438b-8978-bd78a819a498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:47.908875 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206dac7-5bbc-438b-8978-bd78a819a498 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:47.908875 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206dac7-5bbc-438b-8978-bd78a819a498 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:47.908875 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206dac7-5bbc-438b-8978-bd78a819a498 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:47.909247 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206dac7-5bbc-438b-8978-bd78a819a498 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:14:47.909799 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206dac7-5bbc-438b-8978-bd78a819a498 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:47.913117 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206dac7-5bbc-438b-8978-bd78a819a498 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:47.926969 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1011/2024] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:14:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:14:47.931406 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf327c-47a6-45f6-932c-8b6aea1be70f None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:47.942170 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf327c-47a6-45f6-932c-8b6aea1be70f None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:47.947069 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a3ea3-e10e-4014-b78e-54879359655d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:47.947732 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a3ea3-e10e-4014-b78e-54879359655d admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:47.948146 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a3ea3-e10e-4014-b78e-54879359655d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:47.948422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a3ea3-e10e-4014-b78e-54879359655d admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:47.949138 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a3ea3-e10e-4014-b78e-54879359655d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:47.951134 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a3ea3-e10e-4014-b78e-54879359655d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:47.980322 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1014/2025] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:47 2021] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:47.981525 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206dac7-5bbc-438b-8978-bd78a819a498 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:47.992402 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206dac7-5bbc-438b-8978-bd78a819a498 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:48.051120 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6740f-16fa-4974-88d5-5f496a8dc4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:48.051799 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6740f-16fa-4974-88d5-5f496a8dc4f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:48.052083 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6740f-16fa-4974-88d5-5f496a8dc4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:48.052356 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe6740f-16fa-4974-88d5-5f496a8dc4f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:48.053064 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6740f-16fa-4974-88d5-5f496a8dc4f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:48.055008 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe6740f-16fa-4974-88d5-5f496a8dc4f5 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:48.079193 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1012/2026] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:47 2021] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:48.080988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a3ea3-e10e-4014-b78e-54879359655d admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:48.091491 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a3ea3-e10e-4014-b78e-54879359655d admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:48.096276 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e90798-a65e-43fe-bb8a-ac9ccf62c72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:48.097512 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e90798-a65e-43fe-bb8a-ac9ccf62c72a admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:48.097821 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e90798-a65e-43fe-bb8a-ac9ccf62c72a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:48.098078 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e90798-a65e-43fe-bb8a-ac9ccf62c72a admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:48.098825 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e90798-a65e-43fe-bb8a-ac9ccf62c72a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:48.100414 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e90798-a65e-43fe-bb8a-ac9ccf62c72a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:48.113704 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1015/2027] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:48 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:14:48.117670 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6740f-16fa-4974-88d5-5f496a8dc4f5 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:48.127827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe6740f-16fa-4974-88d5-5f496a8dc4f5 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:48.132558 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded3b97-e7a3-4134-8608-8a3685755e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:48.133243 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded3b97-e7a3-4134-8608-8a3685755e8b admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:48.133528 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded3b97-e7a3-4134-8608-8a3685755e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:48.133803 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded3b97-e7a3-4134-8608-8a3685755e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:48.134577 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded3b97-e7a3-4134-8608-8a3685755e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:48.136193 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded3b97-e7a3-4134-8608-8a3685755e8b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:48.150622 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1013/2028] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:48.152539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e90798-a65e-43fe-bb8a-ac9ccf62c72a admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:48.163270 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e90798-a65e-43fe-bb8a-ac9ccf62c72a admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:48.167822 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98df2c-31ac-4f57-a33b-2ea78b554b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:48.168693 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98df2c-31ac-4f57-a33b-2ea78b554b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:48.168973 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98df2c-31ac-4f57-a33b-2ea78b554b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:48.169243 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd98df2c-31ac-4f57-a33b-2ea78b554b53 admin admin] PATH_INFO: `/v3/projects/593ce660a9854cc39307d1b88673e99c/users/02e2d3f2b5034581953cc25b3abf1cff/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:48.184169 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98df2c-31ac-4f57-a33b-2ea78b554b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=593ce660a9854cc39307d1b88673e99c, user_id=02e2d3f2b5034581953cc25b3abf1cff, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:48.186886 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd98df2c-31ac-4f57-a33b-2ea78b554b53 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:48.202108 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1016/2029] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:48 2021] PUT /identity/v3/projects/593ce660a9854cc39307d1b88673e99c/users/02e2d3f2b5034581953cc25b3abf1cff/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:48.212907 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caad39-eb50-46da-85b2-c5254c8525e1 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:48.213205 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caad39-eb50-46da-85b2-c5254c8525e1 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:48.213490 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caad39-eb50-46da-85b2-c5254c8525e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:48.242484 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-e2caad39-eb50-46da-85b2-c5254c8525e1 None None] MFA Rules not processed for user `02e2d3f2b5034581953cc25b3abf1cff`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:48.244352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e2caad39-eb50-46da-85b2-c5254c8525e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:48.320000 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1014/2030] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:48 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:48.324482 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98df2c-31ac-4f57-a33b-2ea78b554b53 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:48.392342 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd98df2c-31ac-4f57-a33b-2ea78b554b53 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:48.397511 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf48b65-1a61-4b99-b394-190a47c88e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:48.398148 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf48b65-1a61-4b99-b394-190a47c88e3b admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:48.398437 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf48b65-1a61-4b99-b394-190a47c88e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:48.398719 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf48b65-1a61-4b99-b394-190a47c88e3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:48.399534 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf48b65-1a61-4b99-b394-190a47c88e3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:48.401503 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf48b65-1a61-4b99-b394-190a47c88e3b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:48.428025 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1017/2031] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:48 2021] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:14:48.432050 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caad39-eb50-46da-85b2-c5254c8525e1 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:48.442623 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caad39-eb50-46da-85b2-c5254c8525e1 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:48.497330 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f09c7d-89d5-4f08-89d9-740f6b763365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:48.498031 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f09c7d-89d5-4f08-89d9-740f6b763365 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:48.498319 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f09c7d-89d5-4f08-89d9-740f6b763365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:48.498595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f09c7d-89d5-4f08-89d9-740f6b763365 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:48.499302 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f09c7d-89d5-4f08-89d9-740f6b763365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:48.501211 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f09c7d-89d5-4f08-89d9-740f6b763365 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:48.520678 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1015/2032] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:48 2021] POST /identity/v3/users => generated 298 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:48.526095 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf48b65-1a61-4b99-b394-190a47c88e3b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:48.535647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf48b65-1a61-4b99-b394-190a47c88e3b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:48.540313 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2327637-297a-4aca-81bc-83cf397e372e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:48.540982 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2327637-297a-4aca-81bc-83cf397e372e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:48.541265 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2327637-297a-4aca-81bc-83cf397e372e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:48.541544 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2327637-297a-4aca-81bc-83cf397e372e admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:48.542320 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2327637-297a-4aca-81bc-83cf397e372e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:48.543929 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2327637-297a-4aca-81bc-83cf397e372e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:48.554101 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1018/2033] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:48 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:48.558218 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f09c7d-89d5-4f08-89d9-740f6b763365 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:48.567960 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f09c7d-89d5-4f08-89d9-740f6b763365 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:48.572551 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554155b-4f99-489a-868c-f214a8cfe84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:48.573417 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554155b-4f99-489a-868c-f214a8cfe84d admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:48.573833 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554155b-4f99-489a-868c-f214a8cfe84d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:48.574095 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554155b-4f99-489a-868c-f214a8cfe84d admin admin] PATH_INFO: `/v3/projects/bac09b07029e44098a7ca64d564caeb6/users/725db863e7f44058be033761d9a389ef/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:48.591339 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554155b-4f99-489a-868c-f214a8cfe84d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bac09b07029e44098a7ca64d564caeb6, user_id=725db863e7f44058be033761d9a389ef, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:48.594082 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554155b-4f99-489a-868c-f214a8cfe84d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:48.612107 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1016/2034] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:48 2021] PUT /identity/v3/projects/bac09b07029e44098a7ca64d564caeb6/users/725db863e7f44058be033761d9a389ef/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:48.615870 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2327637-297a-4aca-81bc-83cf397e372e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:48.625510 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2327637-297a-4aca-81bc-83cf397e372e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:48.652681 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554155b-4f99-489a-868c-f214a8cfe84d admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:48.654921 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d554155b-4f99-489a-868c-f214a8cfe84d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:48.688347 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55da6cb-ed7f-440c-8771-a8695a62363d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:48.689261 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55da6cb-ed7f-440c-8771-a8695a62363d admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:48.689647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55da6cb-ed7f-440c-8771-a8695a62363d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:48.690066 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55da6cb-ed7f-440c-8771-a8695a62363d admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:48.691188 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55da6cb-ed7f-440c-8771-a8695a62363d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:48.693013 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55da6cb-ed7f-440c-8771-a8695a62363d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:48.703797 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1019/2035] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:48 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:48.709122 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55da6cb-ed7f-440c-8771-a8695a62363d admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:48.719609 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55da6cb-ed7f-440c-8771-a8695a62363d admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:48.724991 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5e6eba-b165-480d-a255-47d1e8008884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:48.725899 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e6eba-b165-480d-a255-47d1e8008884 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:48.726210 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e6eba-b165-480d-a255-47d1e8008884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:48.726490 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5e6eba-b165-480d-a255-47d1e8008884 admin admin] PATH_INFO: `/v3/projects/bac09b07029e44098a7ca64d564caeb6/users/725db863e7f44058be033761d9a389ef/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:48.728562 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e6eba-b165-480d-a255-47d1e8008884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bac09b07029e44098a7ca64d564caeb6, user_id=725db863e7f44058be033761d9a389ef, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:48.732548 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5e6eba-b165-480d-a255-47d1e8008884 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:48.746074 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1020/2036] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:48 2021] PUT /identity/v3/projects/bac09b07029e44098a7ca64d564caeb6/users/725db863e7f44058be033761d9a389ef/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:48.758984 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afa1a3-ba3c-40e6-a185-d72811439773 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:48.759268 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afa1a3-ba3c-40e6-a185-d72811439773 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:48.759548 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19afa1a3-ba3c-40e6-a185-d72811439773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:48.792221 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-19afa1a3-ba3c-40e6-a185-d72811439773 None None] MFA Rules not processed for user `725db863e7f44058be033761d9a389ef`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:48.793458 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-19afa1a3-ba3c-40e6-a185-d72811439773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:48.845503 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554155b-4f99-489a-868c-f214a8cfe84d admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:48.875096 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1021/2037] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:48 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:48.885750 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afa1a3-ba3c-40e6-a185-d72811439773 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:48.887487 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-19afa1a3-ba3c-40e6-a185-d72811439773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:48.917415 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbc26d-250a-4a91-afcc-52cac62acd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:48.917415 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbc26d-250a-4a91-afcc-52cac62acd94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:48.917415 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbc26d-250a-4a91-afcc-52cac62acd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:48.917415 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbc26d-250a-4a91-afcc-52cac62acd94 admin admin] PATH_INFO: `/v3/users/96f3dd60e23c44cd8465c22750c86e38` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:48.918451 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbc26d-250a-4a91-afcc-52cac62acd94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96f3dd60e23c44cd8465c22750c86e38)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:48.920492 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbc26d-250a-4a91-afcc-52cac62acd94 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:48.959236 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19afa1a3-ba3c-40e6-a185-d72811439773 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:48.962935 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da047146-2c2c-4de6-8f16-b7bfb7a06323 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:48.963895 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da047146-2c2c-4de6-8f16-b7bfb7a06323 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:48.964010 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da047146-2c2c-4de6-8f16-b7bfb7a06323 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:48.964299 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da047146-2c2c-4de6-8f16-b7bfb7a06323 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:48.969198 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0ebbc26d-250a-4a91-afcc-52cac62acd94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96f3dd60e23c44cd8465c22750c86e38'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:48.980303 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0ebbc26d-250a-4a91-afcc-52cac62acd94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96f3dd60e23c44cd8465c22750c86e38'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:48.981778 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da047146-2c2c-4de6-8f16-b7bfb7a06323 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:48.983643 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da047146-2c2c-4de6-8f16-b7bfb7a06323 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:48.989065 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0ebbc26d-250a-4a91-afcc-52cac62acd94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96f3dd60e23c44cd8465c22750c86e38'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:48.989975 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0ebbc26d-250a-4a91-afcc-52cac62acd94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96f3dd60e23c44cd8465c22750c86e38'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:48.997154 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1022/2038] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:48 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:49.004535 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0ebbc26d-250a-4a91-afcc-52cac62acd94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96f3dd60e23c44cd8465c22750c86e38'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:49.015653 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1017/2039] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:48 2021] DELETE /identity/v3/users/96f3dd60e23c44cd8465c22750c86e38 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:49.020873 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd51fb-73ef-460f-a205-66abe55033e6 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:49.021162 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd51fb-73ef-460f-a205-66abe55033e6 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:49.021444 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bd51fb-73ef-460f-a205-66abe55033e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:49.039349 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-94bd51fb-73ef-460f-a205-66abe55033e6 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:49.040837 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-94bd51fb-73ef-460f-a205-66abe55033e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:49.095878 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbc26d-250a-4a91-afcc-52cac62acd94 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:49.097445 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-0ebbc26d-250a-4a91-afcc-52cac62acd94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:49.117888 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1023/2040] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:49.129050 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd51fb-73ef-460f-a205-66abe55033e6 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:49.130613 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-94bd51fb-73ef-460f-a205-66abe55033e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:49.157794 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbc26d-250a-4a91-afcc-52cac62acd94 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:49.163030 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb8aa8-96d9-40f1-9267-a6b92d7431a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:49.163757 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb8aa8-96d9-40f1-9267-a6b92d7431a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:49.164384 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb8aa8-96d9-40f1-9267-a6b92d7431a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:49.164736 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcb8aa8-96d9-40f1-9267-a6b92d7431a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:49.167205 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-5fcb8aa8-96d9-40f1-9267-a6b92d7431a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:49.199248 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bd51fb-73ef-460f-a205-66abe55033e6 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:49.202976 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a464ca-d177-4819-89ee-806366fcdcba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:49.203881 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a464ca-d177-4819-89ee-806366fcdcba service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:49.204167 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a464ca-d177-4819-89ee-806366fcdcba service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:49.204435 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a464ca-d177-4819-89ee-806366fcdcba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:49.216402 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a464ca-d177-4819-89ee-806366fcdcba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:49.218118 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a464ca-d177-4819-89ee-806366fcdcba service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:49.231561 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1024/2041] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:14:49.235101 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb8aa8-96d9-40f1-9267-a6b92d7431a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:49.236661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcb8aa8-96d9-40f1-9267-a6b92d7431a1 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:49.252718 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1018/2042] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:49 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:14:49.565138 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a464ca-d177-4819-89ee-806366fcdcba service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:49.567286 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-d4a464ca-d177-4819-89ee-806366fcdcba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:49.584868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a464ca-d177-4819-89ee-806366fcdcba service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:49.590385 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bef495-d18c-412c-aaf0-4b39a3127eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:49.591454 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bef495-d18c-412c-aaf0-4b39a3127eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:49.591930 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bef495-d18c-412c-aaf0-4b39a3127eba admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:49.592378 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bef495-d18c-412c-aaf0-4b39a3127eba admin admin] PATH_INFO: `/v3/projects/ab82399312204a7785fb1adf6c70e0ba` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:49.594522 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bef495-d18c-412c-aaf0-4b39a3127eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab82399312204a7785fb1adf6c70e0ba)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:49.596261 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bef495-d18c-412c-aaf0-4b39a3127eba admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:49.664879 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-11bef495-d18c-412c-aaf0-4b39a3127eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab82399312204a7785fb1adf6c70e0ba', 'request_id': 'req-11bef495-d18c-412c-aaf0-4b39a3127eba'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:49.674587 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-11bef495-d18c-412c-aaf0-4b39a3127eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab82399312204a7785fb1adf6c70e0ba', 'request_id': 'req-11bef495-d18c-412c-aaf0-4b39a3127eba'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:49.685044 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-11bef495-d18c-412c-aaf0-4b39a3127eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab82399312204a7785fb1adf6c70e0ba', 'request_id': 'req-11bef495-d18c-412c-aaf0-4b39a3127eba'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:49.697798 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-11bef495-d18c-412c-aaf0-4b39a3127eba admin admin] The token cache is being invalidate because project ab82399312204a7785fb1adf6c70e0ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:49.698262 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-11bef495-d18c-412c-aaf0-4b39a3127eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:49.699317 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-11bef495-d18c-412c-aaf0-4b39a3127eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:49.704008 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1025/2043] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:49 2021] DELETE /identity/v3/projects/ab82399312204a7785fb1adf6c70e0ba => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:49.705164 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb8aa8-96d9-40f1-9267-a6b92d7431a1 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:49.716020 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcb8aa8-96d9-40f1-9267-a6b92d7431a1 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:49.776244 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e96c06-1734-45db-ad74-f60a15c2dc46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:49.777126 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e96c06-1734-45db-ad74-f60a15c2dc46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:49.777407 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e96c06-1734-45db-ad74-f60a15c2dc46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:49.777684 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e96c06-1734-45db-ad74-f60a15c2dc46 admin admin] PATH_INFO: `/v3/users/7c90f9ac02ed43a8bdb32f879c771437` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:49.779005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e96c06-1734-45db-ad74-f60a15c2dc46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c90f9ac02ed43a8bdb32f879c771437)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:49.780948 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e96c06-1734-45db-ad74-f60a15c2dc46 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:49.838764 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-34e96c06-1734-45db-ad74-f60a15c2dc46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c90f9ac02ed43a8bdb32f879c771437'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:49.848750 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-34e96c06-1734-45db-ad74-f60a15c2dc46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c90f9ac02ed43a8bdb32f879c771437'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:49.857028 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-34e96c06-1734-45db-ad74-f60a15c2dc46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c90f9ac02ed43a8bdb32f879c771437'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:49.862228 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-34e96c06-1734-45db-ad74-f60a15c2dc46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c90f9ac02ed43a8bdb32f879c771437'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:49.880556 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-34e96c06-1734-45db-ad74-f60a15c2dc46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c90f9ac02ed43a8bdb32f879c771437'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:49.889672 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1019/2044] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:49 2021] DELETE /identity/v3/users/7c90f9ac02ed43a8bdb32f879c771437 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:50.178593 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bef495-d18c-412c-aaf0-4b39a3127eba admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:50.181167 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-11bef495-d18c-412c-aaf0-4b39a3127eba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:50.204285 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bef495-d18c-412c-aaf0-4b39a3127eba admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:50.263246 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508b4d3-23f3-400c-879c-0687da44dc06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:50.264065 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508b4d3-23f3-400c-879c-0687da44dc06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:50.264343 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508b4d3-23f3-400c-879c-0687da44dc06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:50.264612 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508b4d3-23f3-400c-879c-0687da44dc06 admin admin] PATH_INFO: `/v3/projects/4bd96c93bf5c4fab82456748fdad80fa` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:50.265807 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508b4d3-23f3-400c-879c-0687da44dc06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bd96c93bf5c4fab82456748fdad80fa)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:50.267741 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508b4d3-23f3-400c-879c-0687da44dc06 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:50.330700 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f508b4d3-23f3-400c-879c-0687da44dc06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bd96c93bf5c4fab82456748fdad80fa', 'request_id': 'req-f508b4d3-23f3-400c-879c-0687da44dc06'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:50.340436 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f508b4d3-23f3-400c-879c-0687da44dc06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bd96c93bf5c4fab82456748fdad80fa', 'request_id': 'req-f508b4d3-23f3-400c-879c-0687da44dc06'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:50.349306 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f508b4d3-23f3-400c-879c-0687da44dc06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bd96c93bf5c4fab82456748fdad80fa', 'request_id': 'req-f508b4d3-23f3-400c-879c-0687da44dc06'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:50.361265 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f508b4d3-23f3-400c-879c-0687da44dc06 admin admin] The token cache is being invalidate because project 4bd96c93bf5c4fab82456748fdad80fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:50.361554 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f508b4d3-23f3-400c-879c-0687da44dc06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:50.362240 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f508b4d3-23f3-400c-879c-0687da44dc06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:50.364346 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1026/2045] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:50 2021] DELETE /identity/v3/projects/4bd96c93bf5c4fab82456748fdad80fa => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:50.368492 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e96c06-1734-45db-ad74-f60a15c2dc46 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:50.369983 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-34e96c06-1734-45db-ad74-f60a15c2dc46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:50.384165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e96c06-1734-45db-ad74-f60a15c2dc46 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:50.452501 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766408e-8228-4e98-bd50-d0cdf767e5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:50.453400 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766408e-8228-4e98-bd50-d0cdf767e5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:50.453865 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766408e-8228-4e98-bd50-d0cdf767e5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:50.454175 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766408e-8228-4e98-bd50-d0cdf767e5b6 admin admin] PATH_INFO: `/v3/users/98436391911c4f1d8eba8411a238aa24` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:50.455663 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766408e-8228-4e98-bd50-d0cdf767e5b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98436391911c4f1d8eba8411a238aa24)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:50.458179 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766408e-8228-4e98-bd50-d0cdf767e5b6 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:50.518033 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b766408e-8228-4e98-bd50-d0cdf767e5b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98436391911c4f1d8eba8411a238aa24'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:50.535386 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b766408e-8228-4e98-bd50-d0cdf767e5b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98436391911c4f1d8eba8411a238aa24'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:50.542901 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b766408e-8228-4e98-bd50-d0cdf767e5b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98436391911c4f1d8eba8411a238aa24'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:50.543558 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b766408e-8228-4e98-bd50-d0cdf767e5b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98436391911c4f1d8eba8411a238aa24'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:50.555280 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b766408e-8228-4e98-bd50-d0cdf767e5b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98436391911c4f1d8eba8411a238aa24'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:50.561468 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1020/2046] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:50 2021] DELETE /identity/v3/users/98436391911c4f1d8eba8411a238aa24 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:50.924896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508b4d3-23f3-400c-879c-0687da44dc06 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:50.926383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f508b4d3-23f3-400c-879c-0687da44dc06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:50.939016 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508b4d3-23f3-400c-879c-0687da44dc06 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:50.994118 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34140c-8fd3-42b8-8103-eb6e37c3d147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:50.994969 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34140c-8fd3-42b8-8103-eb6e37c3d147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:50.995249 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34140c-8fd3-42b8-8103-eb6e37c3d147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:50.995523 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34140c-8fd3-42b8-8103-eb6e37c3d147 admin admin] PATH_INFO: `/v3/projects/e243e3885abe4138888ba93c72f05b54` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:50.996694 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34140c-8fd3-42b8-8103-eb6e37c3d147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e243e3885abe4138888ba93c72f05b54)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:50.998646 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34140c-8fd3-42b8-8103-eb6e37c3d147 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:51.042876 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7b34140c-8fd3-42b8-8103-eb6e37c3d147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e243e3885abe4138888ba93c72f05b54', 'request_id': 'req-7b34140c-8fd3-42b8-8103-eb6e37c3d147'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:51.047885 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7b34140c-8fd3-42b8-8103-eb6e37c3d147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e243e3885abe4138888ba93c72f05b54', 'request_id': 'req-7b34140c-8fd3-42b8-8103-eb6e37c3d147'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:51.054668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7b34140c-8fd3-42b8-8103-eb6e37c3d147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e243e3885abe4138888ba93c72f05b54', 'request_id': 'req-7b34140c-8fd3-42b8-8103-eb6e37c3d147'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:51.066038 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7b34140c-8fd3-42b8-8103-eb6e37c3d147 admin admin] The token cache is being invalidate because project e243e3885abe4138888ba93c72f05b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:51.066328 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7b34140c-8fd3-42b8-8103-eb6e37c3d147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:51.066958 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7b34140c-8fd3-42b8-8103-eb6e37c3d147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:51.068516 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1027/2047] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:50 2021] DELETE /identity/v3/projects/e243e3885abe4138888ba93c72f05b54 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:51.074384 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c535567-f24a-414d-a996-a3f7682f1a31 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:51.074671 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c535567-f24a-414d-a996-a3f7682f1a31 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:51.074948 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c535567-f24a-414d-a996-a3f7682f1a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:51.093661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-5c535567-f24a-414d-a996-a3f7682f1a31 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:51.094897 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-5c535567-f24a-414d-a996-a3f7682f1a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:51.153792 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1021/2048] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:51.163661 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db837b7b-9e2e-45f9-a448-49ce4b97b0b0 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:51.163661 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db837b7b-9e2e-45f9-a448-49ce4b97b0b0 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:51.163661 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db837b7b-9e2e-45f9-a448-49ce4b97b0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:51.183462 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-db837b7b-9e2e-45f9-a448-49ce4b97b0b0 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:51.184720 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-db837b7b-9e2e-45f9-a448-49ce4b97b0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:51.193620 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1028/2049] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:51.198759 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c535567-f24a-414d-a996-a3f7682f1a31 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:51.209464 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c535567-f24a-414d-a996-a3f7682f1a31 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:51.214043 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650cb23-2820-438d-b768-985549d18a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:51.214687 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650cb23-2820-438d-b768-985549d18a7a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:51.214968 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650cb23-2820-438d-b768-985549d18a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:51.215249 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650cb23-2820-438d-b768-985549d18a7a admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:51.215978 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650cb23-2820-438d-b768-985549d18a7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:14:51.216282 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650cb23-2820-438d-b768-985549d18a7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:51.217859 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650cb23-2820-438d-b768-985549d18a7a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:51.228974 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1022/2050] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:14:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:14:51.233358 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db837b7b-9e2e-45f9-a448-49ce4b97b0b0 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:51.242364 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db837b7b-9e2e-45f9-a448-49ce4b97b0b0 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:51.247346 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e98b89-7526-479b-a1b1-c75d79fb3619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:51.247988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e98b89-7526-479b-a1b1-c75d79fb3619 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:51.248268 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e98b89-7526-479b-a1b1-c75d79fb3619 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:51.248541 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e98b89-7526-479b-a1b1-c75d79fb3619 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:51.249246 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e98b89-7526-479b-a1b1-c75d79fb3619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:51.251171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e98b89-7526-479b-a1b1-c75d79fb3619 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:51.279221 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1029/2051] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:51 2021] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:14:51.284587 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650cb23-2820-438d-b768-985549d18a7a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:51.294568 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650cb23-2820-438d-b768-985549d18a7a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:51.351042 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5a7d4-b546-4a79-a844-0f64b8cc2f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:51.351717 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5a7d4-b546-4a79-a844-0f64b8cc2f39 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:51.352032 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5a7d4-b546-4a79-a844-0f64b8cc2f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:51.352291 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d5a7d4-b546-4a79-a844-0f64b8cc2f39 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:51.352997 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5a7d4-b546-4a79-a844-0f64b8cc2f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:51.354944 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d5a7d4-b546-4a79-a844-0f64b8cc2f39 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:51.374343 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1023/2052] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:51 2021] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:51.379128 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e98b89-7526-479b-a1b1-c75d79fb3619 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:51.389231 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e98b89-7526-479b-a1b1-c75d79fb3619 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:51.394549 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcace82-f4f3-48ce-8dff-b53b584c2828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:51.395217 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcace82-f4f3-48ce-8dff-b53b584c2828 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:51.395503 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcace82-f4f3-48ce-8dff-b53b584c2828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:51.395779 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcace82-f4f3-48ce-8dff-b53b584c2828 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:51.396527 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcace82-f4f3-48ce-8dff-b53b584c2828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:51.398150 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcace82-f4f3-48ce-8dff-b53b584c2828 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:51.408622 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1030/2053] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:51 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:14:51.412682 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5a7d4-b546-4a79-a844-0f64b8cc2f39 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:51.422770 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d5a7d4-b546-4a79-a844-0f64b8cc2f39 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:51.427500 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd198bc-3cf8-4063-b952-dd9b0a237bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:51.428160 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd198bc-3cf8-4063-b952-dd9b0a237bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:51.428445 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd198bc-3cf8-4063-b952-dd9b0a237bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:51.428723 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd198bc-3cf8-4063-b952-dd9b0a237bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:51.429467 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd198bc-3cf8-4063-b952-dd9b0a237bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:51.431091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd198bc-3cf8-4063-b952-dd9b0a237bf6 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:51.441298 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1024/2054] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:51 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:51.445334 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcace82-f4f3-48ce-8dff-b53b584c2828 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:51.454892 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcace82-f4f3-48ce-8dff-b53b584c2828 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:51.460369 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b05c6-0a9d-4b1d-98e0-0759c747d0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:51.461225 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b05c6-0a9d-4b1d-98e0-0759c747d0bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:51.461497 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b05c6-0a9d-4b1d-98e0-0759c747d0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:51.461762 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b05c6-0a9d-4b1d-98e0-0759c747d0bc admin admin] PATH_INFO: `/v3/projects/4edb193656f247d38402071c9c8df2db/users/c56d39c1cb5346bbb574571edc98009e/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:51.475507 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b05c6-0a9d-4b1d-98e0-0759c747d0bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4edb193656f247d38402071c9c8df2db, user_id=c56d39c1cb5346bbb574571edc98009e, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:51.478171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b05c6-0a9d-4b1d-98e0-0759c747d0bc admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:51.490850 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1031/2055] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:51 2021] PUT /identity/v3/projects/4edb193656f247d38402071c9c8df2db/users/c56d39c1cb5346bbb574571edc98009e/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:51.501047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7b687-ac5b-43e1-bb70-8e0914f34626 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:51.501341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7b687-ac5b-43e1-bb70-8e0914f34626 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:51.501669 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e7b687-ac5b-43e1-bb70-8e0914f34626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:51.528142 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-24e7b687-ac5b-43e1-bb70-8e0914f34626 None None] MFA Rules not processed for user `c56d39c1cb5346bbb574571edc98009e`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:51.529469 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-24e7b687-ac5b-43e1-bb70-8e0914f34626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:51.596323 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1025/2056] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:51 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:51.606754 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b05c6-0a9d-4b1d-98e0-0759c747d0bc admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:51.608427 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a45b05c6-0a9d-4b1d-98e0-0759c747d0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:51.664092 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b05c6-0a9d-4b1d-98e0-0759c747d0bc admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:51.668402 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad886e47-2ccf-4e6c-8c69-fcaafb8de08c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:51.669085 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad886e47-2ccf-4e6c-8c69-fcaafb8de08c service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:51.669352 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad886e47-2ccf-4e6c-8c69-fcaafb8de08c service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:51.669796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad886e47-2ccf-4e6c-8c69-fcaafb8de08c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:51.679643 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad886e47-2ccf-4e6c-8c69-fcaafb8de08c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:51.681165 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad886e47-2ccf-4e6c-8c69-fcaafb8de08c service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:51.690012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1032/2057] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:51 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:51.955069 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7b687-ac5b-43e1-bb70-8e0914f34626 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:51.956891 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-24e7b687-ac5b-43e1-bb70-8e0914f34626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:52.038596 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e7b687-ac5b-43e1-bb70-8e0914f34626 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:52.043140 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a89d18-079c-4c25-b65f-5cc1e02f9912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:52.044275 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a89d18-079c-4c25-b65f-5cc1e02f9912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:52.044395 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a89d18-079c-4c25-b65f-5cc1e02f9912 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:52.044715 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a89d18-079c-4c25-b65f-5cc1e02f9912 admin admin] PATH_INFO: `/v3/users/02e2d3f2b5034581953cc25b3abf1cff` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:52.046127 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a89d18-079c-4c25-b65f-5cc1e02f9912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02e2d3f2b5034581953cc25b3abf1cff)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:52.048158 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a89d18-079c-4c25-b65f-5cc1e02f9912 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:52.095982 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d9a89d18-079c-4c25-b65f-5cc1e02f9912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02e2d3f2b5034581953cc25b3abf1cff'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:52.103771 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d9a89d18-079c-4c25-b65f-5cc1e02f9912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02e2d3f2b5034581953cc25b3abf1cff'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:52.110400 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d9a89d18-079c-4c25-b65f-5cc1e02f9912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02e2d3f2b5034581953cc25b3abf1cff'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:52.111012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d9a89d18-079c-4c25-b65f-5cc1e02f9912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02e2d3f2b5034581953cc25b3abf1cff'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:52.123219 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d9a89d18-079c-4c25-b65f-5cc1e02f9912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02e2d3f2b5034581953cc25b3abf1cff'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:52.129120 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1026/2058] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:51 2021] DELETE /identity/v3/users/02e2d3f2b5034581953cc25b3abf1cff => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:52.133610 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5379709-682b-4d4c-894b-cebcf28764ea None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:52.133901 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5379709-682b-4d4c-894b-cebcf28764ea None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:52.134213 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5379709-682b-4d4c-894b-cebcf28764ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:52.150538 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-a5379709-682b-4d4c-894b-cebcf28764ea None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:52.151754 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a5379709-682b-4d4c-894b-cebcf28764ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:52.208782 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1033/2059] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:52.218601 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a89d18-079c-4c25-b65f-5cc1e02f9912 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:52.220097 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d9a89d18-079c-4c25-b65f-5cc1e02f9912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:52.275716 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a89d18-079c-4c25-b65f-5cc1e02f9912 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:52.279421 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249ec7b-2cc0-4d34-8f13-73377429effa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:52.280052 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249ec7b-2cc0-4d34-8f13-73377429effa service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:52.280329 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249ec7b-2cc0-4d34-8f13-73377429effa service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:52.280602 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0249ec7b-2cc0-4d34-8f13-73377429effa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:52.290205 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249ec7b-2cc0-4d34-8f13-73377429effa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:52.292002 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0249ec7b-2cc0-4d34-8f13-73377429effa service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:52.301468 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1027/2060] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:52.583275 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5379709-682b-4d4c-894b-cebcf28764ea None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:52.584752 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a5379709-682b-4d4c-894b-cebcf28764ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:52.597424 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5379709-682b-4d4c-894b-cebcf28764ea None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:52.602893 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054071eb-c0e6-4226-8195-24bd691eecf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:52.603931 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054071eb-c0e6-4226-8195-24bd691eecf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:52.604349 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054071eb-c0e6-4226-8195-24bd691eecf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:52.605225 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054071eb-c0e6-4226-8195-24bd691eecf6 admin admin] PATH_INFO: `/v3/projects/593ce660a9854cc39307d1b88673e99c` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:52.606638 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054071eb-c0e6-4226-8195-24bd691eecf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=593ce660a9854cc39307d1b88673e99c)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:52.608778 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054071eb-c0e6-4226-8195-24bd691eecf6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:52.660759 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-054071eb-c0e6-4226-8195-24bd691eecf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '593ce660a9854cc39307d1b88673e99c', 'request_id': 'req-054071eb-c0e6-4226-8195-24bd691eecf6'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:52.667741 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-054071eb-c0e6-4226-8195-24bd691eecf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '593ce660a9854cc39307d1b88673e99c', 'request_id': 'req-054071eb-c0e6-4226-8195-24bd691eecf6'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:52.678201 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-054071eb-c0e6-4226-8195-24bd691eecf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '593ce660a9854cc39307d1b88673e99c', 'request_id': 'req-054071eb-c0e6-4226-8195-24bd691eecf6'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:52.693110 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-054071eb-c0e6-4226-8195-24bd691eecf6 admin admin] The token cache is being invalidate because project 593ce660a9854cc39307d1b88673e99c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:52.693397 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-054071eb-c0e6-4226-8195-24bd691eecf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:52.694214 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-054071eb-c0e6-4226-8195-24bd691eecf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:52.696171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1034/2061] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:52 2021] DELETE /identity/v3/projects/593ce660a9854cc39307d1b88673e99c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:52.700644 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249ec7b-2cc0-4d34-8f13-73377429effa service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:52.711456 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0249ec7b-2cc0-4d34-8f13-73377429effa service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:52.782581 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b6334e-dd13-4179-ae78-ca3b29c97112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:52.783593 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6334e-dd13-4179-ae78-ca3b29c97112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:52.784009 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6334e-dd13-4179-ae78-ca3b29c97112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:52.784532 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b6334e-dd13-4179-ae78-ca3b29c97112 admin admin] PATH_INFO: `/v3/users/725db863e7f44058be033761d9a389ef` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:52.785824 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6334e-dd13-4179-ae78-ca3b29c97112 admin admin] RBAC: Authorizing `identity:delete_user(user_id=725db863e7f44058be033761d9a389ef)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:52.788010 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b6334e-dd13-4179-ae78-ca3b29c97112 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:52.875068 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a8b6334e-dd13-4179-ae78-ca3b29c97112 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '725db863e7f44058be033761d9a389ef'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:52.884700 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a8b6334e-dd13-4179-ae78-ca3b29c97112 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '725db863e7f44058be033761d9a389ef'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:52.892295 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a8b6334e-dd13-4179-ae78-ca3b29c97112 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '725db863e7f44058be033761d9a389ef'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:52.893160 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a8b6334e-dd13-4179-ae78-ca3b29c97112 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '725db863e7f44058be033761d9a389ef'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:52.909667 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a8b6334e-dd13-4179-ae78-ca3b29c97112 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '725db863e7f44058be033761d9a389ef'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:52.917969 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1028/2062] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:52 2021] DELETE /identity/v3/users/725db863e7f44058be033761d9a389ef => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:53.261365 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054071eb-c0e6-4226-8195-24bd691eecf6 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:53.262870 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-054071eb-c0e6-4226-8195-24bd691eecf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:53.285070 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054071eb-c0e6-4226-8195-24bd691eecf6 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:53.341373 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215e472-fcb4-4d1f-8c96-58a4c88d95fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:53.342261 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215e472-fcb4-4d1f-8c96-58a4c88d95fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:53.342546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215e472-fcb4-4d1f-8c96-58a4c88d95fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:53.342822 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215e472-fcb4-4d1f-8c96-58a4c88d95fd admin admin] PATH_INFO: `/v3/projects/bac09b07029e44098a7ca64d564caeb6` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:53.344016 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215e472-fcb4-4d1f-8c96-58a4c88d95fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bac09b07029e44098a7ca64d564caeb6)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:53.345959 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215e472-fcb4-4d1f-8c96-58a4c88d95fd admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:53.389569 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5215e472-fcb4-4d1f-8c96-58a4c88d95fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bac09b07029e44098a7ca64d564caeb6', 'request_id': 'req-5215e472-fcb4-4d1f-8c96-58a4c88d95fd'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:53.394734 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5215e472-fcb4-4d1f-8c96-58a4c88d95fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bac09b07029e44098a7ca64d564caeb6', 'request_id': 'req-5215e472-fcb4-4d1f-8c96-58a4c88d95fd'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:53.401860 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5215e472-fcb4-4d1f-8c96-58a4c88d95fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bac09b07029e44098a7ca64d564caeb6', 'request_id': 'req-5215e472-fcb4-4d1f-8c96-58a4c88d95fd'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:53.413030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5215e472-fcb4-4d1f-8c96-58a4c88d95fd admin admin] The token cache is being invalidate because project bac09b07029e44098a7ca64d564caeb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:53.413241 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5215e472-fcb4-4d1f-8c96-58a4c88d95fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:53.413875 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5215e472-fcb4-4d1f-8c96-58a4c88d95fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:53.415594 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1035/2063] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:53 2021] DELETE /identity/v3/projects/bac09b07029e44098a7ca64d564caeb6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:53.421542 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba00031-0286-4402-aa00-252d0d29acee None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:53.421839 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba00031-0286-4402-aa00-252d0d29acee None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:53.422146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba00031-0286-4402-aa00-252d0d29acee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:53.440194 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-8ba00031-0286-4402-aa00-252d0d29acee None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:53.441397 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8ba00031-0286-4402-aa00-252d0d29acee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:53.499949 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1029/2064] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:53.508760 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f0c34-994d-445a-b983-d5cf355ed94a None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:53.509095 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f0c34-994d-445a-b983-d5cf355ed94a None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:53.509406 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f0c34-994d-445a-b983-d5cf355ed94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:53.528338 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-d29f0c34-994d-445a-b983-d5cf355ed94a None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:53.530660 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-d29f0c34-994d-445a-b983-d5cf355ed94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:53.539922 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1036/2065] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:53.544278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba00031-0286-4402-aa00-252d0d29acee None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:53.554827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba00031-0286-4402-aa00-252d0d29acee None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:53.559427 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7daad-6e80-4571-8da3-ebc895af0de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:53.560175 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7daad-6e80-4571-8da3-ebc895af0de3 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:53.560485 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7daad-6e80-4571-8da3-ebc895af0de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:53.560763 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7daad-6e80-4571-8da3-ebc895af0de3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:53.561605 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7daad-6e80-4571-8da3-ebc895af0de3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:14:53.561944 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7daad-6e80-4571-8da3-ebc895af0de3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:53.563658 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7daad-6e80-4571-8da3-ebc895af0de3 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:53.575235 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1030/2066] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:14:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:14:53.579501 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f0c34-994d-445a-b983-d5cf355ed94a None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:53.589354 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29f0c34-994d-445a-b983-d5cf355ed94a None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:53.594960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518dcbd-c905-4ddf-9981-0f7108177df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:53.595625 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518dcbd-c905-4ddf-9981-0f7108177df5 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:53.595906 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518dcbd-c905-4ddf-9981-0f7108177df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:53.596180 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9518dcbd-c905-4ddf-9981-0f7108177df5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:53.597560 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518dcbd-c905-4ddf-9981-0f7108177df5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:53.599748 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9518dcbd-c905-4ddf-9981-0f7108177df5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:53.627689 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1037/2067] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:53 2021] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:14:53.632140 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7daad-6e80-4571-8da3-ebc895af0de3 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:53.642633 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7daad-6e80-4571-8da3-ebc895af0de3 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:53.705047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476ec6d-0614-4cae-8b97-4d94d0a1fb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:53.707234 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476ec6d-0614-4cae-8b97-4d94d0a1fb1f admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:53.707519 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476ec6d-0614-4cae-8b97-4d94d0a1fb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:53.707798 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476ec6d-0614-4cae-8b97-4d94d0a1fb1f admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:53.708516 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476ec6d-0614-4cae-8b97-4d94d0a1fb1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:53.710489 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476ec6d-0614-4cae-8b97-4d94d0a1fb1f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:53.732160 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1031/2068] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:53 2021] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:14:53.736152 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518dcbd-c905-4ddf-9981-0f7108177df5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:53.746255 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9518dcbd-c905-4ddf-9981-0f7108177df5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:53.751010 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95fb31-f5f6-416e-b6b4-6bee634b3600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:53.751659 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95fb31-f5f6-416e-b6b4-6bee634b3600 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:53.751945 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95fb31-f5f6-416e-b6b4-6bee634b3600 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:53.752223 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a95fb31-f5f6-416e-b6b4-6bee634b3600 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:53.752977 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95fb31-f5f6-416e-b6b4-6bee634b3600 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:53.754613 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a95fb31-f5f6-416e-b6b4-6bee634b3600 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:53.769247 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1038/2069] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:53 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:14:53.771498 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476ec6d-0614-4cae-8b97-4d94d0a1fb1f admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:53.781613 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476ec6d-0614-4cae-8b97-4d94d0a1fb1f admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:53.787122 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f321e3d-d87f-46a4-853d-fa244dc95a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:53.787887 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f321e3d-d87f-46a4-853d-fa244dc95a74 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:53.788170 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f321e3d-d87f-46a4-853d-fa244dc95a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:53.788491 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f321e3d-d87f-46a4-853d-fa244dc95a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:53.789383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f321e3d-d87f-46a4-853d-fa244dc95a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:53.791342 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f321e3d-d87f-46a4-853d-fa244dc95a74 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:53.804293 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1032/2070] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:53 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:53.808820 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95fb31-f5f6-416e-b6b4-6bee634b3600 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:53.819294 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a95fb31-f5f6-416e-b6b4-6bee634b3600 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:53.824448 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e90f6b-11d3-4a1f-9662-d7e259ae9087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:53.825340 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e90f6b-11d3-4a1f-9662-d7e259ae9087 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:53.825726 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e90f6b-11d3-4a1f-9662-d7e259ae9087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:53.825892 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e90f6b-11d3-4a1f-9662-d7e259ae9087 admin admin] PATH_INFO: `/v3/projects/ebd5bf35591743ffb1705f06272cf240/users/e1ccfdf204cc4d03ae5d32b6b7dc65a9/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:53.841607 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e90f6b-11d3-4a1f-9662-d7e259ae9087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd5bf35591743ffb1705f06272cf240, user_id=e1ccfdf204cc4d03ae5d32b6b7dc65a9, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:53.844351 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e90f6b-11d3-4a1f-9662-d7e259ae9087 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:53.859026 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1039/2071] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:53 2021] PUT /identity/v3/projects/ebd5bf35591743ffb1705f06272cf240/users/e1ccfdf204cc4d03ae5d32b6b7dc65a9/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:53.869297 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee185aa2-cc27-487f-8678-3ceee546db3f None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:53.869585 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee185aa2-cc27-487f-8678-3ceee546db3f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:53.869881 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee185aa2-cc27-487f-8678-3ceee546db3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:53.905880 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-ee185aa2-cc27-487f-8678-3ceee546db3f None None] MFA Rules not processed for user `e1ccfdf204cc4d03ae5d32b6b7dc65a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:53.910064 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-ee185aa2-cc27-487f-8678-3ceee546db3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:54.008375 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e90f6b-11d3-4a1f-9662-d7e259ae9087 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:54.010663 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1033/2072] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:53 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:54.077045 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e90f6b-11d3-4a1f-9662-d7e259ae9087 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:54.082468 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff647e4-c19f-43a3-a0c5-e5fe96ff49fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:54.083121 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff647e4-c19f-43a3-a0c5-e5fe96ff49fe admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:54.083408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff647e4-c19f-43a3-a0c5-e5fe96ff49fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:54.083684 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff647e4-c19f-43a3-a0c5-e5fe96ff49fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:54.084377 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff647e4-c19f-43a3-a0c5-e5fe96ff49fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:54.086314 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff647e4-c19f-43a3-a0c5-e5fe96ff49fe admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:54.110924 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1040/2073] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:54 2021] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:54.114779 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee185aa2-cc27-487f-8678-3ceee546db3f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:54.127113 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee185aa2-cc27-487f-8678-3ceee546db3f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:54.184287 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b632e0-27a8-4e20-84bb-0ef75bd32e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:54.184869 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b632e0-27a8-4e20-84bb-0ef75bd32e5d admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:54.185150 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b632e0-27a8-4e20-84bb-0ef75bd32e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:54.185425 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b632e0-27a8-4e20-84bb-0ef75bd32e5d admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:54.186163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b632e0-27a8-4e20-84bb-0ef75bd32e5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:54.188065 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b632e0-27a8-4e20-84bb-0ef75bd32e5d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:54.210364 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1034/2074] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:54 2021] POST /identity/v3/users => generated 290 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:54.213910 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff647e4-c19f-43a3-a0c5-e5fe96ff49fe admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:54.224520 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff647e4-c19f-43a3-a0c5-e5fe96ff49fe admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:54.229743 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea36da9-4870-4aff-8c72-46fffce2f342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:54.230539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea36da9-4870-4aff-8c72-46fffce2f342 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:54.230830 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea36da9-4870-4aff-8c72-46fffce2f342 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:54.231111 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea36da9-4870-4aff-8c72-46fffce2f342 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:54.231797 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b632e0-27a8-4e20-84bb-0ef75bd32e5d admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:54.232002 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea36da9-4870-4aff-8c72-46fffce2f342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:54.233498 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d1b632e0-27a8-4e20-84bb-0ef75bd32e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:54.233607 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea36da9-4870-4aff-8c72-46fffce2f342 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:54.251251 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1041/2075] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:54 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:54.251609 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b632e0-27a8-4e20-84bb-0ef75bd32e5d admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:54.253459 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea36da9-4870-4aff-8c72-46fffce2f342 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:54.256973 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02986dd-ea50-4a7b-95f7-8ac91d8ef35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:54.257942 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02986dd-ea50-4a7b-95f7-8ac91d8ef35a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:54.258292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02986dd-ea50-4a7b-95f7-8ac91d8ef35a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:54.258674 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02986dd-ea50-4a7b-95f7-8ac91d8ef35a admin admin] PATH_INFO: `/v3/users/c56d39c1cb5346bbb574571edc98009e` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:54.260518 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02986dd-ea50-4a7b-95f7-8ac91d8ef35a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56d39c1cb5346bbb574571edc98009e)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:54.263381 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02986dd-ea50-4a7b-95f7-8ac91d8ef35a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:54.265460 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea36da9-4870-4aff-8c72-46fffce2f342 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:54.271297 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2792f24-8619-49ee-9e90-43742f61113f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:54.271960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2792f24-8619-49ee-9e90-43742f61113f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:54.272244 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2792f24-8619-49ee-9e90-43742f61113f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:54.272691 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2792f24-8619-49ee-9e90-43742f61113f admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:54.273615 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2792f24-8619-49ee-9e90-43742f61113f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:54.275264 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2792f24-8619-49ee-9e90-43742f61113f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:54.289143 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1042/2076] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:54 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:14:54.290340 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2792f24-8619-49ee-9e90-43742f61113f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:54.302996 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2792f24-8619-49ee-9e90-43742f61113f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:54.309072 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd8d9c-a724-407e-8720-b5abf4073a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:54.309984 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd8d9c-a724-407e-8720-b5abf4073a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:54.310270 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd8d9c-a724-407e-8720-b5abf4073a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:54.310634 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd8d9c-a724-407e-8720-b5abf4073a63 admin admin] PATH_INFO: `/v3/projects/761fbff20bd541c7bdf58d48f08a4b8b/users/fe1fc85d44ae4d8ab36ebed354cb25d6/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:54.327184 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd8d9c-a724-407e-8720-b5abf4073a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=761fbff20bd541c7bdf58d48f08a4b8b, user_id=fe1fc85d44ae4d8ab36ebed354cb25d6, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:54.327581 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a02986dd-ea50-4a7b-95f7-8ac91d8ef35a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56d39c1cb5346bbb574571edc98009e'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:54.329861 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd8d9c-a724-407e-8720-b5abf4073a63 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:54.339848 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a02986dd-ea50-4a7b-95f7-8ac91d8ef35a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56d39c1cb5346bbb574571edc98009e'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:54.344872 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1043/2077] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:54 2021] PUT /identity/v3/projects/761fbff20bd541c7bdf58d48f08a4b8b/users/fe1fc85d44ae4d8ab36ebed354cb25d6/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:54.354121 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a02986dd-ea50-4a7b-95f7-8ac91d8ef35a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56d39c1cb5346bbb574571edc98009e'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:54.354121 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a02986dd-ea50-4a7b-95f7-8ac91d8ef35a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56d39c1cb5346bbb574571edc98009e'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:54.355819 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12488495-32fc-491e-9d4c-59011d3e173a None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:54.356109 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12488495-32fc-491e-9d4c-59011d3e173a None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:54.356383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12488495-32fc-491e-9d4c-59011d3e173a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:54.363115 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a02986dd-ea50-4a7b-95f7-8ac91d8ef35a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56d39c1cb5346bbb574571edc98009e'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:54.370061 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1035/2078] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:54 2021] DELETE /identity/v3/users/c56d39c1cb5346bbb574571edc98009e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:54.375242 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670c925-c7a0-4c48-9ba2-55f992e12f3f None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:54.375528 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670c925-c7a0-4c48-9ba2-55f992e12f3f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:54.375804 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670c925-c7a0-4c48-9ba2-55f992e12f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:54.388373 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-12488495-32fc-491e-9d4c-59011d3e173a None None] MFA Rules not processed for user `fe1fc85d44ae4d8ab36ebed354cb25d6`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:54.389825 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-12488495-32fc-491e-9d4c-59011d3e173a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:54.394453 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-3670c925-c7a0-4c48-9ba2-55f992e12f3f None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:54.396063 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3670c925-c7a0-4c48-9ba2-55f992e12f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:54.464597 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1044/2079] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:54 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:54.466672 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1036/2080] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:54.472030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12488495-32fc-491e-9d4c-59011d3e173a None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:54.473467 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-12488495-32fc-491e-9d4c-59011d3e173a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:54.477395 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670c925-c7a0-4c48-9ba2-55f992e12f3f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:54.478783 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3670c925-c7a0-4c48-9ba2-55f992e12f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:54.492556 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12488495-32fc-491e-9d4c-59011d3e173a None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:54.506941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098131f5-28e4-40f7-8ef2-ef4f72b677b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:54.507610 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098131f5-28e4-40f7-8ef2-ef4f72b677b1 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:54.507893 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098131f5-28e4-40f7-8ef2-ef4f72b677b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:54.508193 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098131f5-28e4-40f7-8ef2-ef4f72b677b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:54.508999 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098131f5-28e4-40f7-8ef2-ef4f72b677b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:54.511348 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098131f5-28e4-40f7-8ef2-ef4f72b677b1 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:54.537962 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1045/2081] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:54 2021] POST /identity/v3/projects => generated 375 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:14:54.538151 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670c925-c7a0-4c48-9ba2-55f992e12f3f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:54.540718 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098131f5-28e4-40f7-8ef2-ef4f72b677b1 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:54.588037 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a709b4-b7d1-4ac7-8834-52da98260a54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:54.588692 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a709b4-b7d1-4ac7-8834-52da98260a54 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:54.589076 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a709b4-b7d1-4ac7-8834-52da98260a54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:54.589356 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a709b4-b7d1-4ac7-8834-52da98260a54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:54.615605 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098131f5-28e4-40f7-8ef2-ef4f72b677b1 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:54.620736 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161bc7b-e7fd-4eee-ad79-9f885e36ad7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:54.621485 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161bc7b-e7fd-4eee-ad79-9f885e36ad7c admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:54.621864 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161bc7b-e7fd-4eee-ad79-9f885e36ad7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:54.622209 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161bc7b-e7fd-4eee-ad79-9f885e36ad7c admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:54.622985 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161bc7b-e7fd-4eee-ad79-9f885e36ad7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:54.625151 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161bc7b-e7fd-4eee-ad79-9f885e36ad7c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:54.644705 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1046/2082] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:54 2021] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:54.648571 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161bc7b-e7fd-4eee-ad79-9f885e36ad7c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:54.651391 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a709b4-b7d1-4ac7-8834-52da98260a54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:54.652835 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a709b4-b7d1-4ac7-8834-52da98260a54 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:54.658287 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161bc7b-e7fd-4eee-ad79-9f885e36ad7c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:54.662415 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1037/2083] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:14:54.664842 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bca195-2f1f-47be-9a9f-533d5eb4209f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:54.665563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bca195-2f1f-47be-9a9f-533d5eb4209f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:54.670162 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bca195-2f1f-47be-9a9f-533d5eb4209f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:54.670162 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bca195-2f1f-47be-9a9f-533d5eb4209f admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:54.670162 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bca195-2f1f-47be-9a9f-533d5eb4209f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:54.670162 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bca195-2f1f-47be-9a9f-533d5eb4209f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:54.680590 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1047/2084] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:54 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:14:54.684685 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a709b4-b7d1-4ac7-8834-52da98260a54 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:54.694773 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a709b4-b7d1-4ac7-8834-52da98260a54 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:54.701212 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402e43b-d53f-4ca1-9cff-65863f2f9dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:54.701935 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402e43b-d53f-4ca1-9cff-65863f2f9dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:54.702239 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402e43b-d53f-4ca1-9cff-65863f2f9dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:54.702512 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3402e43b-d53f-4ca1-9cff-65863f2f9dd7 admin admin] PATH_INFO: `/v3/projects/6174270b19ff4310bde87844d490fc05/users/400be13271c945908daf60261384e58c/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:54.718338 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402e43b-d53f-4ca1-9cff-65863f2f9dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6174270b19ff4310bde87844d490fc05, user_id=400be13271c945908daf60261384e58c, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:54.721635 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3402e43b-d53f-4ca1-9cff-65863f2f9dd7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:54.734459 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1038/2085] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:54 2021] PUT /identity/v3/projects/6174270b19ff4310bde87844d490fc05/users/400be13271c945908daf60261384e58c/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:54.738971 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bca195-2f1f-47be-9a9f-533d5eb4209f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:54.750228 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bca195-2f1f-47be-9a9f-533d5eb4209f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:54.808064 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450b2793-b998-488d-b44e-577720483b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:54.808952 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b2793-b998-488d-b44e-577720483b4f admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:54.809185 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b2793-b998-488d-b44e-577720483b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:54.809455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450b2793-b998-488d-b44e-577720483b4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:54.810612 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b2793-b998-488d-b44e-577720483b4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:54.812576 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450b2793-b998-488d-b44e-577720483b4f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:54.823662 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1048/2086] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:54 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:54.827642 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402e43b-d53f-4ca1-9cff-65863f2f9dd7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:54.837974 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3402e43b-d53f-4ca1-9cff-65863f2f9dd7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:54.842654 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9a4f2-9edc-4de1-853e-3c0191eead55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:54.843561 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9a4f2-9edc-4de1-853e-3c0191eead55 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:54.843847 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9a4f2-9edc-4de1-853e-3c0191eead55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:54.844127 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d9a4f2-9edc-4de1-853e-3c0191eead55 admin admin] PATH_INFO: `/v3/projects/6174270b19ff4310bde87844d490fc05/users/400be13271c945908daf60261384e58c/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:54.846157 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9a4f2-9edc-4de1-853e-3c0191eead55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6174270b19ff4310bde87844d490fc05, user_id=400be13271c945908daf60261384e58c, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:54.849340 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d9a4f2-9edc-4de1-853e-3c0191eead55 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:54.860107 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1039/2087] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:54 2021] PUT /identity/v3/projects/6174270b19ff4310bde87844d490fc05/users/400be13271c945908daf60261384e58c/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:54.870869 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc250-7864-4c9d-aa5a-f3a0742fb0d0 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:54.871160 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc250-7864-4c9d-aa5a-f3a0742fb0d0 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:54.871439 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc250-7864-4c9d-aa5a-f3a0742fb0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:54.905356 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-b0cdc250-7864-4c9d-aa5a-f3a0742fb0d0 None None] MFA Rules not processed for user `400be13271c945908daf60261384e58c`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:54.906814 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b0cdc250-7864-4c9d-aa5a-f3a0742fb0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:54.969422 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9a4f2-9edc-4de1-853e-3c0191eead55 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:54.971343 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-97d9a4f2-9edc-4de1-853e-3c0191eead55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:54.988759 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1049/2088] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:54 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:54.998964 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdc250-7864-4c9d-aa5a-f3a0742fb0d0 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:55.000359 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b0cdc250-7864-4c9d-aa5a-f3a0742fb0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:55.037671 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d9a4f2-9edc-4de1-853e-3c0191eead55 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:55.046965 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1cd935-74dc-4559-a5dc-190af0bd5cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:55.047837 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cd935-74dc-4559-a5dc-190af0bd5cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:55.048116 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cd935-74dc-4559-a5dc-190af0bd5cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:55.048389 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1cd935-74dc-4559-a5dc-190af0bd5cfe admin admin] PATH_INFO: `/v3/projects/4edb193656f247d38402071c9c8df2db` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:55.049595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cd935-74dc-4559-a5dc-190af0bd5cfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4edb193656f247d38402071c9c8df2db)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:55.052164 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1cd935-74dc-4559-a5dc-190af0bd5cfe admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:55.056849 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdc250-7864-4c9d-aa5a-f3a0742fb0d0 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:55.062647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2eb3e0-8361-4c51-9d4f-3dc85a3ca04c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:55.063310 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2eb3e0-8361-4c51-9d4f-3dc85a3ca04c service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:55.063595 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2eb3e0-8361-4c51-9d4f-3dc85a3ca04c service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:55.063871 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2eb3e0-8361-4c51-9d4f-3dc85a3ca04c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:55.073953 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2eb3e0-8361-4c51-9d4f-3dc85a3ca04c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:55.075419 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2eb3e0-8361-4c51-9d4f-3dc85a3ca04c service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:55.087834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1050/2089] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:54 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:55.104541 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-3c1cd935-74dc-4559-a5dc-190af0bd5cfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4edb193656f247d38402071c9c8df2db', 'request_id': 'req-3c1cd935-74dc-4559-a5dc-190af0bd5cfe'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:55.125314 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-3c1cd935-74dc-4559-a5dc-190af0bd5cfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4edb193656f247d38402071c9c8df2db', 'request_id': 'req-3c1cd935-74dc-4559-a5dc-190af0bd5cfe'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:55.139039 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2eb3e0-8361-4c51-9d4f-3dc85a3ca04c service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:55.140446 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-3c1cd935-74dc-4559-a5dc-190af0bd5cfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4edb193656f247d38402071c9c8df2db', 'request_id': 'req-3c1cd935-74dc-4559-a5dc-190af0bd5cfe'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:55.148929 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2eb3e0-8361-4c51-9d4f-3dc85a3ca04c service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:55.156304 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-3c1cd935-74dc-4559-a5dc-190af0bd5cfe admin admin] The token cache is being invalidate because project 4edb193656f247d38402071c9c8df2db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:55.156903 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-3c1cd935-74dc-4559-a5dc-190af0bd5cfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:55.157701 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-3c1cd935-74dc-4559-a5dc-190af0bd5cfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:55.161073 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1040/2090] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:54 2021] DELETE /identity/v3/projects/4edb193656f247d38402071c9c8df2db => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:55.166679 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b225c-2825-4eac-9f76-79bfdfb43a22 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:55.167846 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b225c-2825-4eac-9f76-79bfdfb43a22 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:55.168368 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822b225c-2825-4eac-9f76-79bfdfb43a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:55.195310 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-822b225c-2825-4eac-9f76-79bfdfb43a22 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:55.197392 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-822b225c-2825-4eac-9f76-79bfdfb43a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:55.204391 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9976b-6bc3-4831-bfdc-6ab0bb9bdf5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:55.205157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9976b-6bc3-4831-bfdc-6ab0bb9bdf5c service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:55.205801 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9976b-6bc3-4831-bfdc-6ab0bb9bdf5c service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:55.207019 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a9976b-6bc3-4831-bfdc-6ab0bb9bdf5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:55.208959 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-50a9976b-6bc3-4831-bfdc-6ab0bb9bdf5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:55.272169 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1041/2091] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:14:55.280155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb783e-ea03-4fac-b258-1ab610351640 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:55.280447 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb783e-ea03-4fac-b258-1ab610351640 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:55.280723 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb783e-ea03-4fac-b258-1ab610351640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:55.292319 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9976b-6bc3-4831-bfdc-6ab0bb9bdf5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:55.293670 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a9976b-6bc3-4831-bfdc-6ab0bb9bdf5c service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:55.303997 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1051/2092] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:55 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:55.306109 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-acdb783e-ea03-4fac-b258-1ab610351640 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:55.307530 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-acdb783e-ea03-4fac-b258-1ab610351640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:55.316137 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1042/2093] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:55.320445 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9976b-6bc3-4831-bfdc-6ab0bb9bdf5c service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:55.332896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a9976b-6bc3-4831-bfdc-6ab0bb9bdf5c service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:55.337690 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9002e-1a42-4ef5-85ab-aa12d058e0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:55.338353 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9002e-1a42-4ef5-85ab-aa12d058e0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:55.338633 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9002e-1a42-4ef5-85ab-aa12d058e0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:55.338909 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9002e-1a42-4ef5-85ab-aa12d058e0d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:55.339655 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9002e-1a42-4ef5-85ab-aa12d058e0d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:14:55.339969 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9002e-1a42-4ef5-85ab-aa12d058e0d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:55.341585 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9002e-1a42-4ef5-85ab-aa12d058e0d9 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:55.359476 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1052/2094] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:14:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:14:55.360730 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb783e-ea03-4fac-b258-1ab610351640 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:55.371907 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb783e-ea03-4fac-b258-1ab610351640 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:55.376673 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d2f40-ccdf-49ab-99cf-fa344bd2cf2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:55.377330 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d2f40-ccdf-49ab-99cf-fa344bd2cf2e admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:55.377614 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d2f40-ccdf-49ab-99cf-fa344bd2cf2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:55.377891 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d2f40-ccdf-49ab-99cf-fa344bd2cf2e admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:55.378682 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d2f40-ccdf-49ab-99cf-fa344bd2cf2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:55.380578 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d2f40-ccdf-49ab-99cf-fa344bd2cf2e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:55.411545 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1043/2095] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:14:55 2021] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:14:55.415592 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9002e-1a42-4ef5-85ab-aa12d058e0d9 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:55.425499 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9002e-1a42-4ef5-85ab-aa12d058e0d9 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:55.481760 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf39391-da31-4140-8aa0-15bf13e1d828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:55.482581 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf39391-da31-4140-8aa0-15bf13e1d828 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:55.482772 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf39391-da31-4140-8aa0-15bf13e1d828 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:55.483025 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf39391-da31-4140-8aa0-15bf13e1d828 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:55.483744 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf39391-da31-4140-8aa0-15bf13e1d828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:55.485778 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf39391-da31-4140-8aa0-15bf13e1d828 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:55.506199 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1053/2096] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:14:55 2021] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:14:55.510868 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d2f40-ccdf-49ab-99cf-fa344bd2cf2e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:55.522368 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d2f40-ccdf-49ab-99cf-fa344bd2cf2e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:55.527652 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d46bf-6989-4465-9682-dbd2d10fd97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:55.528427 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d46bf-6989-4465-9682-dbd2d10fd97d admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:55.528761 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d46bf-6989-4465-9682-dbd2d10fd97d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:55.529194 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d46bf-6989-4465-9682-dbd2d10fd97d admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:55.530349 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d46bf-6989-4465-9682-dbd2d10fd97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:55.532775 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d46bf-6989-4465-9682-dbd2d10fd97d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:55.551533 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf39391-da31-4140-8aa0-15bf13e1d828 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:55.554284 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1044/2097] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:55 2021] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:14:55.569617 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf39391-da31-4140-8aa0-15bf13e1d828 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:55.575292 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff337908-307e-4e88-805e-3c002141cbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:55.575959 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff337908-307e-4e88-805e-3c002141cbdc admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:55.576243 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff337908-307e-4e88-805e-3c002141cbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:55.576520 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff337908-307e-4e88-805e-3c002141cbdc admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:55.577262 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff337908-307e-4e88-805e-3c002141cbdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:55.578907 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff337908-307e-4e88-805e-3c002141cbdc admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:55.593121 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1054/2098] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:14:55 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:14:55.594367 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d46bf-6989-4465-9682-dbd2d10fd97d admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:55.605435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d46bf-6989-4465-9682-dbd2d10fd97d admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:55.610292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebdda03-1dc7-486e-b0c5-9d1b0387d7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:55.611053 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebdda03-1dc7-486e-b0c5-9d1b0387d7bf admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:55.611340 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebdda03-1dc7-486e-b0c5-9d1b0387d7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:55.611611 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebdda03-1dc7-486e-b0c5-9d1b0387d7bf admin admin] PATH_INFO: `/v3/projects/46d63e53a20045f28167ee1dc6b383e3/users/8719b276102043fda5c941da84654009/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:55.628446 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebdda03-1dc7-486e-b0c5-9d1b0387d7bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d63e53a20045f28167ee1dc6b383e3, user_id=8719b276102043fda5c941da84654009, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:55.631665 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebdda03-1dc7-486e-b0c5-9d1b0387d7bf admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:55.647703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1045/2099] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:14:55 2021] PUT /identity/v3/projects/46d63e53a20045f28167ee1dc6b383e3/users/8719b276102043fda5c941da84654009/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:14:55.652556 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6ccd7-ff82-4fc0-9f9e-1388a863bef6 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:55.652844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6ccd7-ff82-4fc0-9f9e-1388a863bef6 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:55.653122 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6ccd7-ff82-4fc0-9f9e-1388a863bef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:55.671732 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-8ec6ccd7-ff82-4fc0-9f9e-1388a863bef6 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:55.672959 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-8ec6ccd7-ff82-4fc0-9f9e-1388a863bef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:55.733193 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1055/2100] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:55.742951 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebdda03-1dc7-486e-b0c5-9d1b0387d7bf admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:55.744610 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3ebdda03-1dc7-486e-b0c5-9d1b0387d7bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:55.809178 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebdda03-1dc7-486e-b0c5-9d1b0387d7bf admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:55.814822 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8e609-e568-4079-b75a-5f14748cc6c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:55.816152 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8e609-e568-4079-b75a-5f14748cc6c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:55.816508 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8e609-e568-4079-b75a-5f14748cc6c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:55.816849 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f8e609-e568-4079-b75a-5f14748cc6c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:55.826980 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8e609-e568-4079-b75a-5f14748cc6c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:55.828433 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f8e609-e568-4079-b75a-5f14748cc6c2 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:55.838745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1046/2101] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:56.457558 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b3686-03d4-462b-825e-27311353018f None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:56.458475 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b3686-03d4-462b-825e-27311353018f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:56.459023 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b3686-03d4-462b-825e-27311353018f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:56.489142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-108b3686-03d4-462b-825e-27311353018f None None] MFA Rules not processed for user `8719b276102043fda5c941da84654009`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:56.490396 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-108b3686-03d4-462b-825e-27311353018f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:56.566092 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1056/2102] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:56 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:56.578251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8e609-e568-4079-b75a-5f14748cc6c2 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:56.581187 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d2f8e609-e568-4079-b75a-5f14748cc6c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:56.682639 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f8e609-e568-4079-b75a-5f14748cc6c2 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:56.687890 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d08c6e-3a54-4ce1-a176-8e11ebb2686d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:56.688629 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d08c6e-3a54-4ce1-a176-8e11ebb2686d service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:56.688984 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d08c6e-3a54-4ce1-a176-8e11ebb2686d service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:56.689332 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d08c6e-3a54-4ce1-a176-8e11ebb2686d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:56.699715 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d08c6e-3a54-4ce1-a176-8e11ebb2686d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:56.701285 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d08c6e-3a54-4ce1-a176-8e11ebb2686d service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:56.724778 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1047/2103] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:56 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:14:58.123370 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91597e-a740-4c24-8d44-4f649600e3e7 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:58.123840 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91597e-a740-4c24-8d44-4f649600e3e7 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:58.123996 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91597e-a740-4c24-8d44-4f649600e3e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:58.153800 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-3a91597e-a740-4c24-8d44-4f649600e3e7 None None] MFA Rules not processed for user `8719b276102043fda5c941da84654009`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:58.155049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-3a91597e-a740-4c24-8d44-4f649600e3e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:58.162675 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1057/2104] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:58 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:58.211235 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d08c6e-3a54-4ce1-a176-8e11ebb2686d service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:58.212661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-c9d08c6e-3a54-4ce1-a176-8e11ebb2686d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:58.227292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d08c6e-3a54-4ce1-a176-8e11ebb2686d service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:58.232255 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb3dc7-d085-4f35-be4d-290a8f00221e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:58.233241 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb3dc7-d085-4f35-be4d-290a8f00221e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:58.233601 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb3dc7-d085-4f35-be4d-290a8f00221e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:58.233880 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb3dc7-d085-4f35-be4d-290a8f00221e admin admin] PATH_INFO: `/v3/users/e1ccfdf204cc4d03ae5d32b6b7dc65a9` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:58.235118 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb3dc7-d085-4f35-be4d-290a8f00221e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ccfdf204cc4d03ae5d32b6b7dc65a9)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:58.237065 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb3dc7-d085-4f35-be4d-290a8f00221e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:58.286507 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b8eb3dc7-d085-4f35-be4d-290a8f00221e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ccfdf204cc4d03ae5d32b6b7dc65a9'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:58.295715 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b8eb3dc7-d085-4f35-be4d-290a8f00221e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ccfdf204cc4d03ae5d32b6b7dc65a9'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:58.303912 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b8eb3dc7-d085-4f35-be4d-290a8f00221e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ccfdf204cc4d03ae5d32b6b7dc65a9'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:58.304728 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b8eb3dc7-d085-4f35-be4d-290a8f00221e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ccfdf204cc4d03ae5d32b6b7dc65a9'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:58.318213 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b8eb3dc7-d085-4f35-be4d-290a8f00221e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ccfdf204cc4d03ae5d32b6b7dc65a9'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:58.327691 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1048/2105] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:58 2021] DELETE /identity/v3/users/e1ccfdf204cc4d03ae5d32b6b7dc65a9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:58.333351 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee2871-0ddc-4eac-83af-da05c8225489 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:58.333824 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee2871-0ddc-4eac-83af-da05c8225489 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:58.334279 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee2871-0ddc-4eac-83af-da05c8225489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:58.355156 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-ceee2871-0ddc-4eac-83af-da05c8225489 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:14:58.356347 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ceee2871-0ddc-4eac-83af-da05c8225489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:58.415531 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1058/2106] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:14:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:14:58.425712 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb3dc7-d085-4f35-be4d-290a8f00221e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:58.427333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-b8eb3dc7-d085-4f35-be4d-290a8f00221e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:58.483064 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb3dc7-d085-4f35-be4d-290a8f00221e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:58.486513 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45310ad8-bb6d-453f-93a3-244c9b6c9a6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:58.487171 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45310ad8-bb6d-453f-93a3-244c9b6c9a6b service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:58.487458 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45310ad8-bb6d-453f-93a3-244c9b6c9a6b service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:58.487732 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45310ad8-bb6d-453f-93a3-244c9b6c9a6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:58.496854 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45310ad8-bb6d-453f-93a3-244c9b6c9a6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:58.498325 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45310ad8-bb6d-453f-93a3-244c9b6c9a6b service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:58.507739 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1049/2107] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:14:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:14:58.892861 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee2871-0ddc-4eac-83af-da05c8225489 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:58.895120 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ceee2871-0ddc-4eac-83af-da05c8225489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:58.908053 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee2871-0ddc-4eac-83af-da05c8225489 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:58.914514 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a16b4-7860-4618-a55d-166cefa766e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:58.915364 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a16b4-7860-4618-a55d-166cefa766e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:58.916050 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a16b4-7860-4618-a55d-166cefa766e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:58.916397 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6a16b4-7860-4618-a55d-166cefa766e6 admin admin] PATH_INFO: `/v3/projects/ebd5bf35591743ffb1705f06272cf240` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:58.917700 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a16b4-7860-4618-a55d-166cefa766e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd5bf35591743ffb1705f06272cf240)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:58.920628 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6a16b4-7860-4618-a55d-166cefa766e6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:58.981689 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8c6a16b4-7860-4618-a55d-166cefa766e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd5bf35591743ffb1705f06272cf240', 'request_id': 'req-8c6a16b4-7860-4618-a55d-166cefa766e6'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:58.988276 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8c6a16b4-7860-4618-a55d-166cefa766e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd5bf35591743ffb1705f06272cf240', 'request_id': 'req-8c6a16b4-7860-4618-a55d-166cefa766e6'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:58.996648 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8c6a16b4-7860-4618-a55d-166cefa766e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd5bf35591743ffb1705f06272cf240', 'request_id': 'req-8c6a16b4-7860-4618-a55d-166cefa766e6'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:59.009098 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8c6a16b4-7860-4618-a55d-166cefa766e6 admin admin] The token cache is being invalidate because project ebd5bf35591743ffb1705f06272cf240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:59.009493 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8c6a16b4-7860-4618-a55d-166cefa766e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:59.010081 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8c6a16b4-7860-4618-a55d-166cefa766e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:59.011661 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1059/2108] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:58 2021] DELETE /identity/v3/projects/ebd5bf35591743ffb1705f06272cf240 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:59.016148 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45310ad8-bb6d-453f-93a3-244c9b6c9a6b service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:59.029112 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45310ad8-bb6d-453f-93a3-244c9b6c9a6b service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:59.094090 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4a0c3-60f3-4092-aa85-fabc657f3886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:59.094534 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4a0c3-60f3-4092-aa85-fabc657f3886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:59.094873 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4a0c3-60f3-4092-aa85-fabc657f3886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:59.095247 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c4a0c3-60f3-4092-aa85-fabc657f3886 admin admin] PATH_INFO: `/v3/users/fe1fc85d44ae4d8ab36ebed354cb25d6` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:59.097663 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4a0c3-60f3-4092-aa85-fabc657f3886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe1fc85d44ae4d8ab36ebed354cb25d6)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:59.099993 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c4a0c3-60f3-4092-aa85-fabc657f3886 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:59.147345 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b0c4a0c3-60f3-4092-aa85-fabc657f3886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe1fc85d44ae4d8ab36ebed354cb25d6'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:59.154699 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b0c4a0c3-60f3-4092-aa85-fabc657f3886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe1fc85d44ae4d8ab36ebed354cb25d6'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:59.163329 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b0c4a0c3-60f3-4092-aa85-fabc657f3886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe1fc85d44ae4d8ab36ebed354cb25d6'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:59.164294 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b0c4a0c3-60f3-4092-aa85-fabc657f3886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe1fc85d44ae4d8ab36ebed354cb25d6'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:59.179167 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b0c4a0c3-60f3-4092-aa85-fabc657f3886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe1fc85d44ae4d8ab36ebed354cb25d6'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:59.189816 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1050/2109] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:59 2021] DELETE /identity/v3/users/fe1fc85d44ae4d8ab36ebed354cb25d6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:59.502562 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a16b4-7860-4618-a55d-166cefa766e6 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:59.504846 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-8c6a16b4-7860-4618-a55d-166cefa766e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:59.519578 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6a16b4-7860-4618-a55d-166cefa766e6 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:59.579556 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c417e98-6cfe-49d7-996d-67d03dfcaa9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:59.580686 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c417e98-6cfe-49d7-996d-67d03dfcaa9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:59.581003 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c417e98-6cfe-49d7-996d-67d03dfcaa9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:59.581277 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c417e98-6cfe-49d7-996d-67d03dfcaa9b admin admin] PATH_INFO: `/v3/projects/761fbff20bd541c7bdf58d48f08a4b8b` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:59.582587 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c417e98-6cfe-49d7-996d-67d03dfcaa9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=761fbff20bd541c7bdf58d48f08a4b8b)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:59.584650 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c417e98-6cfe-49d7-996d-67d03dfcaa9b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:59.631965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5c417e98-6cfe-49d7-996d-67d03dfcaa9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '761fbff20bd541c7bdf58d48f08a4b8b', 'request_id': 'req-5c417e98-6cfe-49d7-996d-67d03dfcaa9b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:59.638305 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5c417e98-6cfe-49d7-996d-67d03dfcaa9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '761fbff20bd541c7bdf58d48f08a4b8b', 'request_id': 'req-5c417e98-6cfe-49d7-996d-67d03dfcaa9b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:59.647491 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5c417e98-6cfe-49d7-996d-67d03dfcaa9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '761fbff20bd541c7bdf58d48f08a4b8b', 'request_id': 'req-5c417e98-6cfe-49d7-996d-67d03dfcaa9b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:59.658796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5c417e98-6cfe-49d7-996d-67d03dfcaa9b admin admin] The token cache is being invalidate because project 761fbff20bd541c7bdf58d48f08a4b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:14:59.659629 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5c417e98-6cfe-49d7-996d-67d03dfcaa9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:59.660282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5c417e98-6cfe-49d7-996d-67d03dfcaa9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:59.662108 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1060/2110] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:14:59 2021] DELETE /identity/v3/projects/761fbff20bd541c7bdf58d48f08a4b8b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:14:59.665912 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4a0c3-60f3-4092-aa85-fabc657f3886 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:14:59.668729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-b0c4a0c3-60f3-4092-aa85-fabc657f3886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:14:59.681413 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c4a0c3-60f3-4092-aa85-fabc657f3886 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:14:59.742047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1b2d9-5992-4275-85c5-29222a0ab035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:14:59.742926 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1b2d9-5992-4275-85c5-29222a0ab035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:14:59.743213 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1b2d9-5992-4275-85c5-29222a0ab035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:14:59.743491 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1b2d9-5992-4275-85c5-29222a0ab035 admin admin] PATH_INFO: `/v3/users/400be13271c945908daf60261384e58c` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:14:59.745109 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1b2d9-5992-4275-85c5-29222a0ab035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=400be13271c945908daf60261384e58c)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:14:59.747300 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1b2d9-5992-4275-85c5-29222a0ab035 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:14:59.811784 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-42d1b2d9-5992-4275-85c5-29222a0ab035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '400be13271c945908daf60261384e58c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:59.851350 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-42d1b2d9-5992-4275-85c5-29222a0ab035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '400be13271c945908daf60261384e58c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:59.861185 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-42d1b2d9-5992-4275-85c5-29222a0ab035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '400be13271c945908daf60261384e58c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:59.862189 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-42d1b2d9-5992-4275-85c5-29222a0ab035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '400be13271c945908daf60261384e58c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:59.878506 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-42d1b2d9-5992-4275-85c5-29222a0ab035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '400be13271c945908daf60261384e58c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:14:59.896211 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1051/2111] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:14:59 2021] DELETE /identity/v3/users/400be13271c945908daf60261384e58c => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:15:00.316733 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c417e98-6cfe-49d7-996d-67d03dfcaa9b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:00.319371 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-5c417e98-6cfe-49d7-996d-67d03dfcaa9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:00.337624 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c417e98-6cfe-49d7-996d-67d03dfcaa9b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:00.412817 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6fc2f-c9b4-45b1-a052-336025e34c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:00.413564 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6fc2f-c9b4-45b1-a052-336025e34c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:00.413839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6fc2f-c9b4-45b1-a052-336025e34c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:00.414137 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6fc2f-c9b4-45b1-a052-336025e34c33 admin admin] PATH_INFO: `/v3/projects/6174270b19ff4310bde87844d490fc05` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:00.415341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6fc2f-c9b4-45b1-a052-336025e34c33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6174270b19ff4310bde87844d490fc05)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:00.417474 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6fc2f-c9b4-45b1-a052-336025e34c33 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:00.471060 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a6a6fc2f-c9b4-45b1-a052-336025e34c33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6174270b19ff4310bde87844d490fc05', 'request_id': 'req-a6a6fc2f-c9b4-45b1-a052-336025e34c33'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:00.477413 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a6a6fc2f-c9b4-45b1-a052-336025e34c33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6174270b19ff4310bde87844d490fc05', 'request_id': 'req-a6a6fc2f-c9b4-45b1-a052-336025e34c33'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:00.488446 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a6a6fc2f-c9b4-45b1-a052-336025e34c33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6174270b19ff4310bde87844d490fc05', 'request_id': 'req-a6a6fc2f-c9b4-45b1-a052-336025e34c33'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:00.501844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a6a6fc2f-c9b4-45b1-a052-336025e34c33 admin admin] The token cache is being invalidate because project 6174270b19ff4310bde87844d490fc05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:15:00.501844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a6a6fc2f-c9b4-45b1-a052-336025e34c33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:00.502660 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a6a6fc2f-c9b4-45b1-a052-336025e34c33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:00.505290 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1061/2112] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:15:00 2021] DELETE /identity/v3/projects/6174270b19ff4310bde87844d490fc05 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:00.511850 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfd404-5e7d-4e22-a4dd-26e95c90aa26 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:00.512138 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfd404-5e7d-4e22-a4dd-26e95c90aa26 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:00.512419 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bfd404-5e7d-4e22-a4dd-26e95c90aa26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:00.532552 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-30bfd404-5e7d-4e22-a4dd-26e95c90aa26 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:00.534039 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-30bfd404-5e7d-4e22-a4dd-26e95c90aa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:00.596438 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1052/2113] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:00.605835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe4fd6-3713-41b4-a668-3dd703bd1165 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:00.606156 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe4fd6-3713-41b4-a668-3dd703bd1165 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:00.606440 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe4fd6-3713-41b4-a668-3dd703bd1165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:00.626642 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-0ebe4fd6-3713-41b4-a668-3dd703bd1165 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:00.628438 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-0ebe4fd6-3713-41b4-a668-3dd703bd1165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:00.637386 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1062/2114] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:00.641739 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfd404-5e7d-4e22-a4dd-26e95c90aa26 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:00.652066 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bfd404-5e7d-4e22-a4dd-26e95c90aa26 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:00.657121 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386b587-537f-4777-818d-239e2362c368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:00.657795 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386b587-537f-4777-818d-239e2362c368 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:00.658107 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386b587-537f-4777-818d-239e2362c368 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:00.658385 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386b587-537f-4777-818d-239e2362c368 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:00.659161 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386b587-537f-4777-818d-239e2362c368 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:15:00.659469 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386b587-537f-4777-818d-239e2362c368 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:00.661061 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1386b587-537f-4777-818d-239e2362c368 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:00.681301 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1053/2115] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:15:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:15:00.685879 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe4fd6-3713-41b4-a668-3dd703bd1165 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:00.695566 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe4fd6-3713-41b4-a668-3dd703bd1165 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:00.701952 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba953e1d-a28a-4973-b349-3efbab3bae0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:00.702710 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba953e1d-a28a-4973-b349-3efbab3bae0f admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:00.702999 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba953e1d-a28a-4973-b349-3efbab3bae0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:00.703276 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba953e1d-a28a-4973-b349-3efbab3bae0f admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:00.703988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba953e1d-a28a-4973-b349-3efbab3bae0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:00.706402 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba953e1d-a28a-4973-b349-3efbab3bae0f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:00.735279 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1063/2116] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:15:00 2021] POST /identity/v3/projects => generated 361 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:15:00.739856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386b587-537f-4777-818d-239e2362c368 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:00.760251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1386b587-537f-4777-818d-239e2362c368 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:00.829247 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b2a73-3837-4021-8370-bf43ac8bba4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:00.830152 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b2a73-3837-4021-8370-bf43ac8bba4e admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:00.831265 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b2a73-3837-4021-8370-bf43ac8bba4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:00.831898 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b2a73-3837-4021-8370-bf43ac8bba4e admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:00.833326 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b2a73-3837-4021-8370-bf43ac8bba4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:00.835646 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b2a73-3837-4021-8370-bf43ac8bba4e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:00.860394 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1054/2117] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:15:00 2021] POST /identity/v3/users => generated 281 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:15:00.865749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba953e1d-a28a-4973-b349-3efbab3bae0f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:00.876311 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba953e1d-a28a-4973-b349-3efbab3bae0f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:00.881117 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c38bc4-a5dd-4ccf-8480-e3c4399dc462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:00.881780 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c38bc4-a5dd-4ccf-8480-e3c4399dc462 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:00.882218 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c38bc4-a5dd-4ccf-8480-e3c4399dc462 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:00.882377 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c38bc4-a5dd-4ccf-8480-e3c4399dc462 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:00.883121 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c38bc4-a5dd-4ccf-8480-e3c4399dc462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:00.885021 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c38bc4-a5dd-4ccf-8480-e3c4399dc462 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:00.897336 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1064/2118] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:15:00 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:15:00.901221 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b2a73-3837-4021-8370-bf43ac8bba4e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:00.912177 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b2a73-3837-4021-8370-bf43ac8bba4e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:00.916750 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff540af-a25a-4b63-97fd-7203c4c1b5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:00.917405 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff540af-a25a-4b63-97fd-7203c4c1b5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:00.917690 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff540af-a25a-4b63-97fd-7203c4c1b5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:00.918002 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff540af-a25a-4b63-97fd-7203c4c1b5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:00.918748 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff540af-a25a-4b63-97fd-7203c4c1b5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:00.920325 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff540af-a25a-4b63-97fd-7203c4c1b5d2 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:00.930745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1055/2119] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:15:00 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:15:00.935029 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c38bc4-a5dd-4ccf-8480-e3c4399dc462 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:00.944857 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c38bc4-a5dd-4ccf-8480-e3c4399dc462 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:00.949478 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd6810-39c4-4c2c-bde5-8ea539c9abc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:00.950402 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd6810-39c4-4c2c-bde5-8ea539c9abc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:00.950684 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd6810-39c4-4c2c-bde5-8ea539c9abc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:00.950959 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd6810-39c4-4c2c-bde5-8ea539c9abc2 admin admin] PATH_INFO: `/v3/projects/372103b9d8944a298e513fc8e2473398/users/52f51bde5e2d4b1382a74c4c3ea42b1f/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:00.965501 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd6810-39c4-4c2c-bde5-8ea539c9abc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=372103b9d8944a298e513fc8e2473398, user_id=52f51bde5e2d4b1382a74c4c3ea42b1f, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:00.968203 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd6810-39c4-4c2c-bde5-8ea539c9abc2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:00.982916 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1065/2120] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:15:00 2021] PUT /identity/v3/projects/372103b9d8944a298e513fc8e2473398/users/52f51bde5e2d4b1382a74c4c3ea42b1f/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:00.995388 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a863f33-2d51-491c-a3b3-d912dec353ea None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:00.995679 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a863f33-2d51-491c-a3b3-d912dec353ea None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:00.995958 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a863f33-2d51-491c-a3b3-d912dec353ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:01.022813 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-2a863f33-2d51-491c-a3b3-d912dec353ea None None] MFA Rules not processed for user `52f51bde5e2d4b1382a74c4c3ea42b1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:01.024175 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-2a863f33-2d51-491c-a3b3-d912dec353ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:01.098026 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1056/2121] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:00 2021] POST /identity/v3/auth/tokens => generated 3381 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:01.126091 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd6810-39c4-4c2c-bde5-8ea539c9abc2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:01.127806 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-60dd6810-39c4-4c2c-bde5-8ea539c9abc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:01.192109 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd6810-39c4-4c2c-bde5-8ea539c9abc2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:01.196360 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3a68a4-53b4-4592-9c0d-dd4596db8d25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:01.197045 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a68a4-53b4-4592-9c0d-dd4596db8d25 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:01.197328 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a68a4-53b4-4592-9c0d-dd4596db8d25 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:01.197633 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3a68a4-53b4-4592-9c0d-dd4596db8d25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:01.210791 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a68a4-53b4-4592-9c0d-dd4596db8d25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:01.212439 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3a68a4-53b4-4592-9c0d-dd4596db8d25 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:01.246001 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1066/2122] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:15:01 2021] GET /identity/v3/auth/tokens => generated 3381 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:15:01.246976 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a863f33-2d51-491c-a3b3-d912dec353ea None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:01.359055 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a863f33-2d51-491c-a3b3-d912dec353ea None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:01.364116 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef2710-e6d8-40f8-8ac6-4f4b701d0d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:01.365620 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef2710-e6d8-40f8-8ac6-4f4b701d0d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:01.365949 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef2710-e6d8-40f8-8ac6-4f4b701d0d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:01.366236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef2710-e6d8-40f8-8ac6-4f4b701d0d34 admin admin] PATH_INFO: `/v3/users/52f51bde5e2d4b1382a74c4c3ea42b1f` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:01.367527 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef2710-e6d8-40f8-8ac6-4f4b701d0d34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52f51bde5e2d4b1382a74c4c3ea42b1f)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:01.369540 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef2710-e6d8-40f8-8ac6-4f4b701d0d34 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:01.422564 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-dbef2710-e6d8-40f8-8ac6-4f4b701d0d34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52f51bde5e2d4b1382a74c4c3ea42b1f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:01.431953 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-dbef2710-e6d8-40f8-8ac6-4f4b701d0d34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52f51bde5e2d4b1382a74c4c3ea42b1f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:01.440711 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-dbef2710-e6d8-40f8-8ac6-4f4b701d0d34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52f51bde5e2d4b1382a74c4c3ea42b1f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:01.441355 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-dbef2710-e6d8-40f8-8ac6-4f4b701d0d34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52f51bde5e2d4b1382a74c4c3ea42b1f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:01.458083 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-dbef2710-e6d8-40f8-8ac6-4f4b701d0d34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52f51bde5e2d4b1382a74c4c3ea42b1f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:01.465948 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1057/2123] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:15:01 2021] DELETE /identity/v3/users/52f51bde5e2d4b1382a74c4c3ea42b1f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:01.472211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf55fd-1301-4569-a56c-a17520781b12 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:01.472554 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf55fd-1301-4569-a56c-a17520781b12 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:01.472834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf55fd-1301-4569-a56c-a17520781b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:01.505972 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-6dbf55fd-1301-4569-a56c-a17520781b12 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:01.507082 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-6dbf55fd-1301-4569-a56c-a17520781b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:01.581079 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1067/2124] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:01.593484 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef2710-e6d8-40f8-8ac6-4f4b701d0d34 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:01.594948 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-dbef2710-e6d8-40f8-8ac6-4f4b701d0d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:01.690966 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef2710-e6d8-40f8-8ac6-4f4b701d0d34 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:01.695659 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d767898-7b04-4bcd-a8c2-4ff1e3f9f6b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:01.696316 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d767898-7b04-4bcd-a8c2-4ff1e3f9f6b2 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:01.696599 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d767898-7b04-4bcd-a8c2-4ff1e3f9f6b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:01.696881 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d767898-7b04-4bcd-a8c2-4ff1e3f9f6b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:01.709404 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d767898-7b04-4bcd-a8c2-4ff1e3f9f6b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:01.711335 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d767898-7b04-4bcd-a8c2-4ff1e3f9f6b2 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:01.725760 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1058/2125] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:15:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:15:01.746529 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bef0a-2151-4bc0-b55d-934ad015ed06 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:01.750171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bef0a-2151-4bc0-b55d-934ad015ed06 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:01.750171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9bef0a-2151-4bc0-b55d-934ad015ed06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:01.785911 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-8c9bef0a-2151-4bc0-b55d-934ad015ed06 None None] MFA Rules not processed for user `10b4daa146fa4b638d90ea1e9a4878eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:01.791079 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-8c9bef0a-2151-4bc0-b55d-934ad015ed06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:01.874314 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1068/2126] 10.222.0.41 () {58 vars in 1009 bytes} [Fri Oct 29 16:15:01 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:01.929493 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d767898-7b04-4bcd-a8c2-4ff1e3f9f6b2 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:01.930955 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-6d767898-7b04-4bcd-a8c2-4ff1e3f9f6b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:02.027952 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d767898-7b04-4bcd-a8c2-4ff1e3f9f6b2 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:02.033877 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ab6f6-1370-491b-b2fc-6be12eed6aca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f518ae309c4b4f7eacca882b58e58bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:02.035161 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ab6f6-1370-491b-b2fc-6be12eed6aca service swift] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:02.035520 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ab6f6-1370-491b-b2fc-6be12eed6aca service swift] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:02.035797 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ab6f6-1370-491b-b2fc-6be12eed6aca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:02.047377 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ab6f6-1370-491b-b2fc-6be12eed6aca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:02.049107 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ab6f6-1370-491b-b2fc-6be12eed6aca service swift] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:02.057744 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1059/2127] 10.222.0.41 () {60 vars in 1384 bytes} [Fri Oct 29 16:15:01 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 16:15:02.125370 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bef0a-2151-4bc0-b55d-934ad015ed06 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:02.127296 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-8c9bef0a-2151-4bc0-b55d-934ad015ed06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:02.145672 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9bef0a-2151-4bc0-b55d-934ad015ed06 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:02.170572 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed3828-5659-482a-847c-d0b2f74073d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:02.174299 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed3828-5659-482a-847c-d0b2f74073d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:02.176025 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed3828-5659-482a-847c-d0b2f74073d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:02.177059 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed3828-5659-482a-847c-d0b2f74073d5 admin admin] PATH_INFO: `/v3/projects/372103b9d8944a298e513fc8e2473398` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:02.179385 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed3828-5659-482a-847c-d0b2f74073d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=372103b9d8944a298e513fc8e2473398)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:02.182080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed3828-5659-482a-847c-d0b2f74073d5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:02.263163 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-62ed3828-5659-482a-847c-d0b2f74073d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '372103b9d8944a298e513fc8e2473398', 'request_id': 'req-62ed3828-5659-482a-847c-d0b2f74073d5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:02.271849 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-62ed3828-5659-482a-847c-d0b2f74073d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '372103b9d8944a298e513fc8e2473398', 'request_id': 'req-62ed3828-5659-482a-847c-d0b2f74073d5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:02.280241 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-62ed3828-5659-482a-847c-d0b2f74073d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '372103b9d8944a298e513fc8e2473398', 'request_id': 'req-62ed3828-5659-482a-847c-d0b2f74073d5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:02.293056 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-62ed3828-5659-482a-847c-d0b2f74073d5 admin admin] The token cache is being invalidate because project 372103b9d8944a298e513fc8e2473398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:15:02.293579 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-62ed3828-5659-482a-847c-d0b2f74073d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:02.294456 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-62ed3828-5659-482a-847c-d0b2f74073d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:02.296346 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1069/2128] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:15:02 2021] DELETE /identity/v3/projects/372103b9d8944a298e513fc8e2473398 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:02.394989 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ab6f6-1370-491b-b2fc-6be12eed6aca service swift] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:02.396504 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-fb8ab6f6-1370-491b-b2fc-6be12eed6aca service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:02.416551 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ab6f6-1370-491b-b2fc-6be12eed6aca service swift] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:02.514375 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9a87e-a57d-46af-8c0c-f255155eed78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:02.515343 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9a87e-a57d-46af-8c0c-f255155eed78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:02.515667 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9a87e-a57d-46af-8c0c-f255155eed78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:02.515997 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9a87e-a57d-46af-8c0c-f255155eed78 admin admin] PATH_INFO: `/v3/users/da0bf4df5bd14fde83eacc8abe24aeb8` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:02.517424 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9a87e-a57d-46af-8c0c-f255155eed78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da0bf4df5bd14fde83eacc8abe24aeb8)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:02.519795 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9a87e-a57d-46af-8c0c-f255155eed78 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:02.583812 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f3d9a87e-a57d-46af-8c0c-f255155eed78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da0bf4df5bd14fde83eacc8abe24aeb8'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:02.599039 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f3d9a87e-a57d-46af-8c0c-f255155eed78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da0bf4df5bd14fde83eacc8abe24aeb8'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:02.611530 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f3d9a87e-a57d-46af-8c0c-f255155eed78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da0bf4df5bd14fde83eacc8abe24aeb8'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:02.615363 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f3d9a87e-a57d-46af-8c0c-f255155eed78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da0bf4df5bd14fde83eacc8abe24aeb8'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:02.638438 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f3d9a87e-a57d-46af-8c0c-f255155eed78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da0bf4df5bd14fde83eacc8abe24aeb8'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:02.653818 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1060/2129] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:15:02 2021] DELETE /identity/v3/users/da0bf4df5bd14fde83eacc8abe24aeb8 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:02.656027 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9d0eb-bb41-4f56-aa20-64ee4aaca2c5 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:02.657474 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9d0eb-bb41-4f56-aa20-64ee4aaca2c5 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:02.657999 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9d0eb-bb41-4f56-aa20-64ee4aaca2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:02.682280 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e2c9d0eb-bb41-4f56-aa20-64ee4aaca2c5 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:02.684081 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e2c9d0eb-bb41-4f56-aa20-64ee4aaca2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:02.773775 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1070/2130] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:15:02.789067 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9a87e-a57d-46af-8c0c-f255155eed78 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:02.790570 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-f3d9a87e-a57d-46af-8c0c-f255155eed78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:02.872553 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9a87e-a57d-46af-8c0c-f255155eed78 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:02.882689 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd33e8c-7700-4bc4-9040-3023a3664bcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:02.885310 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd33e8c-7700-4bc4-9040-3023a3664bcd service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:02.885696 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd33e8c-7700-4bc4-9040-3023a3664bcd service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:02.886250 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd33e8c-7700-4bc4-9040-3023a3664bcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:02.904422 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd33e8c-7700-4bc4-9040-3023a3664bcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:02.905870 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd33e8c-7700-4bc4-9040-3023a3664bcd service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:02.918954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1061/2131] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:15:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:15:02.950021 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1952a-f9a9-48cb-bfd7-d518e7d3bb9d None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:02.950560 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1952a-f9a9-48cb-bfd7-d518e7d3bb9d None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:02.950841 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1952a-f9a9-48cb-bfd7-d518e7d3bb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:02.972355 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-5fe1952a-f9a9-48cb-bfd7-d518e7d3bb9d None None] MFA Rules not processed for user `10b4daa146fa4b638d90ea1e9a4878eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:02.973613 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-5fe1952a-f9a9-48cb-bfd7-d518e7d3bb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:03.035651 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1071/2132] 10.222.0.41 () {58 vars in 1009 bytes} [Fri Oct 29 16:15:02 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:03.053848 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd33e8c-7700-4bc4-9040-3023a3664bcd service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:03.055600 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-4dd33e8c-7700-4bc4-9040-3023a3664bcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:03.132475 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd33e8c-7700-4bc4-9040-3023a3664bcd service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:03.138484 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f556f-fc9c-4712-8ac0-0ae2de6e4d9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f518ae309c4b4f7eacca882b58e58bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:03.139376 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f556f-fc9c-4712-8ac0-0ae2de6e4d9a service swift] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:03.139814 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f556f-fc9c-4712-8ac0-0ae2de6e4d9a service swift] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:03.140235 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f556f-fc9c-4712-8ac0-0ae2de6e4d9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:03.151164 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f556f-fc9c-4712-8ac0-0ae2de6e4d9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:03.153114 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f556f-fc9c-4712-8ac0-0ae2de6e4d9a service swift] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:03.162431 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1062/2133] 10.222.0.41 () {60 vars in 1384 bytes} [Fri Oct 29 16:15:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 16:15:03.195794 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1952a-f9a9-48cb-bfd7-d518e7d3bb9d None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:03.197394 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-5fe1952a-f9a9-48cb-bfd7-d518e7d3bb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:03.224546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1952a-f9a9-48cb-bfd7-d518e7d3bb9d None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:03.230436 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec1ece-dff1-4e0c-8ef6-80444e7ba405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:03.231518 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec1ece-dff1-4e0c-8ef6-80444e7ba405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:03.231518 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec1ece-dff1-4e0c-8ef6-80444e7ba405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:03.231788 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec1ece-dff1-4e0c-8ef6-80444e7ba405 admin admin] PATH_INFO: `/v3/projects/1bf6fee7125b4a0db0222dfe56f36b87` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:03.233200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec1ece-dff1-4e0c-8ef6-80444e7ba405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bf6fee7125b4a0db0222dfe56f36b87)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:03.235883 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec1ece-dff1-4e0c-8ef6-80444e7ba405 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:03.288671 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-64ec1ece-dff1-4e0c-8ef6-80444e7ba405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf6fee7125b4a0db0222dfe56f36b87', 'request_id': 'req-64ec1ece-dff1-4e0c-8ef6-80444e7ba405'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:03.294183 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-64ec1ece-dff1-4e0c-8ef6-80444e7ba405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf6fee7125b4a0db0222dfe56f36b87', 'request_id': 'req-64ec1ece-dff1-4e0c-8ef6-80444e7ba405'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:03.301457 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-64ec1ece-dff1-4e0c-8ef6-80444e7ba405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf6fee7125b4a0db0222dfe56f36b87', 'request_id': 'req-64ec1ece-dff1-4e0c-8ef6-80444e7ba405'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:03.312367 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-64ec1ece-dff1-4e0c-8ef6-80444e7ba405 admin admin] The token cache is being invalidate because project 1bf6fee7125b4a0db0222dfe56f36b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:15:03.312734 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-64ec1ece-dff1-4e0c-8ef6-80444e7ba405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:03.313403 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-64ec1ece-dff1-4e0c-8ef6-80444e7ba405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:03.314878 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1072/2134] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:15:03 2021] DELETE /identity/v3/projects/1bf6fee7125b4a0db0222dfe56f36b87 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:03.321741 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc7ac5-b076-4727-add7-16216cde007e None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:03.322079 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc7ac5-b076-4727-add7-16216cde007e None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:03.322283 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc7ac5-b076-4727-add7-16216cde007e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:03.342426 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-8dbc7ac5-b076-4727-add7-16216cde007e None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:03.343694 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8dbc7ac5-b076-4727-add7-16216cde007e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:03.425150 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1063/2135] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:03.432464 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc31a2-35f4-4ac3-b293-144fa1ad0c8d None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:03.432748 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc31a2-35f4-4ac3-b293-144fa1ad0c8d None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:03.433023 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cc31a2-35f4-4ac3-b293-144fa1ad0c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:03.454054 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-50cc31a2-35f4-4ac3-b293-144fa1ad0c8d None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:03.456519 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-50cc31a2-35f4-4ac3-b293-144fa1ad0c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:03.465904 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1073/2136] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:03.470362 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc7ac5-b076-4727-add7-16216cde007e None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:03.489217 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc7ac5-b076-4727-add7-16216cde007e None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:03.495503 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc2536b-ad75-4928-95ed-dfc544b10a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:03.496301 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2536b-ad75-4928-95ed-dfc544b10a6e admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:03.496646 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2536b-ad75-4928-95ed-dfc544b10a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:03.497014 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc2536b-ad75-4928-95ed-dfc544b10a6e admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:03.497846 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2536b-ad75-4928-95ed-dfc544b10a6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:15:03.498246 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2536b-ad75-4928-95ed-dfc544b10a6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:03.499973 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc2536b-ad75-4928-95ed-dfc544b10a6e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:03.513183 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1064/2137] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:15:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:15:03.517477 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc31a2-35f4-4ac3-b293-144fa1ad0c8d None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:03.526849 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cc31a2-35f4-4ac3-b293-144fa1ad0c8d None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:03.534941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72aa8c-993e-4150-92af-051842c52e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:03.535613 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72aa8c-993e-4150-92af-051842c52e0a admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:03.535943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72aa8c-993e-4150-92af-051842c52e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:03.536219 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72aa8c-993e-4150-92af-051842c52e0a admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:03.536943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72aa8c-993e-4150-92af-051842c52e0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:03.538943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a72aa8c-993e-4150-92af-051842c52e0a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:03.566742 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480679b2-2687-45e9-846d-cef19517969c None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:03.567113 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480679b2-2687-45e9-846d-cef19517969c None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:03.567461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480679b2-2687-45e9-846d-cef19517969c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:03.572384 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1074/2138] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:15:03 2021] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:15:03.576622 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72aa8c-993e-4150-92af-051842c52e0a admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:03.589166 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-480679b2-2687-45e9-846d-cef19517969c None None] MFA Rules not processed for user `10b4daa146fa4b638d90ea1e9a4878eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:03.590487 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-480679b2-2687-45e9-846d-cef19517969c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:03.659508 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72aa8c-993e-4150-92af-051842c52e0a admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:03.667340 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d86e9-85d2-4f5e-aca0-a4a81fadcb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:03.668050 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d86e9-85d2-4f5e-aca0-a4a81fadcb64 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:03.668515 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d86e9-85d2-4f5e-aca0-a4a81fadcb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:03.668707 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d86e9-85d2-4f5e-aca0-a4a81fadcb64 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:03.669901 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d86e9-85d2-4f5e-aca0-a4a81fadcb64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:03.671795 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d86e9-85d2-4f5e-aca0-a4a81fadcb64 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:03.687062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1065/2139] 10.222.0.41 () {58 vars in 967 bytes} [Fri Oct 29 16:15:03 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:03.700550 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1075/2140] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:15:03 2021] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:15:03.702929 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480679b2-2687-45e9-846d-cef19517969c None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:03.704763 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-480679b2-2687-45e9-846d-cef19517969c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:03.706177 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d86e9-85d2-4f5e-aca0-a4a81fadcb64 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:03.718573 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d86e9-85d2-4f5e-aca0-a4a81fadcb64 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:03.724055 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6845521-1380-4f82-88c2-5c1079c89391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:03.724732 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6845521-1380-4f82-88c2-5c1079c89391 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:03.725064 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6845521-1380-4f82-88c2-5c1079c89391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:03.725347 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6845521-1380-4f82-88c2-5c1079c89391 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:03.726236 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6845521-1380-4f82-88c2-5c1079c89391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:03.728464 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6845521-1380-4f82-88c2-5c1079c89391 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:03.741977 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1076/2141] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:15:03 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:15:03.744345 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6845521-1380-4f82-88c2-5c1079c89391 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:03.759180 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6845521-1380-4f82-88c2-5c1079c89391 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:03.773821 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bc738-c6e7-437e-96da-447d8cba7da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:03.774589 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bc738-c6e7-437e-96da-447d8cba7da5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:03.774877 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bc738-c6e7-437e-96da-447d8cba7da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:03.775150 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bc738-c6e7-437e-96da-447d8cba7da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:03.775915 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bc738-c6e7-437e-96da-447d8cba7da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:03.777669 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bc738-c6e7-437e-96da-447d8cba7da5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:03.793652 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1077/2142] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:15:03 2021] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:15:03.797830 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bc738-c6e7-437e-96da-447d8cba7da5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:03.807878 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480679b2-2687-45e9-846d-cef19517969c None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:03.808937 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bc738-c6e7-437e-96da-447d8cba7da5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:03.812981 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ddeb28-f7ff-49cd-b9e2-5357702571f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f518ae309c4b4f7eacca882b58e58bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:03.813664 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ccec2-f50a-4a63-a4a2-31d516f3ff62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:03.814008 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddeb28-f7ff-49cd-b9e2-5357702571f1 service swift] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:03.814433 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddeb28-f7ff-49cd-b9e2-5357702571f1 service swift] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:03.814553 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ccec2-f50a-4a63-a4a2-31d516f3ff62 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:03.814842 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ccec2-f50a-4a63-a4a2-31d516f3ff62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:03.815176 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ccec2-f50a-4a63-a4a2-31d516f3ff62 admin admin] PATH_INFO: `/v3/projects/48a915739c894af9a48fd680dfb81dc5/users/6b6206ad9bda4376b0565d0e97ed8b97/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:03.815791 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ddeb28-f7ff-49cd-b9e2-5357702571f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:03.824292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddeb28-f7ff-49cd-b9e2-5357702571f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:03.825854 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ddeb28-f7ff-49cd-b9e2-5357702571f1 service swift] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:03.832388 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ccec2-f50a-4a63-a4a2-31d516f3ff62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48a915739c894af9a48fd680dfb81dc5, user_id=6b6206ad9bda4376b0565d0e97ed8b97, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:03.835106 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ccec2-f50a-4a63-a4a2-31d516f3ff62 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:03.839927 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1066/2143] 10.222.0.41 () {60 vars in 1384 bytes} [Fri Oct 29 16:15:03 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 16:15:03.850027 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1078/2144] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:15:03 2021] PUT /identity/v3/projects/48a915739c894af9a48fd680dfb81dc5/users/6b6206ad9bda4376b0565d0e97ed8b97/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:15:03.862064 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adec352-f491-433a-b489-f2bcdab4e6bb None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:03.862967 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adec352-f491-433a-b489-f2bcdab4e6bb None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:03.863250 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adec352-f491-433a-b489-f2bcdab4e6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:03.890561 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-1adec352-f491-433a-b489-f2bcdab4e6bb None None] MFA Rules not processed for user `6b6206ad9bda4376b0565d0e97ed8b97`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:03.892249 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1adec352-f491-433a-b489-f2bcdab4e6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:03.990556 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1067/2145] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:03 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:03.996918 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ccec2-f50a-4a63-a4a2-31d516f3ff62 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:03.999547 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-646ccec2-f50a-4a63-a4a2-31d516f3ff62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:04.078544 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ccec2-f50a-4a63-a4a2-31d516f3ff62 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:04.084786 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9b012-59cf-4fc2-9e0c-166a412ea856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:04.085583 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9b012-59cf-4fc2-9e0c-166a412ea856 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:04.085876 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9b012-59cf-4fc2-9e0c-166a412ea856 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:04.086186 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9b012-59cf-4fc2-9e0c-166a412ea856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:04.095939 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9b012-59cf-4fc2-9e0c-166a412ea856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:04.101644 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9b012-59cf-4fc2-9e0c-166a412ea856 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:04.120077 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1079/2146] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:15:03 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:15:04.743804 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033f0f4-0462-4e84-bc9d-3cc4e075cac2 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:04.744138 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033f0f4-0462-4e84-bc9d-3cc4e075cac2 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:04.744348 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1033f0f4-0462-4e84-bc9d-3cc4e075cac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:04.772434 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-1033f0f4-0462-4e84-bc9d-3cc4e075cac2 None None] MFA Rules not processed for user `63baa45ff6a84614ac4656f6c7c6be2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:04.779612 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1033f0f4-0462-4e84-bc9d-3cc4e075cac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:04.838226 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1068/2147] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:04 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:15:06.144579 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9b012-59cf-4fc2-9e0c-166a412ea856 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:06.146157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f0b9b012-59cf-4fc2-9e0c-166a412ea856 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:06.218485 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9b012-59cf-4fc2-9e0c-166a412ea856 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:06.225762 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a071e8-e86b-46e2-b64d-0759cd3086e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:06.226901 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a071e8-e86b-46e2-b64d-0759cd3086e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:06.227206 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a071e8-e86b-46e2-b64d-0759cd3086e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:06.227482 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a071e8-e86b-46e2-b64d-0759cd3086e3 admin admin] PATH_INFO: `/v3/users/b6297514861943ba84efd7389e047a6d` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:06.228706 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a071e8-e86b-46e2-b64d-0759cd3086e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6297514861943ba84efd7389e047a6d)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:06.230868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a071e8-e86b-46e2-b64d-0759cd3086e3 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:06.297400 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-39a071e8-e86b-46e2-b64d-0759cd3086e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6297514861943ba84efd7389e047a6d'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:06.298104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-39a071e8-e86b-46e2-b64d-0759cd3086e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6297514861943ba84efd7389e047a6d'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:06.311851 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-39a071e8-e86b-46e2-b64d-0759cd3086e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6297514861943ba84efd7389e047a6d'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:06.312562 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-39a071e8-e86b-46e2-b64d-0759cd3086e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6297514861943ba84efd7389e047a6d'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:06.321989 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-39a071e8-e86b-46e2-b64d-0759cd3086e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6297514861943ba84efd7389e047a6d'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:06.337747 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1080/2148] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:15:06 2021] DELETE /identity/v3/users/b6297514861943ba84efd7389e047a6d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:06.344239 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ae012-5d72-4408-9d2a-8d3facf25fe1 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:06.345012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ae012-5d72-4408-9d2a-8d3facf25fe1 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:06.345352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ae012-5d72-4408-9d2a-8d3facf25fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:06.368533 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-0d1ae012-5d72-4408-9d2a-8d3facf25fe1 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:06.369995 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-0d1ae012-5d72-4408-9d2a-8d3facf25fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:06.441028 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1069/2149] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:06.450854 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a071e8-e86b-46e2-b64d-0759cd3086e3 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:06.452258 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-39a071e8-e86b-46e2-b64d-0759cd3086e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:06.520749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a071e8-e86b-46e2-b64d-0759cd3086e3 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:06.524512 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a9a8e-4984-4ffc-9da7-16f04e92dae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:06.525255 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a9a8e-4984-4ffc-9da7-16f04e92dae6 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:06.525593 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a9a8e-4984-4ffc-9da7-16f04e92dae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:06.526252 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a9a8e-4984-4ffc-9da7-16f04e92dae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:06.536873 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a9a8e-4984-4ffc-9da7-16f04e92dae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:06.538504 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68a9a8e-4984-4ffc-9da7-16f04e92dae6 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:06.548485 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1081/2150] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:15:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:15:06.822039 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ae012-5d72-4408-9d2a-8d3facf25fe1 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:06.823483 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-0d1ae012-5d72-4408-9d2a-8d3facf25fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:06.836488 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ae012-5d72-4408-9d2a-8d3facf25fe1 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:06.841360 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c4565-de35-4060-bcd7-890bc0c15f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:06.842565 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c4565-de35-4060-bcd7-890bc0c15f27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:06.842841 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c4565-de35-4060-bcd7-890bc0c15f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:06.843522 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c4565-de35-4060-bcd7-890bc0c15f27 admin admin] PATH_INFO: `/v3/projects/9e74e94fe7a243cd8ce601baa35daaa7` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:06.845263 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c4565-de35-4060-bcd7-890bc0c15f27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e74e94fe7a243cd8ce601baa35daaa7)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:06.848508 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c4565-de35-4060-bcd7-890bc0c15f27 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:06.897997 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-444c4565-de35-4060-bcd7-890bc0c15f27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e74e94fe7a243cd8ce601baa35daaa7', 'request_id': 'req-444c4565-de35-4060-bcd7-890bc0c15f27'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:06.903927 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-444c4565-de35-4060-bcd7-890bc0c15f27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e74e94fe7a243cd8ce601baa35daaa7', 'request_id': 'req-444c4565-de35-4060-bcd7-890bc0c15f27'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:06.912576 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-444c4565-de35-4060-bcd7-890bc0c15f27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e74e94fe7a243cd8ce601baa35daaa7', 'request_id': 'req-444c4565-de35-4060-bcd7-890bc0c15f27'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:06.924041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-444c4565-de35-4060-bcd7-890bc0c15f27 admin admin] The token cache is being invalidate because project 9e74e94fe7a243cd8ce601baa35daaa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:15:06.924304 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-444c4565-de35-4060-bcd7-890bc0c15f27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:06.925637 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-444c4565-de35-4060-bcd7-890bc0c15f27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:06.927280 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1070/2151] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:15:06 2021] DELETE /identity/v3/projects/9e74e94fe7a243cd8ce601baa35daaa7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:14.289061 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a9a8e-4984-4ffc-9da7-16f04e92dae6 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:14.290498 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f68a9a8e-4984-4ffc-9da7-16f04e92dae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:14.303186 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a9a8e-4984-4ffc-9da7-16f04e92dae6 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:14.358582 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86b2d8-617e-4e28-be87-ff2507207547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:14.359365 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86b2d8-617e-4e28-be87-ff2507207547 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:14.359648 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86b2d8-617e-4e28-be87-ff2507207547 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:14.359927 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e86b2d8-617e-4e28-be87-ff2507207547 admin admin] PATH_INFO: `/v3/users/6b6206ad9bda4376b0565d0e97ed8b97` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:14.361128 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86b2d8-617e-4e28-be87-ff2507207547 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b6206ad9bda4376b0565d0e97ed8b97)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:14.363115 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e86b2d8-617e-4e28-be87-ff2507207547 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:14.411464 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4e86b2d8-617e-4e28-be87-ff2507207547 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b6206ad9bda4376b0565d0e97ed8b97'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:14.412107 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4e86b2d8-617e-4e28-be87-ff2507207547 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b6206ad9bda4376b0565d0e97ed8b97'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:14.423243 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4e86b2d8-617e-4e28-be87-ff2507207547 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b6206ad9bda4376b0565d0e97ed8b97'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:14.423929 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4e86b2d8-617e-4e28-be87-ff2507207547 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b6206ad9bda4376b0565d0e97ed8b97'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:14.430848 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4e86b2d8-617e-4e28-be87-ff2507207547 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b6206ad9bda4376b0565d0e97ed8b97'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:14.443146 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1082/2152] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:15:14 2021] DELETE /identity/v3/users/6b6206ad9bda4376b0565d0e97ed8b97 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:14.447526 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4432f04-2200-440d-943f-ae4a86b96b6b None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:14.448001 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4432f04-2200-440d-943f-ae4a86b96b6b None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:14.448124 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4432f04-2200-440d-943f-ae4a86b96b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:14.467239 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-e4432f04-2200-440d-943f-ae4a86b96b6b None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:14.468437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e4432f04-2200-440d-943f-ae4a86b96b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:14.525564 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1071/2153] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:14.535476 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86b2d8-617e-4e28-be87-ff2507207547 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:14.536902 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4e86b2d8-617e-4e28-be87-ff2507207547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:14.598326 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e86b2d8-617e-4e28-be87-ff2507207547 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:14.601965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc39f2-7c1b-4d7d-8ddc-2bf3992ec070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:14.602608 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc39f2-7c1b-4d7d-8ddc-2bf3992ec070 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:14.602887 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc39f2-7c1b-4d7d-8ddc-2bf3992ec070 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:14.603189 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc39f2-7c1b-4d7d-8ddc-2bf3992ec070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:14.612071 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc39f2-7c1b-4d7d-8ddc-2bf3992ec070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:14.613435 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dc39f2-7c1b-4d7d-8ddc-2bf3992ec070 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:14.622561 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1083/2154] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:15:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:15:14.951800 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4432f04-2200-440d-943f-ae4a86b96b6b None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:14.953373 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e4432f04-2200-440d-943f-ae4a86b96b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:14.965399 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4432f04-2200-440d-943f-ae4a86b96b6b None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:14.970238 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e2c5a-0260-446e-b5cf-ad52822462c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:14.971161 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e2c5a-0260-446e-b5cf-ad52822462c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:14.971504 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e2c5a-0260-446e-b5cf-ad52822462c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:14.971847 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521e2c5a-0260-446e-b5cf-ad52822462c1 admin admin] PATH_INFO: `/v3/projects/48a915739c894af9a48fd680dfb81dc5` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:14.973148 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e2c5a-0260-446e-b5cf-ad52822462c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48a915739c894af9a48fd680dfb81dc5)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:14.975216 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521e2c5a-0260-446e-b5cf-ad52822462c1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:15.024524 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-521e2c5a-0260-446e-b5cf-ad52822462c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48a915739c894af9a48fd680dfb81dc5', 'request_id': 'req-521e2c5a-0260-446e-b5cf-ad52822462c1'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:15.029990 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-521e2c5a-0260-446e-b5cf-ad52822462c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48a915739c894af9a48fd680dfb81dc5', 'request_id': 'req-521e2c5a-0260-446e-b5cf-ad52822462c1'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:15.036619 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-521e2c5a-0260-446e-b5cf-ad52822462c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48a915739c894af9a48fd680dfb81dc5', 'request_id': 'req-521e2c5a-0260-446e-b5cf-ad52822462c1'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:15.048072 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-521e2c5a-0260-446e-b5cf-ad52822462c1 admin admin] The token cache is being invalidate because project 48a915739c894af9a48fd680dfb81dc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:15:15.048392 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-521e2c5a-0260-446e-b5cf-ad52822462c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:15.049615 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-521e2c5a-0260-446e-b5cf-ad52822462c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:15.051171 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1072/2155] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:15:14 2021] DELETE /identity/v3/projects/48a915739c894af9a48fd680dfb81dc5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:51.699263 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73195b-d34d-4664-82bb-45813e1e8a9c None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:51.699781 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73195b-d34d-4664-82bb-45813e1e8a9c None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:51.699930 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73195b-d34d-4664-82bb-45813e1e8a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:51.720176 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-2c73195b-d34d-4664-82bb-45813e1e8a9c None None] MFA Rules not processed for user `10b4daa146fa4b638d90ea1e9a4878eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:51.721386 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-2c73195b-d34d-4664-82bb-45813e1e8a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:51.777843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1084/2156] 10.222.0.41 () {58 vars in 1009 bytes} [Fri Oct 29 16:15:51 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:15:51.791465 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e2c5a-0260-446e-b5cf-ad52822462c1 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:51.792865 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-521e2c5a-0260-446e-b5cf-ad52822462c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:51.860437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521e2c5a-0260-446e-b5cf-ad52822462c1 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:51.865673 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d868e-bcf1-44e3-aaee-742b06b5b961 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f518ae309c4b4f7eacca882b58e58bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:51.866360 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d868e-bcf1-44e3-aaee-742b06b5b961 service swift] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:51.866646 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d868e-bcf1-44e3-aaee-742b06b5b961 service swift] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:51.866934 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9d868e-bcf1-44e3-aaee-742b06b5b961 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:51.875733 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d868e-bcf1-44e3-aaee-742b06b5b961 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:51.877482 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9d868e-bcf1-44e3-aaee-742b06b5b961 service swift] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:51.886306 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1073/2157] 10.222.0.41 () {60 vars in 1384 bytes} [Fri Oct 29 16:15:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 16:15:53.042442 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73195b-d34d-4664-82bb-45813e1e8a9c None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:53.044025 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-2c73195b-d34d-4664-82bb-45813e1e8a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:53.136215 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73195b-d34d-4664-82bb-45813e1e8a9c None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:53.141227 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecc13a9-afb6-4839-abbd-78919facb579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:53.143933 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc13a9-afb6-4839-abbd-78919facb579 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:53.144190 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc13a9-afb6-4839-abbd-78919facb579 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:53.145006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecc13a9-afb6-4839-abbd-78919facb579 admin admin] PATH_INFO: `/v3/users/63baa45ff6a84614ac4656f6c7c6be2a` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:53.146919 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc13a9-afb6-4839-abbd-78919facb579 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63baa45ff6a84614ac4656f6c7c6be2a)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:53.149594 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecc13a9-afb6-4839-abbd-78919facb579 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:53.218955 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4ecc13a9-afb6-4839-abbd-78919facb579 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63baa45ff6a84614ac4656f6c7c6be2a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:53.219751 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4ecc13a9-afb6-4839-abbd-78919facb579 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63baa45ff6a84614ac4656f6c7c6be2a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:53.233207 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4ecc13a9-afb6-4839-abbd-78919facb579 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63baa45ff6a84614ac4656f6c7c6be2a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:53.234083 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4ecc13a9-afb6-4839-abbd-78919facb579 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63baa45ff6a84614ac4656f6c7c6be2a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:53.247534 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4ecc13a9-afb6-4839-abbd-78919facb579 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63baa45ff6a84614ac4656f6c7c6be2a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:53.264546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1085/2158] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:15:53 2021] DELETE /identity/v3/users/63baa45ff6a84614ac4656f6c7c6be2a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:53.468498 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d868e-bcf1-44e3-aaee-742b06b5b961 service swift] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:53.484313 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9d868e-bcf1-44e3-aaee-742b06b5b961 service swift] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:53.644391 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f7322-9d36-4288-96c3-4c13eff14c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:53.645390 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f7322-9d36-4288-96c3-4c13eff14c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:53.645736 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f7322-9d36-4288-96c3-4c13eff14c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:53.647311 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f7322-9d36-4288-96c3-4c13eff14c00 admin admin] PATH_INFO: `/v3/projects/59d1f3bec3724b87a4fa8a01bbebd39b` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:53.648645 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f7322-9d36-4288-96c3-4c13eff14c00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59d1f3bec3724b87a4fa8a01bbebd39b)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:53.651041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89f7322-9d36-4288-96c3-4c13eff14c00 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:53.726485 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c89f7322-9d36-4288-96c3-4c13eff14c00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59d1f3bec3724b87a4fa8a01bbebd39b', 'request_id': 'req-c89f7322-9d36-4288-96c3-4c13eff14c00'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:53.733892 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c89f7322-9d36-4288-96c3-4c13eff14c00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59d1f3bec3724b87a4fa8a01bbebd39b', 'request_id': 'req-c89f7322-9d36-4288-96c3-4c13eff14c00'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:53.746378 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c89f7322-9d36-4288-96c3-4c13eff14c00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59d1f3bec3724b87a4fa8a01bbebd39b', 'request_id': 'req-c89f7322-9d36-4288-96c3-4c13eff14c00'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:53.761607 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c89f7322-9d36-4288-96c3-4c13eff14c00 admin admin] The token cache is being invalidate because project 59d1f3bec3724b87a4fa8a01bbebd39b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:15:53.762083 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c89f7322-9d36-4288-96c3-4c13eff14c00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:53.762776 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c89f7322-9d36-4288-96c3-4c13eff14c00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:53.764720 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1074/2159] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:15:53 2021] DELETE /identity/v3/projects/59d1f3bec3724b87a4fa8a01bbebd39b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:53.770348 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abe222-adc9-4306-817a-254469e8357a None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:53.770899 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abe222-adc9-4306-817a-254469e8357a None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:53.771750 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08abe222-adc9-4306-817a-254469e8357a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:53.793031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-08abe222-adc9-4306-817a-254469e8357a None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:53.794358 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-08abe222-adc9-4306-817a-254469e8357a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:53.879181 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1086/2160] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:53.887731 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10903e31-b425-49be-83e4-06f263df96c1 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:53.888019 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10903e31-b425-49be-83e4-06f263df96c1 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:53.888323 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10903e31-b425-49be-83e4-06f263df96c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:53.908177 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-10903e31-b425-49be-83e4-06f263df96c1 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:53.911180 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-10903e31-b425-49be-83e4-06f263df96c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:53.919693 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1075/2161] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:53.923600 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abe222-adc9-4306-817a-254469e8357a None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:53.937613 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08abe222-adc9-4306-817a-254469e8357a None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:53.942343 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174bbd7-160d-407c-a8ae-be4788a44a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:53.943556 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174bbd7-160d-407c-a8ae-be4788a44a79 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:53.943832 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174bbd7-160d-407c-a8ae-be4788a44a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:53.944103 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e174bbd7-160d-407c-a8ae-be4788a44a79 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:53.944842 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174bbd7-160d-407c-a8ae-be4788a44a79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:15:53.945144 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174bbd7-160d-407c-a8ae-be4788a44a79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:53.947136 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e174bbd7-160d-407c-a8ae-be4788a44a79 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:53.962134 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1087/2162] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:15:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:15:53.966519 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10903e31-b425-49be-83e4-06f263df96c1 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:53.976030 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10903e31-b425-49be-83e4-06f263df96c1 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:53.981445 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588029f-5f1e-41ee-aeda-8383d4e98841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:53.982151 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588029f-5f1e-41ee-aeda-8383d4e98841 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:53.982497 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588029f-5f1e-41ee-aeda-8383d4e98841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:53.982860 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588029f-5f1e-41ee-aeda-8383d4e98841 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:53.983655 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588029f-5f1e-41ee-aeda-8383d4e98841 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:53.985772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588029f-5f1e-41ee-aeda-8383d4e98841 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:54.021795 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1076/2163] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:15:53 2021] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:15:54.023378 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174bbd7-160d-407c-a8ae-be4788a44a79 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:54.033620 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e174bbd7-160d-407c-a8ae-be4788a44a79 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:54.097477 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45c953-f251-4a8d-ac60-d43e65e3cee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:54.100339 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45c953-f251-4a8d-ac60-d43e65e3cee2 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:54.101012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45c953-f251-4a8d-ac60-d43e65e3cee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:54.101560 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f45c953-f251-4a8d-ac60-d43e65e3cee2 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:54.102436 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45c953-f251-4a8d-ac60-d43e65e3cee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:54.104565 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f45c953-f251-4a8d-ac60-d43e65e3cee2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:54.132896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1088/2164] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:15:54 2021] POST /identity/v3/users => generated 282 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:15:54.136985 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588029f-5f1e-41ee-aeda-8383d4e98841 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:54.152854 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588029f-5f1e-41ee-aeda-8383d4e98841 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:54.158024 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04072a64-0805-410d-b8d6-14f0641de16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:54.158775 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04072a64-0805-410d-b8d6-14f0641de16c admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:54.159130 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04072a64-0805-410d-b8d6-14f0641de16c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:54.159480 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04072a64-0805-410d-b8d6-14f0641de16c admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:54.160358 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04072a64-0805-410d-b8d6-14f0641de16c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:54.162205 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04072a64-0805-410d-b8d6-14f0641de16c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:54.175021 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1077/2165] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:15:54 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:15:54.179696 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45c953-f251-4a8d-ac60-d43e65e3cee2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:54.191943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f45c953-f251-4a8d-ac60-d43e65e3cee2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:54.198239 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f313581c-8ef7-4433-b945-e013165f4445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:54.199000 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313581c-8ef7-4433-b945-e013165f4445 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:54.199346 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313581c-8ef7-4433-b945-e013165f4445 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:54.199693 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313581c-8ef7-4433-b945-e013165f4445 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:54.200526 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313581c-8ef7-4433-b945-e013165f4445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:54.202332 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f313581c-8ef7-4433-b945-e013165f4445 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:54.216012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1089/2166] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:15:54 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:15:54.221530 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04072a64-0805-410d-b8d6-14f0641de16c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:54.232187 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04072a64-0805-410d-b8d6-14f0641de16c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:54.237229 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1aa118-f3f7-4fa1-b046-3d05be3b6971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:54.238228 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1aa118-f3f7-4fa1-b046-3d05be3b6971 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:54.238580 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1aa118-f3f7-4fa1-b046-3d05be3b6971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:54.238943 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1aa118-f3f7-4fa1-b046-3d05be3b6971 admin admin] PATH_INFO: `/v3/projects/da67cbd2090a436386749a62c9de04ef/users/3bf351a3263b497e909b5d5b6231854f/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:54.260080 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1aa118-f3f7-4fa1-b046-3d05be3b6971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da67cbd2090a436386749a62c9de04ef, user_id=3bf351a3263b497e909b5d5b6231854f, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:54.262520 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1aa118-f3f7-4fa1-b046-3d05be3b6971 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:54.306946 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1078/2167] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:15:54 2021] PUT /identity/v3/projects/da67cbd2090a436386749a62c9de04ef/users/3bf351a3263b497e909b5d5b6231854f/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:54.309710 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7866d8b-b4f8-4e4c-aede-33094e00e2bc None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:54.310271 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7866d8b-b4f8-4e4c-aede-33094e00e2bc None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:54.310795 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7866d8b-b4f8-4e4c-aede-33094e00e2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:54.378950 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-d7866d8b-b4f8-4e4c-aede-33094e00e2bc None None] MFA Rules not processed for user `3bf351a3263b497e909b5d5b6231854f`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:54.381225 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-d7866d8b-b4f8-4e4c-aede-33094e00e2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:54.462010 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1090/2168] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:54 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:54.466606 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1aa118-f3f7-4fa1-b046-3d05be3b6971 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:54.534623 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1aa118-f3f7-4fa1-b046-3d05be3b6971 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:54.541189 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b38491-4425-45c4-beb1-e2a37d920243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:54.541990 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b38491-4425-45c4-beb1-e2a37d920243 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:54.542284 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b38491-4425-45c4-beb1-e2a37d920243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:54.542578 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b38491-4425-45c4-beb1-e2a37d920243 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:54.543305 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b38491-4425-45c4-beb1-e2a37d920243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:54.545216 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b38491-4425-45c4-beb1-e2a37d920243 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:54.573357 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1079/2169] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:15:54 2021] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:15:54.577991 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7866d8b-b4f8-4e4c-aede-33094e00e2bc None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:54.589736 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7866d8b-b4f8-4e4c-aede-33094e00e2bc None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:54.663982 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595f843-5d94-4370-b024-a3489d466dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:54.664870 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595f843-5d94-4370-b024-a3489d466dce admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:54.665274 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595f843-5d94-4370-b024-a3489d466dce admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:54.665649 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4595f843-5d94-4370-b024-a3489d466dce admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:54.666593 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595f843-5d94-4370-b024-a3489d466dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:54.668753 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4595f843-5d94-4370-b024-a3489d466dce admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:54.727988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1091/2170] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:15:54 2021] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:15:54.732123 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b38491-4425-45c4-beb1-e2a37d920243 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:54.762391 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b38491-4425-45c4-beb1-e2a37d920243 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:54.769178 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2724d-0c11-4ce1-be29-3c2fc0d236b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:54.769843 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2724d-0c11-4ce1-be29-3c2fc0d236b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:54.770170 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2724d-0c11-4ce1-be29-3c2fc0d236b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:54.770503 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2724d-0c11-4ce1-be29-3c2fc0d236b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:54.771810 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2724d-0c11-4ce1-be29-3c2fc0d236b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:54.773430 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2724d-0c11-4ce1-be29-3c2fc0d236b6 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:54.791019 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1080/2171] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:15:54 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:15:54.792146 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595f843-5d94-4370-b024-a3489d466dce admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:54.802290 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4595f843-5d94-4370-b024-a3489d466dce admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:54.809419 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889363af-edb4-4ab5-9dd5-ed3366b8d3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:54.810355 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889363af-edb4-4ab5-9dd5-ed3366b8d3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:54.810638 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889363af-edb4-4ab5-9dd5-ed3366b8d3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:54.810916 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889363af-edb4-4ab5-9dd5-ed3366b8d3bc admin admin] PATH_INFO: `/v3/projects/6082dbd1123b4bfe9969176db8ba117c/users/31beda62457e41f69030e81a66ea030f/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:54.828135 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889363af-edb4-4ab5-9dd5-ed3366b8d3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6082dbd1123b4bfe9969176db8ba117c, user_id=31beda62457e41f69030e81a66ea030f, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:54.831282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889363af-edb4-4ab5-9dd5-ed3366b8d3bc admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:54.848694 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1092/2172] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:15:54 2021] PUT /identity/v3/projects/6082dbd1123b4bfe9969176db8ba117c/users/31beda62457e41f69030e81a66ea030f/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:54.852834 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2724d-0c11-4ce1-be29-3c2fc0d236b6 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:54.864822 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2724d-0c11-4ce1-be29-3c2fc0d236b6 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:54.952441 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883eb9d-99f0-4a96-9298-f7e9af8da83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:54.953292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883eb9d-99f0-4a96-9298-f7e9af8da83d admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:54.953650 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883eb9d-99f0-4a96-9298-f7e9af8da83d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:54.954055 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883eb9d-99f0-4a96-9298-f7e9af8da83d admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:54.954884 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883eb9d-99f0-4a96-9298-f7e9af8da83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:54.957604 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883eb9d-99f0-4a96-9298-f7e9af8da83d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:54.972225 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1081/2173] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:15:54 2021] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:15:54.976850 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889363af-edb4-4ab5-9dd5-ed3366b8d3bc admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:54.987694 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889363af-edb4-4ab5-9dd5-ed3366b8d3bc admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:55.001594 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61934b-4952-4bcb-94ec-9bcf828734f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:55.003139 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61934b-4952-4bcb-94ec-9bcf828734f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:55.003992 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61934b-4952-4bcb-94ec-9bcf828734f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:55.004372 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61934b-4952-4bcb-94ec-9bcf828734f9 admin admin] PATH_INFO: `/v3/projects/6082dbd1123b4bfe9969176db8ba117c/users/31beda62457e41f69030e81a66ea030f/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:55.007988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61934b-4952-4bcb-94ec-9bcf828734f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6082dbd1123b4bfe9969176db8ba117c, user_id=31beda62457e41f69030e81a66ea030f, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:55.012734 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61934b-4952-4bcb-94ec-9bcf828734f9 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:55.026918 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1093/2174] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:15:54 2021] PUT /identity/v3/projects/6082dbd1123b4bfe9969176db8ba117c/users/31beda62457e41f69030e81a66ea030f/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:55.038606 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540032e0-8e75-4d09-8acc-3c21cadf825e None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:55.039123 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540032e0-8e75-4d09-8acc-3c21cadf825e None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:55.039400 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540032e0-8e75-4d09-8acc-3c21cadf825e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:55.080234 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-540032e0-8e75-4d09-8acc-3c21cadf825e None None] MFA Rules not processed for user `31beda62457e41f69030e81a66ea030f`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:55.081824 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-540032e0-8e75-4d09-8acc-3c21cadf825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:55.164258 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1082/2175] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:55 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:55.174470 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61934b-4952-4bcb-94ec-9bcf828734f9 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:55.180833 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-8b61934b-4952-4bcb-94ec-9bcf828734f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:55.242826 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61934b-4952-4bcb-94ec-9bcf828734f9 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:55.247200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20acd5f8-3b10-4e58-a8b8-1857984e6f3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:55.247966 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acd5f8-3b10-4e58-a8b8-1857984e6f3f service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:55.248343 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acd5f8-3b10-4e58-a8b8-1857984e6f3f service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:55.248713 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20acd5f8-3b10-4e58-a8b8-1857984e6f3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:55.258631 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acd5f8-3b10-4e58-a8b8-1857984e6f3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:55.260092 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20acd5f8-3b10-4e58-a8b8-1857984e6f3f service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:55.270943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1094/2176] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:15:55 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:15:55.440742 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540032e0-8e75-4d09-8acc-3c21cadf825e None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:55.518376 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540032e0-8e75-4d09-8acc-3c21cadf825e None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:55.524891 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416162e6-bd22-410a-b97b-6bd0a930febe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:55.526125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416162e6-bd22-410a-b97b-6bd0a930febe admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:55.526606 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416162e6-bd22-410a-b97b-6bd0a930febe admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:55.527096 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416162e6-bd22-410a-b97b-6bd0a930febe admin admin] PATH_INFO: `/v3/users/3bf351a3263b497e909b5d5b6231854f` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:55.528502 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416162e6-bd22-410a-b97b-6bd0a930febe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf351a3263b497e909b5d5b6231854f)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:55.530556 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416162e6-bd22-410a-b97b-6bd0a930febe admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:55.593662 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-416162e6-bd22-410a-b97b-6bd0a930febe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf351a3263b497e909b5d5b6231854f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:55.613885 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-416162e6-bd22-410a-b97b-6bd0a930febe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf351a3263b497e909b5d5b6231854f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:55.621636 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-416162e6-bd22-410a-b97b-6bd0a930febe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf351a3263b497e909b5d5b6231854f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:55.622341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-416162e6-bd22-410a-b97b-6bd0a930febe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf351a3263b497e909b5d5b6231854f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:55.638516 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-416162e6-bd22-410a-b97b-6bd0a930febe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf351a3263b497e909b5d5b6231854f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:55.644594 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1083/2177] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:15:55 2021] DELETE /identity/v3/users/3bf351a3263b497e909b5d5b6231854f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:55.650225 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c652590-0301-463c-a749-efb2d4add480 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:55.650520 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c652590-0301-463c-a749-efb2d4add480 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:55.650804 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c652590-0301-463c-a749-efb2d4add480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:55.674243 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-8c652590-0301-463c-a749-efb2d4add480 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:55.675726 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-8c652590-0301-463c-a749-efb2d4add480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:55.745100 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1095/2178] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:55.756197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416162e6-bd22-410a-b97b-6bd0a930febe admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:55.757735 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-416162e6-bd22-410a-b97b-6bd0a930febe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:55.841418 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416162e6-bd22-410a-b97b-6bd0a930febe admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:55.845224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3165ac-ec04-4fa8-853a-614bbf909441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:55.845808 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3165ac-ec04-4fa8-853a-614bbf909441 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:55.846141 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3165ac-ec04-4fa8-853a-614bbf909441 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:55.846434 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3165ac-ec04-4fa8-853a-614bbf909441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:55.858916 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3165ac-ec04-4fa8-853a-614bbf909441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:55.860390 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3165ac-ec04-4fa8-853a-614bbf909441 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:55.871182 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1084/2179] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:15:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:15:56.242608 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c652590-0301-463c-a749-efb2d4add480 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:56.244544 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-8c652590-0301-463c-a749-efb2d4add480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:56.262078 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c652590-0301-463c-a749-efb2d4add480 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:56.267099 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef16cef-185f-499e-b6a9-66ffbbeaa977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:56.267965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef16cef-185f-499e-b6a9-66ffbbeaa977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:56.268244 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef16cef-185f-499e-b6a9-66ffbbeaa977 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:56.268517 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef16cef-185f-499e-b6a9-66ffbbeaa977 admin admin] PATH_INFO: `/v3/projects/da67cbd2090a436386749a62c9de04ef` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:56.269729 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef16cef-185f-499e-b6a9-66ffbbeaa977 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da67cbd2090a436386749a62c9de04ef)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:56.272383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef16cef-185f-499e-b6a9-66ffbbeaa977 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:56.344067 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-aef16cef-185f-499e-b6a9-66ffbbeaa977 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da67cbd2090a436386749a62c9de04ef', 'request_id': 'req-aef16cef-185f-499e-b6a9-66ffbbeaa977'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:56.354350 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-aef16cef-185f-499e-b6a9-66ffbbeaa977 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da67cbd2090a436386749a62c9de04ef', 'request_id': 'req-aef16cef-185f-499e-b6a9-66ffbbeaa977'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:56.364528 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-aef16cef-185f-499e-b6a9-66ffbbeaa977 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da67cbd2090a436386749a62c9de04ef', 'request_id': 'req-aef16cef-185f-499e-b6a9-66ffbbeaa977'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:56.382655 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-aef16cef-185f-499e-b6a9-66ffbbeaa977 admin admin] The token cache is being invalidate because project da67cbd2090a436386749a62c9de04ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:15:56.384195 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-aef16cef-185f-499e-b6a9-66ffbbeaa977 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:56.385521 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-aef16cef-185f-499e-b6a9-66ffbbeaa977 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:56.388103 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1096/2180] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:15:56 2021] DELETE /identity/v3/projects/da67cbd2090a436386749a62c9de04ef => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:56.391958 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3165ac-ec04-4fa8-853a-614bbf909441 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:56.412827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3165ac-ec04-4fa8-853a-614bbf909441 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:56.485649 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc8d50-c1c2-4156-922a-77a2b4fc4e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:56.486549 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc8d50-c1c2-4156-922a-77a2b4fc4e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:56.486827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc8d50-c1c2-4156-922a-77a2b4fc4e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:56.487107 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc8d50-c1c2-4156-922a-77a2b4fc4e94 admin admin] PATH_INFO: `/v3/users/31beda62457e41f69030e81a66ea030f` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:56.488320 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc8d50-c1c2-4156-922a-77a2b4fc4e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31beda62457e41f69030e81a66ea030f)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:56.490932 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc8d50-c1c2-4156-922a-77a2b4fc4e94 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:56.546366 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c7bc8d50-c1c2-4156-922a-77a2b4fc4e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31beda62457e41f69030e81a66ea030f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:56.560914 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c7bc8d50-c1c2-4156-922a-77a2b4fc4e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31beda62457e41f69030e81a66ea030f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:56.569061 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c7bc8d50-c1c2-4156-922a-77a2b4fc4e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31beda62457e41f69030e81a66ea030f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:56.569910 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c7bc8d50-c1c2-4156-922a-77a2b4fc4e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31beda62457e41f69030e81a66ea030f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:56.583240 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c7bc8d50-c1c2-4156-922a-77a2b4fc4e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31beda62457e41f69030e81a66ea030f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:56.590274 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1085/2181] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:15:56 2021] DELETE /identity/v3/users/31beda62457e41f69030e81a66ea030f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:56.936941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef16cef-185f-499e-b6a9-66ffbbeaa977 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:56.938419 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-aef16cef-185f-499e-b6a9-66ffbbeaa977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:56.957257 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef16cef-185f-499e-b6a9-66ffbbeaa977 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:57.025741 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05658c18-eac2-4efe-9722-c56dbff657aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:57.026929 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05658c18-eac2-4efe-9722-c56dbff657aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:57.027439 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05658c18-eac2-4efe-9722-c56dbff657aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:57.027835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05658c18-eac2-4efe-9722-c56dbff657aa admin admin] PATH_INFO: `/v3/projects/6082dbd1123b4bfe9969176db8ba117c` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:57.029777 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05658c18-eac2-4efe-9722-c56dbff657aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6082dbd1123b4bfe9969176db8ba117c)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:57.031811 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05658c18-eac2-4efe-9722-c56dbff657aa admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:57.082844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-05658c18-eac2-4efe-9722-c56dbff657aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6082dbd1123b4bfe9969176db8ba117c', 'request_id': 'req-05658c18-eac2-4efe-9722-c56dbff657aa'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:57.089274 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-05658c18-eac2-4efe-9722-c56dbff657aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6082dbd1123b4bfe9969176db8ba117c', 'request_id': 'req-05658c18-eac2-4efe-9722-c56dbff657aa'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:57.098563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-05658c18-eac2-4efe-9722-c56dbff657aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6082dbd1123b4bfe9969176db8ba117c', 'request_id': 'req-05658c18-eac2-4efe-9722-c56dbff657aa'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:57.112016 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-05658c18-eac2-4efe-9722-c56dbff657aa admin admin] The token cache is being invalidate because project 6082dbd1123b4bfe9969176db8ba117c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:15:57.112312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-05658c18-eac2-4efe-9722-c56dbff657aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:57.112957 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-05658c18-eac2-4efe-9722-c56dbff657aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:57.117958 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1097/2182] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:15:56 2021] DELETE /identity/v3/projects/6082dbd1123b4bfe9969176db8ba117c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:57.120500 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bae45-b764-4e28-a9e2-62bb2be15d94 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:57.120994 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bae45-b764-4e28-a9e2-62bb2be15d94 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:57.121259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bae45-b764-4e28-a9e2-62bb2be15d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:57.140329 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-f29bae45-b764-4e28-a9e2-62bb2be15d94 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:57.141659 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-f29bae45-b764-4e28-a9e2-62bb2be15d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:57.211532 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1086/2183] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:57.213295 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6da28-7c60-4bdc-85a9-7a3283d8abdf None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:57.213586 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6da28-7c60-4bdc-85a9-7a3283d8abdf None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:57.213866 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e6da28-7c60-4bdc-85a9-7a3283d8abdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:57.238260 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-65e6da28-7c60-4bdc-85a9-7a3283d8abdf None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:57.242301 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-65e6da28-7c60-4bdc-85a9-7a3283d8abdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:57.252975 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1098/2184] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:57.257329 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bae45-b764-4e28-a9e2-62bb2be15d94 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:57.267835 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bae45-b764-4e28-a9e2-62bb2be15d94 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:57.273625 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fceb4-0bc8-4d30-bf40-739e06bf4358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:57.274320 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fceb4-0bc8-4d30-bf40-739e06bf4358 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:57.274651 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fceb4-0bc8-4d30-bf40-739e06bf4358 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:57.274923 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fceb4-0bc8-4d30-bf40-739e06bf4358 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:57.275718 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fceb4-0bc8-4d30-bf40-739e06bf4358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:15:57.276017 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fceb4-0bc8-4d30-bf40-739e06bf4358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:57.277615 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fceb4-0bc8-4d30-bf40-739e06bf4358 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:57.291763 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1087/2185] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:15:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:15:57.296044 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6da28-7c60-4bdc-85a9-7a3283d8abdf None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:57.306251 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e6da28-7c60-4bdc-85a9-7a3283d8abdf None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:57.311842 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bdba6-8c5a-4ebc-8515-59aa462e0a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:57.312641 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bdba6-8c5a-4ebc-8515-59aa462e0a97 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:57.313024 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bdba6-8c5a-4ebc-8515-59aa462e0a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:57.313409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bdba6-8c5a-4ebc-8515-59aa462e0a97 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:57.314277 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bdba6-8c5a-4ebc-8515-59aa462e0a97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:57.316513 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bdba6-8c5a-4ebc-8515-59aa462e0a97 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:57.355256 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1099/2186] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:15:57 2021] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:15:57.359006 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fceb4-0bc8-4d30-bf40-739e06bf4358 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:57.370510 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fceb4-0bc8-4d30-bf40-739e06bf4358 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:57.446715 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e65384-d298-42c4-af89-2e2a37385191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:57.447396 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e65384-d298-42c4-af89-2e2a37385191 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:57.447678 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e65384-d298-42c4-af89-2e2a37385191 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:57.447960 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e65384-d298-42c4-af89-2e2a37385191 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:57.449960 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e65384-d298-42c4-af89-2e2a37385191 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:57.450699 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e65384-d298-42c4-af89-2e2a37385191 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:57.485571 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1088/2187] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:15:57 2021] POST /identity/v3/users => generated 291 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:15:57.490246 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bdba6-8c5a-4ebc-8515-59aa462e0a97 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:57.500666 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bdba6-8c5a-4ebc-8515-59aa462e0a97 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:57.507642 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b9fab-1691-4756-9404-25b40fafe3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:57.508258 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b9fab-1691-4756-9404-25b40fafe3bf admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:57.508644 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b9fab-1691-4756-9404-25b40fafe3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:57.509104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b9fab-1691-4756-9404-25b40fafe3bf admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:57.509991 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b9fab-1691-4756-9404-25b40fafe3bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:57.511700 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b9fab-1691-4756-9404-25b40fafe3bf admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:57.535873 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1100/2188] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:15:57 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:15:57.535983 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e65384-d298-42c4-af89-2e2a37385191 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:57.543287 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e65384-d298-42c4-af89-2e2a37385191 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:57.548552 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda15667-a2a4-4482-9d12-2af290ea0f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:57.549301 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda15667-a2a4-4482-9d12-2af290ea0f9e admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:57.549648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda15667-a2a4-4482-9d12-2af290ea0f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:57.550150 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda15667-a2a4-4482-9d12-2af290ea0f9e admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:57.551018 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda15667-a2a4-4482-9d12-2af290ea0f9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:57.552769 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda15667-a2a4-4482-9d12-2af290ea0f9e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:57.565966 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1089/2189] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:15:57 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:15:57.568739 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b9fab-1691-4756-9404-25b40fafe3bf admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:57.579209 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b9fab-1691-4756-9404-25b40fafe3bf admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:57.589380 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6e0b8-a418-447a-b2c3-bdaa09cd0f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:57.590513 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6e0b8-a418-447a-b2c3-bdaa09cd0f33 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:57.590791 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6e0b8-a418-447a-b2c3-bdaa09cd0f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:57.591062 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c6e0b8-a418-447a-b2c3-bdaa09cd0f33 admin admin] PATH_INFO: `/v3/projects/384b1b0f9d51470abdd2e515a0a67b65/users/8c47c507277449a0bbbeefca8637d410/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:57.608237 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6e0b8-a418-447a-b2c3-bdaa09cd0f33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=384b1b0f9d51470abdd2e515a0a67b65, user_id=8c47c507277449a0bbbeefca8637d410, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:57.611101 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c6e0b8-a418-447a-b2c3-bdaa09cd0f33 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:57.630012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1101/2190] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:15:57 2021] PUT /identity/v3/projects/384b1b0f9d51470abdd2e515a0a67b65/users/8c47c507277449a0bbbeefca8637d410/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:57.645648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97942e70-724f-44ec-b765-a175acb61e70 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:57.646326 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97942e70-724f-44ec-b765-a175acb61e70 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:57.646955 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97942e70-724f-44ec-b765-a175acb61e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:57.692367 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-97942e70-724f-44ec-b765-a175acb61e70 None None] MFA Rules not processed for user `8c47c507277449a0bbbeefca8637d410`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:57.694316 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-97942e70-724f-44ec-b765-a175acb61e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:57.802467 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1090/2191] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:57 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:57.815246 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6e0b8-a418-447a-b2c3-bdaa09cd0f33 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:57.879187 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c6e0b8-a418-447a-b2c3-bdaa09cd0f33 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:57.884256 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d7b6f-316b-43e2-9880-257c4235238d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:57.884938 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d7b6f-316b-43e2-9880-257c4235238d admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:57.885224 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d7b6f-316b-43e2-9880-257c4235238d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:57.885496 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1d7b6f-316b-43e2-9880-257c4235238d admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:57.886266 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d7b6f-316b-43e2-9880-257c4235238d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:57.888511 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1d7b6f-316b-43e2-9880-257c4235238d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:57.938507 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1102/2192] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:15:57 2021] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:15:57.939830 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97942e70-724f-44ec-b765-a175acb61e70 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:57.954006 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97942e70-724f-44ec-b765-a175acb61e70 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:58.030361 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe65aff-f78a-46ee-a033-25040e701a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:58.031165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe65aff-f78a-46ee-a033-25040e701a02 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:58.031388 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe65aff-f78a-46ee-a033-25040e701a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:58.031662 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe65aff-f78a-46ee-a033-25040e701a02 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:58.032575 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe65aff-f78a-46ee-a033-25040e701a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:58.035765 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe65aff-f78a-46ee-a033-25040e701a02 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:58.057578 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1091/2193] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:15:57 2021] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:15:58.062063 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d7b6f-316b-43e2-9880-257c4235238d admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:58.071529 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1d7b6f-316b-43e2-9880-257c4235238d admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:58.076294 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7bd85-dddb-482f-ae45-92dd06875be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:58.076956 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7bd85-dddb-482f-ae45-92dd06875be1 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:58.077232 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7bd85-dddb-482f-ae45-92dd06875be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:58.077501 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec7bd85-dddb-482f-ae45-92dd06875be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:58.078311 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7bd85-dddb-482f-ae45-92dd06875be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:58.079985 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec7bd85-dddb-482f-ae45-92dd06875be1 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:58.097959 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1103/2194] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:15:58 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:15:58.102333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe65aff-f78a-46ee-a033-25040e701a02 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:58.118805 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe65aff-f78a-46ee-a033-25040e701a02 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:58.126061 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee85fb-4623-43b1-8f76-be5733865247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:58.128928 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee85fb-4623-43b1-8f76-be5733865247 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:58.128928 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee85fb-4623-43b1-8f76-be5733865247 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:58.128928 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee85fb-4623-43b1-8f76-be5733865247 admin admin] PATH_INFO: `/v3/projects/3f429ff19e4c4be0b4bfa048cc3836b4/users/128d84585147492c9466291347fbf305/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:58.154315 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee85fb-4623-43b1-8f76-be5733865247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f429ff19e4c4be0b4bfa048cc3836b4, user_id=128d84585147492c9466291347fbf305, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:58.157936 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ee85fb-4623-43b1-8f76-be5733865247 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:58.176745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1092/2195] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:15:58 2021] PUT /identity/v3/projects/3f429ff19e4c4be0b4bfa048cc3836b4/users/128d84585147492c9466291347fbf305/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:58.182279 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7bd85-dddb-482f-ae45-92dd06875be1 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:58.198386 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec7bd85-dddb-482f-ae45-92dd06875be1 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:58.276597 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754de14-7439-48bf-9efe-e2f628aa28e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:58.277344 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754de14-7439-48bf-9efe-e2f628aa28e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:58.277540 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754de14-7439-48bf-9efe-e2f628aa28e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:58.277810 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754de14-7439-48bf-9efe-e2f628aa28e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:58.278931 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754de14-7439-48bf-9efe-e2f628aa28e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:58.280760 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754de14-7439-48bf-9efe-e2f628aa28e4 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:58.295246 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1104/2196] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:15:58 2021] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:15:58.299234 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee85fb-4623-43b1-8f76-be5733865247 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:58.312211 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ee85fb-4623-43b1-8f76-be5733865247 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:58.319787 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd7d3c-3885-4b11-b95a-68062fe05686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:58.319787 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd7d3c-3885-4b11-b95a-68062fe05686 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:58.320062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd7d3c-3885-4b11-b95a-68062fe05686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:58.320388 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dd7d3c-3885-4b11-b95a-68062fe05686 admin admin] PATH_INFO: `/v3/projects/3f429ff19e4c4be0b4bfa048cc3836b4/users/128d84585147492c9466291347fbf305/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:58.323482 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd7d3c-3885-4b11-b95a-68062fe05686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f429ff19e4c4be0b4bfa048cc3836b4, user_id=128d84585147492c9466291347fbf305, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:58.326383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dd7d3c-3885-4b11-b95a-68062fe05686 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:58.344380 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1093/2197] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:15:58 2021] PUT /identity/v3/projects/3f429ff19e4c4be0b4bfa048cc3836b4/users/128d84585147492c9466291347fbf305/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:15:58.353422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8237639-b7ee-4e61-8fa9-a5d602a16b5e None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:58.355061 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8237639-b7ee-4e61-8fa9-a5d602a16b5e None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:58.355353 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8237639-b7ee-4e61-8fa9-a5d602a16b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:58.384972 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-b8237639-b7ee-4e61-8fa9-a5d602a16b5e None None] MFA Rules not processed for user `128d84585147492c9466291347fbf305`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:58.386243 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b8237639-b7ee-4e61-8fa9-a5d602a16b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:58.462377 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1105/2198] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:58 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:58.473062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd7d3c-3885-4b11-b95a-68062fe05686 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:58.474910 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-78dd7d3c-3885-4b11-b95a-68062fe05686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:58.546459 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dd7d3c-3885-4b11-b95a-68062fe05686 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:58.556316 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de83336a-b7fa-49f4-be45-f0307569f592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:58.557632 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83336a-b7fa-49f4-be45-f0307569f592 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:58.557942 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83336a-b7fa-49f4-be45-f0307569f592 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:58.558232 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de83336a-b7fa-49f4-be45-f0307569f592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:58.570211 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83336a-b7fa-49f4-be45-f0307569f592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:58.573263 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de83336a-b7fa-49f4-be45-f0307569f592 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:58.600492 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1094/2199] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:15:58 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:15:59.043011 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8237639-b7ee-4e61-8fa9-a5d602a16b5e None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:59.113172 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8237639-b7ee-4e61-8fa9-a5d602a16b5e None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:59.117769 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bd4c4-207c-4e80-93fb-c59289319c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:59.118685 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd4c4-207c-4e80-93fb-c59289319c5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:59.118967 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd4c4-207c-4e80-93fb-c59289319c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:59.119250 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd4c4-207c-4e80-93fb-c59289319c5d admin admin] PATH_INFO: `/v3/users/8c47c507277449a0bbbeefca8637d410` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:59.120451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bd4c4-207c-4e80-93fb-c59289319c5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c47c507277449a0bbbeefca8637d410)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:59.122404 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bd4c4-207c-4e80-93fb-c59289319c5d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:59.184595 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-702bd4c4-207c-4e80-93fb-c59289319c5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c47c507277449a0bbbeefca8637d410'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:59.185269 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-702bd4c4-207c-4e80-93fb-c59289319c5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c47c507277449a0bbbeefca8637d410'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:59.200484 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-702bd4c4-207c-4e80-93fb-c59289319c5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c47c507277449a0bbbeefca8637d410'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:59.201201 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-702bd4c4-207c-4e80-93fb-c59289319c5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c47c507277449a0bbbeefca8637d410'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:59.214514 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-702bd4c4-207c-4e80-93fb-c59289319c5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c47c507277449a0bbbeefca8637d410'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:15:59.230928 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1106/2200] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:15:59 2021] DELETE /identity/v3/users/8c47c507277449a0bbbeefca8637d410 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:15:59.235278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6af06d-98f6-4b1d-a94e-2844e7fb7de5 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:59.235785 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6af06d-98f6-4b1d-a94e-2844e7fb7de5 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:59.235906 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6af06d-98f6-4b1d-a94e-2844e7fb7de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:59.259630 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-ce6af06d-98f6-4b1d-a94e-2844e7fb7de5 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:15:59.260288 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-ce6af06d-98f6-4b1d-a94e-2844e7fb7de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:59.360750 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1095/2201] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:15:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:15:59.371004 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bd4c4-207c-4e80-93fb-c59289319c5d admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:59.372774 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-702bd4c4-207c-4e80-93fb-c59289319c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:15:59.443758 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bd4c4-207c-4e80-93fb-c59289319c5d admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:15:59.458929 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa5784-fa40-4640-ac01-ecd29b502831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:15:59.459703 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa5784-fa40-4640-ac01-ecd29b502831 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:15:59.460056 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa5784-fa40-4640-ac01-ecd29b502831 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:15:59.460410 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa5784-fa40-4640-ac01-ecd29b502831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:15:59.471120 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa5784-fa40-4640-ac01-ecd29b502831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:15:59.473031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa5784-fa40-4640-ac01-ecd29b502831 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:15:59.489366 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1107/2202] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:15:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:15:59.990931 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6af06d-98f6-4b1d-a94e-2844e7fb7de5 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:15:59.992651 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-ce6af06d-98f6-4b1d-a94e-2844e7fb7de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:16:00.026538 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6af06d-98f6-4b1d-a94e-2844e7fb7de5 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:16:00.032233 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0958b-58f5-4417-9636-18545f9f4c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:16:00.033097 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0958b-58f5-4417-9636-18545f9f4c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:00.033555 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0958b-58f5-4417-9636-18545f9f4c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:00.034039 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0958b-58f5-4417-9636-18545f9f4c4c admin admin] PATH_INFO: `/v3/projects/384b1b0f9d51470abdd2e515a0a67b65` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:00.035452 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0958b-58f5-4417-9636-18545f9f4c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=384b1b0f9d51470abdd2e515a0a67b65)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:16:00.038754 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0958b-58f5-4417-9636-18545f9f4c4c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:16:00.098078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-92b0958b-58f5-4417-9636-18545f9f4c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '384b1b0f9d51470abdd2e515a0a67b65', 'request_id': 'req-92b0958b-58f5-4417-9636-18545f9f4c4c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:16:00.105116 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-92b0958b-58f5-4417-9636-18545f9f4c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '384b1b0f9d51470abdd2e515a0a67b65', 'request_id': 'req-92b0958b-58f5-4417-9636-18545f9f4c4c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:16:00.121959 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-92b0958b-58f5-4417-9636-18545f9f4c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '384b1b0f9d51470abdd2e515a0a67b65', 'request_id': 'req-92b0958b-58f5-4417-9636-18545f9f4c4c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:16:00.135861 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-92b0958b-58f5-4417-9636-18545f9f4c4c admin admin] The token cache is being invalidate because project 384b1b0f9d51470abdd2e515a0a67b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:16:00.136075 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-92b0958b-58f5-4417-9636-18545f9f4c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:16:00.136777 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-92b0958b-58f5-4417-9636-18545f9f4c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:16:00.139099 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1096/2203] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:15:59 2021] DELETE /identity/v3/projects/384b1b0f9d51470abdd2e515a0a67b65 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:16:00.144011 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa5784-fa40-4640-ac01-ecd29b502831 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:16:00.158422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa5784-fa40-4640-ac01-ecd29b502831 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:16:00.235761 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c186a3-b7c1-4e07-9033-c837c801d826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:16:00.236734 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c186a3-b7c1-4e07-9033-c837c801d826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:00.237214 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c186a3-b7c1-4e07-9033-c837c801d826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:00.237602 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c186a3-b7c1-4e07-9033-c837c801d826 admin admin] PATH_INFO: `/v3/users/128d84585147492c9466291347fbf305` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:00.239269 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c186a3-b7c1-4e07-9033-c837c801d826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=128d84585147492c9466291347fbf305)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:16:00.241350 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c186a3-b7c1-4e07-9033-c837c801d826 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:16:00.322688 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b4c186a3-b7c1-4e07-9033-c837c801d826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '128d84585147492c9466291347fbf305'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:16:00.324653 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b4c186a3-b7c1-4e07-9033-c837c801d826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '128d84585147492c9466291347fbf305'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:16:00.342398 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b4c186a3-b7c1-4e07-9033-c837c801d826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '128d84585147492c9466291347fbf305'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:16:00.343503 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b4c186a3-b7c1-4e07-9033-c837c801d826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '128d84585147492c9466291347fbf305'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:16:00.358740 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b4c186a3-b7c1-4e07-9033-c837c801d826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '128d84585147492c9466291347fbf305'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:16:00.373986 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1108/2204] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:16:00 2021] DELETE /identity/v3/users/128d84585147492c9466291347fbf305 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:16:00.728335 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0958b-58f5-4417-9636-18545f9f4c4c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:16:00.729783 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-92b0958b-58f5-4417-9636-18545f9f4c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:16:00.779188 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0958b-58f5-4417-9636-18545f9f4c4c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:16:00.891786 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca614071-c3e1-4b71-ac32-54d8f828351c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:16:00.892752 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca614071-c3e1-4b71-ac32-54d8f828351c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:00.893095 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca614071-c3e1-4b71-ac32-54d8f828351c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:00.893378 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca614071-c3e1-4b71-ac32-54d8f828351c admin admin] PATH_INFO: `/v3/projects/3f429ff19e4c4be0b4bfa048cc3836b4` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:00.894818 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca614071-c3e1-4b71-ac32-54d8f828351c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f429ff19e4c4be0b4bfa048cc3836b4)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:16:00.897243 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca614071-c3e1-4b71-ac32-54d8f828351c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:16:00.948163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ca614071-c3e1-4b71-ac32-54d8f828351c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f429ff19e4c4be0b4bfa048cc3836b4', 'request_id': 'req-ca614071-c3e1-4b71-ac32-54d8f828351c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:16:00.953677 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ca614071-c3e1-4b71-ac32-54d8f828351c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f429ff19e4c4be0b4bfa048cc3836b4', 'request_id': 'req-ca614071-c3e1-4b71-ac32-54d8f828351c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:16:00.962982 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ca614071-c3e1-4b71-ac32-54d8f828351c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f429ff19e4c4be0b4bfa048cc3836b4', 'request_id': 'req-ca614071-c3e1-4b71-ac32-54d8f828351c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:16:00.984059 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ca614071-c3e1-4b71-ac32-54d8f828351c admin admin] The token cache is being invalidate because project 3f429ff19e4c4be0b4bfa048cc3836b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:16:00.984354 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ca614071-c3e1-4b71-ac32-54d8f828351c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:16:00.985024 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-ca614071-c3e1-4b71-ac32-54d8f828351c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:16:00.986617 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1097/2205] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:16:00 2021] DELETE /identity/v3/projects/3f429ff19e4c4be0b4bfa048cc3836b4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:16:00.992471 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0e7df-5938-4483-85f5-787ea445af4f None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:00.993015 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0e7df-5938-4483-85f5-787ea445af4f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:00.993383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee0e7df-5938-4483-85f5-787ea445af4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:01.011918 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-fee0e7df-5938-4483-85f5-787ea445af4f None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:16:01.013158 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-fee0e7df-5938-4483-85f5-787ea445af4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:16:01.121955 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1109/2206] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:16:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:16:01.127824 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2a327-d0ff-4a0a-bebb-1bae600bfe23 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:01.128148 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2a327-d0ff-4a0a-bebb-1bae600bfe23 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:01.128432 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec2a327-d0ff-4a0a-bebb-1bae600bfe23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:01.206800 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-6ec2a327-d0ff-4a0a-bebb-1bae600bfe23 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:16:01.207961 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-6ec2a327-d0ff-4a0a-bebb-1bae600bfe23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:16:01.278496 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1098/2207] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:16:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:16:01.282878 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0e7df-5938-4483-85f5-787ea445af4f None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:16:01.348888 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee0e7df-5938-4483-85f5-787ea445af4f None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:16:01.354819 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b156d3-5f25-4fa2-9aae-9b9461919d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:16:01.355729 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b156d3-5f25-4fa2-9aae-9b9461919d71 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:01.356377 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b156d3-5f25-4fa2-9aae-9b9461919d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:01.356762 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b156d3-5f25-4fa2-9aae-9b9461919d71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:01.357519 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b156d3-5f25-4fa2-9aae-9b9461919d71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:16:01.357833 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b156d3-5f25-4fa2-9aae-9b9461919d71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:16:01.360681 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b156d3-5f25-4fa2-9aae-9b9461919d71 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:16:01.391399 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1110/2208] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:16:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:16:01.392604 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2a327-d0ff-4a0a-bebb-1bae600bfe23 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:16:01.403763 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec2a327-d0ff-4a0a-bebb-1bae600bfe23 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:16:01.409569 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada11dd4-e4c5-4355-b7d2-6eac2cc7a9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:16:01.410276 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada11dd4-e4c5-4355-b7d2-6eac2cc7a9aa admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:01.410579 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada11dd4-e4c5-4355-b7d2-6eac2cc7a9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:01.410832 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada11dd4-e4c5-4355-b7d2-6eac2cc7a9aa admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:01.411595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada11dd4-e4c5-4355-b7d2-6eac2cc7a9aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:16:01.413619 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada11dd4-e4c5-4355-b7d2-6eac2cc7a9aa admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:16:01.476126 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1099/2209] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:16:01 2021] POST /identity/v3/projects => generated 375 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:16:01.481351 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b156d3-5f25-4fa2-9aae-9b9461919d71 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:16:01.492926 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b156d3-5f25-4fa2-9aae-9b9461919d71 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:16:01.570785 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d26322-06da-4d05-bcf2-9eb9dc0ed28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:16:01.571539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d26322-06da-4d05-bcf2-9eb9dc0ed28c admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:01.571820 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d26322-06da-4d05-bcf2-9eb9dc0ed28c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:01.572092 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d26322-06da-4d05-bcf2-9eb9dc0ed28c admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:01.572809 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d26322-06da-4d05-bcf2-9eb9dc0ed28c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:16:01.574773 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d26322-06da-4d05-bcf2-9eb9dc0ed28c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:16:01.596585 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1111/2210] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:16:01 2021] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:16:01.600565 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada11dd4-e4c5-4355-b7d2-6eac2cc7a9aa admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:16:01.612580 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada11dd4-e4c5-4355-b7d2-6eac2cc7a9aa admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:16:01.623797 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63535eef-7ff5-4f82-b5f6-c25658316559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:16:01.624531 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63535eef-7ff5-4f82-b5f6-c25658316559 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:01.624817 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63535eef-7ff5-4f82-b5f6-c25658316559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:01.625096 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63535eef-7ff5-4f82-b5f6-c25658316559 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:01.625860 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63535eef-7ff5-4f82-b5f6-c25658316559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:16:01.627498 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63535eef-7ff5-4f82-b5f6-c25658316559 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:16:01.642331 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1100/2211] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:16:01 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:16:01.646202 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d26322-06da-4d05-bcf2-9eb9dc0ed28c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:16:01.657245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d26322-06da-4d05-bcf2-9eb9dc0ed28c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:16:01.663068 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8177f0ea-3717-4278-b800-008942853dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:16:01.663745 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177f0ea-3717-4278-b800-008942853dfc admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:01.664028 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177f0ea-3717-4278-b800-008942853dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:01.664668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8177f0ea-3717-4278-b800-008942853dfc admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:01.665451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177f0ea-3717-4278-b800-008942853dfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:16:01.667087 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8177f0ea-3717-4278-b800-008942853dfc admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:16:01.680219 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1112/2212] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:16:01 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:16:01.684160 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63535eef-7ff5-4f82-b5f6-c25658316559 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:16:01.695299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63535eef-7ff5-4f82-b5f6-c25658316559 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:16:01.702425 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdcf9c-598c-44b6-af67-40fff09d56a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:16:01.703316 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdcf9c-598c-44b6-af67-40fff09d56a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:01.703603 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdcf9c-598c-44b6-af67-40fff09d56a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:01.703889 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfdcf9c-598c-44b6-af67-40fff09d56a2 admin admin] PATH_INFO: `/v3/projects/9be024d9c73c42bf9dcb9727c42100d4/users/2395dd2768604e33a84adbc49f207a6f/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:01.723255 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdcf9c-598c-44b6-af67-40fff09d56a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9be024d9c73c42bf9dcb9727c42100d4, user_id=2395dd2768604e33a84adbc49f207a6f, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:16:01.725869 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfdcf9c-598c-44b6-af67-40fff09d56a2 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:16:01.741464 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1101/2213] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:16:01 2021] PUT /identity/v3/projects/9be024d9c73c42bf9dcb9727c42100d4/users/2395dd2768604e33a84adbc49f207a6f/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:16:01.751548 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b1dd6-ae91-4263-a9e9-d71e3eeeda3b None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:01.751933 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b1dd6-ae91-4263-a9e9-d71e3eeeda3b None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:01.752276 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b1dd6-ae91-4263-a9e9-d71e3eeeda3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:01.790057 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e63b1dd6-ae91-4263-a9e9-d71e3eeeda3b None None] MFA Rules not processed for user `2395dd2768604e33a84adbc49f207a6f`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:16:01.791277 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e63b1dd6-ae91-4263-a9e9-d71e3eeeda3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:16:01.856731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1113/2214] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:16:01 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:16:01.860973 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdcf9c-598c-44b6-af67-40fff09d56a2 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:16:01.945051 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfdcf9c-598c-44b6-af67-40fff09d56a2 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:16:01.956033 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372abf8-2578-4a6b-b191-e1a18b9c835b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:16:01.956275 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372abf8-2578-4a6b-b191-e1a18b9c835b admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:01.956458 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372abf8-2578-4a6b-b191-e1a18b9c835b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:01.956729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372abf8-2578-4a6b-b191-e1a18b9c835b admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:01.957461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372abf8-2578-4a6b-b191-e1a18b9c835b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:16:01.959434 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1372abf8-2578-4a6b-b191-e1a18b9c835b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:16:01.988141 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1102/2215] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:16:01 2021] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:16:01.992603 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b1dd6-ae91-4263-a9e9-d71e3eeeda3b None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:16:02.004050 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b1dd6-ae91-4263-a9e9-d71e3eeeda3b None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:16:02.067579 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a46ba6-4923-4ff8-b551-c01c3d4a46de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:16:02.068265 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a46ba6-4923-4ff8-b551-c01c3d4a46de admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:02.068550 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a46ba6-4923-4ff8-b551-c01c3d4a46de admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:02.068825 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a46ba6-4923-4ff8-b551-c01c3d4a46de admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:02.069529 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a46ba6-4923-4ff8-b551-c01c3d4a46de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:16:02.071549 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a46ba6-4923-4ff8-b551-c01c3d4a46de admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:16:02.091522 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1114/2216] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:16:01 2021] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:16:02.095241 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372abf8-2578-4a6b-b191-e1a18b9c835b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:16:02.106533 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372abf8-2578-4a6b-b191-e1a18b9c835b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:16:02.111217 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955f95f-f618-477e-a31b-6b9c08829434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:16:02.111874 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955f95f-f618-477e-a31b-6b9c08829434 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:02.112160 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955f95f-f618-477e-a31b-6b9c08829434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:02.112462 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955f95f-f618-477e-a31b-6b9c08829434 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:02.113207 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955f95f-f618-477e-a31b-6b9c08829434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:16:02.115431 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955f95f-f618-477e-a31b-6b9c08829434 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:16:02.126638 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1103/2217] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:16:02 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:16:02.130909 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a46ba6-4923-4ff8-b551-c01c3d4a46de admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:16:02.140778 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a46ba6-4923-4ff8-b551-c01c3d4a46de admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:16:02.145455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccdcc6-f9a0-4ecd-844f-bc7ce7b6ea95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:16:02.146409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccdcc6-f9a0-4ecd-844f-bc7ce7b6ea95 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:02.146724 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccdcc6-f9a0-4ecd-844f-bc7ce7b6ea95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:02.147000 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccdcc6-f9a0-4ecd-844f-bc7ce7b6ea95 admin admin] PATH_INFO: `/v3/projects/3df2ea529f8e4ce3b8a7e9f921e83cf7/users/f32ed31e8b0f4fa0b4bc1a98aba54fe5/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:02.161055 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccdcc6-f9a0-4ecd-844f-bc7ce7b6ea95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df2ea529f8e4ce3b8a7e9f921e83cf7, user_id=f32ed31e8b0f4fa0b4bc1a98aba54fe5, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:16:02.164297 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ccdcc6-f9a0-4ecd-844f-bc7ce7b6ea95 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:16:02.176839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1115/2218] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:16:02 2021] PUT /identity/v3/projects/3df2ea529f8e4ce3b8a7e9f921e83cf7/users/f32ed31e8b0f4fa0b4bc1a98aba54fe5/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:16:02.181411 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955f95f-f618-477e-a31b-6b9c08829434 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:16:02.191707 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955f95f-f618-477e-a31b-6b9c08829434 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:16:02.247225 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521de63d-e5c2-4b9b-a6e8-3a1adaca34af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:16:02.247803 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521de63d-e5c2-4b9b-a6e8-3a1adaca34af admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:02.248083 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521de63d-e5c2-4b9b-a6e8-3a1adaca34af admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:02.248359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521de63d-e5c2-4b9b-a6e8-3a1adaca34af admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:02.249095 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521de63d-e5c2-4b9b-a6e8-3a1adaca34af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:16:02.250717 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521de63d-e5c2-4b9b-a6e8-3a1adaca34af admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:16:02.260360 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1104/2219] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:16:02 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:16:02.264457 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccdcc6-f9a0-4ecd-844f-bc7ce7b6ea95 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:16:02.275066 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ccdcc6-f9a0-4ecd-844f-bc7ce7b6ea95 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:16:02.279765 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d82ac-4227-4dd2-a5b5-18e55d9731a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:16:02.280631 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d82ac-4227-4dd2-a5b5-18e55d9731a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:02.280915 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d82ac-4227-4dd2-a5b5-18e55d9731a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:02.281192 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d82ac-4227-4dd2-a5b5-18e55d9731a1 admin admin] PATH_INFO: `/v3/projects/3df2ea529f8e4ce3b8a7e9f921e83cf7/users/f32ed31e8b0f4fa0b4bc1a98aba54fe5/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:02.283173 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d82ac-4227-4dd2-a5b5-18e55d9731a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3df2ea529f8e4ce3b8a7e9f921e83cf7, user_id=f32ed31e8b0f4fa0b4bc1a98aba54fe5, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:16:02.285846 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d82ac-4227-4dd2-a5b5-18e55d9731a1 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:16:02.296540 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1116/2220] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:16:02 2021] PUT /identity/v3/projects/3df2ea529f8e4ce3b8a7e9f921e83cf7/users/f32ed31e8b0f4fa0b4bc1a98aba54fe5/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:16:02.308296 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a67765-39a8-4280-9c72-cf8ded2ec22f None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:02.308583 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a67765-39a8-4280-9c72-cf8ded2ec22f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:02.308861 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a67765-39a8-4280-9c72-cf8ded2ec22f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:02.335111 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-10a67765-39a8-4280-9c72-cf8ded2ec22f None None] MFA Rules not processed for user `f32ed31e8b0f4fa0b4bc1a98aba54fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:16:02.336352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-10a67765-39a8-4280-9c72-cf8ded2ec22f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:16:02.401734 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1105/2221] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:16:02 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:16:02.411964 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d82ac-4227-4dd2-a5b5-18e55d9731a1 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:16:02.413763 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-3a1d82ac-4227-4dd2-a5b5-18e55d9731a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:16:02.483208 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d82ac-4227-4dd2-a5b5-18e55d9731a1 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:16:02.486851 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9cd7f-da2a-4e92-a11c-814faf617b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:16:02.487487 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9cd7f-da2a-4e92-a11c-814faf617b3e service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:02.487772 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9cd7f-da2a-4e92-a11c-814faf617b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:02.488046 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9cd7f-da2a-4e92-a11c-814faf617b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:02.552949 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9cd7f-da2a-4e92-a11c-814faf617b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:16:02.555136 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9cd7f-da2a-4e92-a11c-814faf617b3e service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:16:02.565670 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1117/2222] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:16:02 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:16:06.700487 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5751b1-8f8a-4922-9bb6-22f3aa49d824 None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:06.701045 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5751b1-8f8a-4922-9bb6-22f3aa49d824 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:06.701327 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5751b1-8f8a-4922-9bb6-22f3aa49d824 None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:06.703247 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1106/2223] 10.222.0.41 () {54 vars in 921 bytes} [Fri Oct 29 16:16:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:16:06.710518 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26701f-288e-491b-bbaa-67d6533e3695 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:06.710965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26701f-288e-491b-bbaa-67d6533e3695 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:06.711201 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26701f-288e-491b-bbaa-67d6533e3695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:06.728655 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-6f26701f-288e-491b-bbaa-67d6533e3695 None None] MFA Rules not processed for user `4f13d0e9f79a433c81759ecd819a6dfa`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:16:06.730551 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-6f26701f-288e-491b-bbaa-67d6533e3695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:16:06.797753 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1118/2224] 10.222.0.41 () {58 vars in 1018 bytes} [Fri Oct 29 16:16:06 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:16:06.811104 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5751b1-8f8a-4922-9bb6-22f3aa49d824 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:16:06.812962 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-5c5751b1-8f8a-4922-9bb6-22f3aa49d824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:16:06.869835 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5751b1-8f8a-4922-9bb6-22f3aa49d824 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:16:06.873389 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b18da3-2930-4927-9103-46d10028b84b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27a0c9ae2bf40caa92e9dbceff8d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:16:06.874063 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b18da3-2930-4927-9103-46d10028b84b service glance] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:06.874352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b18da3-2930-4927-9103-46d10028b84b service glance] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:06.874628 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b18da3-2930-4927-9103-46d10028b84b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:06.885167 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b18da3-2930-4927-9103-46d10028b84b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:16:06.886633 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b18da3-2930-4927-9103-46d10028b84b service glance] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:16:06.897078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1107/2225] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:16:06 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:16:06.962514 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e8107-f0ca-4dbb-9cfe-1461ce26f821 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:06.962890 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e8107-f0ca-4dbb-9cfe-1461ce26f821 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:06.963243 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e8107-f0ca-4dbb-9cfe-1461ce26f821 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:06.965159 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1119/2226] 10.222.0.41 () {54 vars in 921 bytes} [Fri Oct 29 16:16:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:16:06.970450 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fac61-984a-446d-a373-302f78a41469 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:06.970747 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fac61-984a-446d-a373-302f78a41469 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:06.971029 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5fac61-984a-446d-a373-302f78a41469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:07.000582 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-3a5fac61-984a-446d-a373-302f78a41469 None None] MFA Rules not processed for user `3bb8aa43328d4be08455441d0ffa4e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:16:07.002015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3a5fac61-984a-446d-a373-302f78a41469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:16:07.064741 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1108/2227] 10.222.0.41 () {58 vars in 1018 bytes} [Fri Oct 29 16:16:06 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:16:07.077699 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e8107-f0ca-4dbb-9cfe-1461ce26f821 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:16:07.079390 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ab8e8107-f0ca-4dbb-9cfe-1461ce26f821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:16:07.092387 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e8107-f0ca-4dbb-9cfe-1461ce26f821 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:16:07.096655 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b240620-d50b-4537-b9e0-aa8db3260088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:16:07.097372 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b240620-d50b-4537-b9e0-aa8db3260088 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:07.097655 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b240620-d50b-4537-b9e0-aa8db3260088 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:07.098001 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b240620-d50b-4537-b9e0-aa8db3260088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:07.105355 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b240620-d50b-4537-b9e0-aa8db3260088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:16:07.106819 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b240620-d50b-4537-b9e0-aa8db3260088 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:16:07.115265 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1120/2228] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:16:07 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:16:37.320731 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fac61-984a-446d-a373-302f78a41469 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:16:37.322777 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3a5fac61-984a-446d-a373-302f78a41469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:16:37.411605 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5fac61-984a-446d-a373-302f78a41469 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:16:37.416764 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936a2b8-cd97-45aa-8c13-842c060ca825 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:16:37.417390 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936a2b8-cd97-45aa-8c13-842c060ca825 service placement] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:16:37.417658 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936a2b8-cd97-45aa-8c13-842c060ca825 service placement] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:16:37.417961 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936a2b8-cd97-45aa-8c13-842c060ca825 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:16:37.419705 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7936a2b8-cd97-45aa-8c13-842c060ca825 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:16:37.430705 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936a2b8-cd97-45aa-8c13-842c060ca825 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:16:37.432257 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936a2b8-cd97-45aa-8c13-842c060ca825 service placement] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:16:37.443713 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1109/2229] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:16:37 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:18:24.749764 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b240620-d50b-4537-b9e0-aa8db3260088 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:18:24.758230 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b240620-d50b-4537-b9e0-aa8db3260088 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:18:24.761941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146a777-9080-43c2-9707-9d1188e801ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:18:24.762583 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146a777-9080-43c2-9707-9d1188e801ca service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:18:24.762864 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146a777-9080-43c2-9707-9d1188e801ca service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:18:24.763142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c146a777-9080-43c2-9707-9d1188e801ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:18:24.764914 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c146a777-9080-43c2-9707-9d1188e801ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:18:24.798808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146a777-9080-43c2-9707-9d1188e801ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:18:24.800264 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c146a777-9080-43c2-9707-9d1188e801ca service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:18:24.819840 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1121/2230] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:18:24 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:18:32.236000 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936a2b8-cd97-45aa-8c13-842c060ca825 service placement] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:18:32.237445 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7936a2b8-cd97-45aa-8c13-842c060ca825 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:18:32.268758 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936a2b8-cd97-45aa-8c13-842c060ca825 service placement] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:18:32.272382 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de935009-961a-4175-baee-df9a1a694ed9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:18:32.273016 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de935009-961a-4175-baee-df9a1a694ed9 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:18:32.273297 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de935009-961a-4175-baee-df9a1a694ed9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:18:32.274112 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de935009-961a-4175-baee-df9a1a694ed9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:18:32.275870 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-de935009-961a-4175-baee-df9a1a694ed9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:18:32.333287 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de935009-961a-4175-baee-df9a1a694ed9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:18:32.334759 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de935009-961a-4175-baee-df9a1a694ed9 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:18:32.344203 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1110/2231] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:18:32 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:18:36.862685 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146a777-9080-43c2-9707-9d1188e801ca service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:18:36.864129 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c146a777-9080-43c2-9707-9d1188e801ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:18:36.877411 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c146a777-9080-43c2-9707-9d1188e801ca service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:18:36.882893 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f515c-abd4-42e2-823d-0021079019f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:18:36.883526 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f515c-abd4-42e2-823d-0021079019f4 service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:18:36.883808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f515c-abd4-42e2-823d-0021079019f4 service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:18:36.884088 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f515c-abd4-42e2-823d-0021079019f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:18:36.886010 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-da7f515c-abd4-42e2-823d-0021079019f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:18:36.940804 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f515c-abd4-42e2-823d-0021079019f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:18:36.942414 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f515c-abd4-42e2-823d-0021079019f4 service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:18:36.951780 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1122/2232] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:18:36 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:18:46.778169 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de935009-961a-4175-baee-df9a1a694ed9 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:18:46.779541 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-de935009-961a-4175-baee-df9a1a694ed9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:18:46.795361 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de935009-961a-4175-baee-df9a1a694ed9 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:18:46.800828 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f90260-f3af-423f-b4ce-8a42401da14f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:18:46.801461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f90260-f3af-423f-b4ce-8a42401da14f service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:18:46.801744 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f90260-f3af-423f-b4ce-8a42401da14f service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:18:46.802055 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f90260-f3af-423f-b4ce-8a42401da14f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:18:46.803781 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-93f90260-f3af-423f-b4ce-8a42401da14f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:18:46.858787 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f90260-f3af-423f-b4ce-8a42401da14f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:18:46.860356 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f90260-f3af-423f-b4ce-8a42401da14f service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:18:46.869671 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1111/2233] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:18:46 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:19:34.751092 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f515c-abd4-42e2-823d-0021079019f4 service nova] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:19:34.752580 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-da7f515c-abd4-42e2-823d-0021079019f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:19:34.764726 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f515c-abd4-42e2-823d-0021079019f4 service nova] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:19:34.768798 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f335e98-5e9a-4f3e-94f3-b29d15a7b2d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:19:34.769621 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f335e98-5e9a-4f3e-94f3-b29d15a7b2d5 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:19:34.770113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f335e98-5e9a-4f3e-94f3-b29d15a7b2d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:19:34.770487 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f335e98-5e9a-4f3e-94f3-b29d15a7b2d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:19:34.772504 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-1f335e98-5e9a-4f3e-94f3-b29d15a7b2d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:19:34.783274 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f335e98-5e9a-4f3e-94f3-b29d15a7b2d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:19:34.784701 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f335e98-5e9a-4f3e-94f3-b29d15a7b2d5 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:19:34.792490 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1123/2234] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:19:34 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:19:56.381532 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f90260-f3af-423f-b4ce-8a42401da14f service nova] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:19:56.390580 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f90260-f3af-423f-b4ce-8a42401da14f service nova] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:19:56.394136 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946211a-566b-459e-abeb-7adefd366ed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:19:56.394761 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946211a-566b-459e-abeb-7adefd366ed4 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:19:56.395042 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946211a-566b-459e-abeb-7adefd366ed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:19:56.395315 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946211a-566b-459e-abeb-7adefd366ed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:19:56.397063 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e946211a-566b-459e-abeb-7adefd366ed4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:19:56.453027 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946211a-566b-459e-abeb-7adefd366ed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:19:56.454479 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946211a-566b-459e-abeb-7adefd366ed4 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:19:56.463335 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1112/2235] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:19:56 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:21:02.465460 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f335e98-5e9a-4f3e-94f3-b29d15a7b2d5 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:21:02.474514 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f335e98-5e9a-4f3e-94f3-b29d15a7b2d5 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:21:02.478050 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25235c67-02f5-4a90-9c15-46ba7f32f0f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:21:02.479187 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25235c67-02f5-4a90-9c15-46ba7f32f0f4 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:21:02.479468 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25235c67-02f5-4a90-9c15-46ba7f32f0f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:21:02.479740 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25235c67-02f5-4a90-9c15-46ba7f32f0f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:21:02.487777 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25235c67-02f5-4a90-9c15-46ba7f32f0f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:21:02.489185 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25235c67-02f5-4a90-9c15-46ba7f32f0f4 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:21:02.498312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1124/2236] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:21:02 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:21:41.027617 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8d194-4918-48f6-a90f-b89edfd1731c None None] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:21:41.028104 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8d194-4918-48f6-a90f-b89edfd1731c None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:21:41.028210 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8d194-4918-48f6-a90f-b89edfd1731c None None] PATH_INFO: `/` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:21:41.029911 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1113/2237] 10.222.0.41 () {54 vars in 960 bytes} [Fri Oct 29 16:21:41 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:21:41.035201 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d16a75-53d5-4aea-8673-dc089630fbd7 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:21:41.035626 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d16a75-53d5-4aea-8673-dc089630fbd7 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:21:41.035759 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d16a75-53d5-4aea-8673-dc089630fbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:21:41.089385 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-29d16a75-53d5-4aea-8673-dc089630fbd7 None None] MFA Rules not processed for user `34c34efa8fd24230aa45e0f67209260e`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:21:41.090607 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-29d16a75-53d5-4aea-8673-dc089630fbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:21:41.099164 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1125/2238] 10.222.0.41 () {58 vars in 1057 bytes} [Fri Oct 29 16:21:41 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:21:41.107183 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8d194-4918-48f6-a90f-b89edfd1731c None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:21:41.120804 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8d194-4918-48f6-a90f-b89edfd1731c None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:21:41.125825 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224c858-f302-496f-88c4-37745cd4b56e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:21:41.126481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224c858-f302-496f-88c4-37745cd4b56e service placement] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:21:41.126765 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224c858-f302-496f-88c4-37745cd4b56e service placement] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:21:41.127043 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1224c858-f302-496f-88c4-37745cd4b56e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:21:41.135394 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224c858-f302-496f-88c4-37745cd4b56e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:21:41.137510 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1224c858-f302-496f-88c4-37745cd4b56e service placement] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:21:41.147276 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1114/2239] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:21:41 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:21:48.727856 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d16a75-53d5-4aea-8673-dc089630fbd7 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:21:48.737318 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d16a75-53d5-4aea-8673-dc089630fbd7 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:21:48.740880 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818bf1f5-a441-4efe-8083-82f8263ae0d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:21:48.741501 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bf1f5-a441-4efe-8083-82f8263ae0d6 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:21:48.741780 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bf1f5-a441-4efe-8083-82f8263ae0d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:21:48.742079 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818bf1f5-a441-4efe-8083-82f8263ae0d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:21:48.743785 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-818bf1f5-a441-4efe-8083-82f8263ae0d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:21:48.757031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bf1f5-a441-4efe-8083-82f8263ae0d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:21:48.758497 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818bf1f5-a441-4efe-8083-82f8263ae0d6 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:21:48.769233 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1126/2240] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:21:48 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:22:02.346437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224c858-f302-496f-88c4-37745cd4b56e service placement] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:22:02.405884 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1224c858-f302-496f-88c4-37745cd4b56e service placement] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:22:02.410356 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150286f5-aece-4d5e-914f-6f2c936c0756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:22:02.411191 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150286f5-aece-4d5e-914f-6f2c936c0756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:02.411469 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150286f5-aece-4d5e-914f-6f2c936c0756 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:02.411741 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150286f5-aece-4d5e-914f-6f2c936c0756 admin admin] PATH_INFO: `/v3/users/2395dd2768604e33a84adbc49f207a6f` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:02.412952 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150286f5-aece-4d5e-914f-6f2c936c0756 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2395dd2768604e33a84adbc49f207a6f)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:22:02.414872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150286f5-aece-4d5e-914f-6f2c936c0756 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:22:02.458698 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-150286f5-aece-4d5e-914f-6f2c936c0756 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2395dd2768604e33a84adbc49f207a6f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:02.465661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-150286f5-aece-4d5e-914f-6f2c936c0756 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2395dd2768604e33a84adbc49f207a6f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:02.472245 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-150286f5-aece-4d5e-914f-6f2c936c0756 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2395dd2768604e33a84adbc49f207a6f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:02.472886 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-150286f5-aece-4d5e-914f-6f2c936c0756 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2395dd2768604e33a84adbc49f207a6f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:02.484565 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-150286f5-aece-4d5e-914f-6f2c936c0756 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2395dd2768604e33a84adbc49f207a6f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:02.490243 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1115/2241] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:22:02 2021] DELETE /identity/v3/users/2395dd2768604e33a84adbc49f207a6f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:22:02.494791 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7578c6-15a8-46ef-895a-43bf09a2e183 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:02.495906 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7578c6-15a8-46ef-895a-43bf09a2e183 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:02.495906 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7578c6-15a8-46ef-895a-43bf09a2e183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:02.512709 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-6d7578c6-15a8-46ef-895a-43bf09a2e183 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:22:02.513953 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-6d7578c6-15a8-46ef-895a-43bf09a2e183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:02.569898 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1127/2242] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:22:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:22:02.579789 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150286f5-aece-4d5e-914f-6f2c936c0756 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:22:02.581402 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-150286f5-aece-4d5e-914f-6f2c936c0756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:02.638694 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150286f5-aece-4d5e-914f-6f2c936c0756 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:22:02.642435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d234cc-5dcd-40cc-8aee-05397ba66ccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:22:02.643074 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d234cc-5dcd-40cc-8aee-05397ba66ccf service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:02.643359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d234cc-5dcd-40cc-8aee-05397ba66ccf service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:02.643636 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d234cc-5dcd-40cc-8aee-05397ba66ccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:02.653495 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d234cc-5dcd-40cc-8aee-05397ba66ccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:22:02.654956 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d234cc-5dcd-40cc-8aee-05397ba66ccf service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:22:02.664282 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1116/2243] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:22:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:22:02.916042 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7578c6-15a8-46ef-895a-43bf09a2e183 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:22:02.917509 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-6d7578c6-15a8-46ef-895a-43bf09a2e183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:02.929341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7578c6-15a8-46ef-895a-43bf09a2e183 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:22:02.934286 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b240070-30f0-4e6f-986f-5a055500f02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:22:02.935289 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b240070-30f0-4e6f-986f-5a055500f02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:02.935643 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b240070-30f0-4e6f-986f-5a055500f02f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:02.935982 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b240070-30f0-4e6f-986f-5a055500f02f admin admin] PATH_INFO: `/v3/projects/9be024d9c73c42bf9dcb9727c42100d4` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:02.937245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b240070-30f0-4e6f-986f-5a055500f02f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9be024d9c73c42bf9dcb9727c42100d4)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:22:02.939249 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b240070-30f0-4e6f-986f-5a055500f02f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:22:02.988264 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-0b240070-30f0-4e6f-986f-5a055500f02f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be024d9c73c42bf9dcb9727c42100d4', 'request_id': 'req-0b240070-30f0-4e6f-986f-5a055500f02f'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:02.993593 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-0b240070-30f0-4e6f-986f-5a055500f02f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be024d9c73c42bf9dcb9727c42100d4', 'request_id': 'req-0b240070-30f0-4e6f-986f-5a055500f02f'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:03.000786 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-0b240070-30f0-4e6f-986f-5a055500f02f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be024d9c73c42bf9dcb9727c42100d4', 'request_id': 'req-0b240070-30f0-4e6f-986f-5a055500f02f'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:03.012428 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-0b240070-30f0-4e6f-986f-5a055500f02f admin admin] The token cache is being invalidate because project 9be024d9c73c42bf9dcb9727c42100d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:22:03.012716 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-0b240070-30f0-4e6f-986f-5a055500f02f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:03.013371 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-0b240070-30f0-4e6f-986f-5a055500f02f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:03.014941 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1128/2244] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:22:02 2021] DELETE /identity/v3/projects/9be024d9c73c42bf9dcb9727c42100d4 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:22:03.018892 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d234cc-5dcd-40cc-8aee-05397ba66ccf service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:22:03.029310 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d234cc-5dcd-40cc-8aee-05397ba66ccf service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:22:03.083984 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c0fac-f06e-46e1-a7ff-34583881a11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:22:03.084828 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c0fac-f06e-46e1-a7ff-34583881a11f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:03.085106 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c0fac-f06e-46e1-a7ff-34583881a11f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:03.085377 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c0fac-f06e-46e1-a7ff-34583881a11f admin admin] PATH_INFO: `/v3/users/f32ed31e8b0f4fa0b4bc1a98aba54fe5` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:03.086572 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c0fac-f06e-46e1-a7ff-34583881a11f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f32ed31e8b0f4fa0b4bc1a98aba54fe5)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:22:03.088509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c0fac-f06e-46e1-a7ff-34583881a11f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:22:03.130971 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c05c0fac-f06e-46e1-a7ff-34583881a11f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f32ed31e8b0f4fa0b4bc1a98aba54fe5'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:03.138246 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c05c0fac-f06e-46e1-a7ff-34583881a11f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f32ed31e8b0f4fa0b4bc1a98aba54fe5'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:03.144726 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c05c0fac-f06e-46e1-a7ff-34583881a11f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f32ed31e8b0f4fa0b4bc1a98aba54fe5'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:03.145368 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c05c0fac-f06e-46e1-a7ff-34583881a11f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f32ed31e8b0f4fa0b4bc1a98aba54fe5'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:03.156979 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c05c0fac-f06e-46e1-a7ff-34583881a11f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f32ed31e8b0f4fa0b4bc1a98aba54fe5'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:03.163000 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1117/2245] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:22:03 2021] DELETE /identity/v3/users/f32ed31e8b0f4fa0b4bc1a98aba54fe5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:22:03.423997 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b240070-30f0-4e6f-986f-5a055500f02f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:22:03.425500 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-0b240070-30f0-4e6f-986f-5a055500f02f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:03.441806 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b240070-30f0-4e6f-986f-5a055500f02f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:22:03.497401 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080daf4-17df-4604-a3be-17d287de6570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:22:03.498361 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080daf4-17df-4604-a3be-17d287de6570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:03.498646 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080daf4-17df-4604-a3be-17d287de6570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:03.498924 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080daf4-17df-4604-a3be-17d287de6570 admin admin] PATH_INFO: `/v3/projects/3df2ea529f8e4ce3b8a7e9f921e83cf7` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:03.500117 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080daf4-17df-4604-a3be-17d287de6570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3df2ea529f8e4ce3b8a7e9f921e83cf7)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:22:03.502065 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080daf4-17df-4604-a3be-17d287de6570 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:22:03.545295 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8080daf4-17df-4604-a3be-17d287de6570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3df2ea529f8e4ce3b8a7e9f921e83cf7', 'request_id': 'req-8080daf4-17df-4604-a3be-17d287de6570'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:03.550566 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8080daf4-17df-4604-a3be-17d287de6570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3df2ea529f8e4ce3b8a7e9f921e83cf7', 'request_id': 'req-8080daf4-17df-4604-a3be-17d287de6570'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:03.557549 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8080daf4-17df-4604-a3be-17d287de6570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3df2ea529f8e4ce3b8a7e9f921e83cf7', 'request_id': 'req-8080daf4-17df-4604-a3be-17d287de6570'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:03.568637 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8080daf4-17df-4604-a3be-17d287de6570 admin admin] The token cache is being invalidate because project 3df2ea529f8e4ce3b8a7e9f921e83cf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:22:03.568954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8080daf4-17df-4604-a3be-17d287de6570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:03.569588 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8080daf4-17df-4604-a3be-17d287de6570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:22:03.571140 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1129/2246] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:22:03 2021] DELETE /identity/v3/projects/3df2ea529f8e4ce3b8a7e9f921e83cf7 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:22:03.578775 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7aba4-4f81-45d4-ab65-4783d021747f None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:03.579236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7aba4-4f81-45d4-ab65-4783d021747f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:03.579365 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7aba4-4f81-45d4-ab65-4783d021747f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:03.597044 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-a1d7aba4-4f81-45d4-ab65-4783d021747f None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:22:03.598642 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a1d7aba4-4f81-45d4-ab65-4783d021747f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:03.656540 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1118/2247] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:22:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:22:03.664261 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471252c2-3669-4258-8252-bc109d5d98d3 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:03.664548 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471252c2-3669-4258-8252-bc109d5d98d3 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:03.664845 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471252c2-3669-4258-8252-bc109d5d98d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:03.683805 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-471252c2-3669-4258-8252-bc109d5d98d3 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:22:03.684908 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-471252c2-3669-4258-8252-bc109d5d98d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:03.692710 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1130/2248] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:22:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:22:03.697319 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7aba4-4f81-45d4-ab65-4783d021747f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:22:03.707810 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7aba4-4f81-45d4-ab65-4783d021747f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:22:03.712467 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4358a-7147-47aa-93d9-1d4ca5f2ca13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:22:03.713149 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4358a-7147-47aa-93d9-1d4ca5f2ca13 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:03.713431 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4358a-7147-47aa-93d9-1d4ca5f2ca13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:03.713704 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4358a-7147-47aa-93d9-1d4ca5f2ca13 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:03.714502 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4358a-7147-47aa-93d9-1d4ca5f2ca13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:22:03.714808 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4358a-7147-47aa-93d9-1d4ca5f2ca13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:22:03.716604 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4358a-7147-47aa-93d9-1d4ca5f2ca13 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:22:03.728860 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1119/2249] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:22:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:22:03.733614 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471252c2-3669-4258-8252-bc109d5d98d3 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:22:03.742638 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471252c2-3669-4258-8252-bc109d5d98d3 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:22:03.747926 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97871194-b704-426a-a08d-6dde0af6e6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:22:03.748589 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97871194-b704-426a-a08d-6dde0af6e6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:03.748866 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97871194-b704-426a-a08d-6dde0af6e6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:03.749135 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97871194-b704-426a-a08d-6dde0af6e6b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:03.749834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97871194-b704-426a-a08d-6dde0af6e6b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:22:03.751735 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97871194-b704-426a-a08d-6dde0af6e6b5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:22:03.786304 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1131/2250] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:22:03 2021] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:22:03.790935 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4358a-7147-47aa-93d9-1d4ca5f2ca13 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:22:03.801167 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4358a-7147-47aa-93d9-1d4ca5f2ca13 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:22:03.854376 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caaa09-5d6c-4270-a23e-b6555bc32a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:22:03.855515 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caaa09-5d6c-4270-a23e-b6555bc32a81 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:03.855800 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caaa09-5d6c-4270-a23e-b6555bc32a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:03.856069 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94caaa09-5d6c-4270-a23e-b6555bc32a81 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:03.856773 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caaa09-5d6c-4270-a23e-b6555bc32a81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:22:03.858727 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94caaa09-5d6c-4270-a23e-b6555bc32a81 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:22:03.879321 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1120/2251] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:22:03 2021] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:22:03.884083 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97871194-b704-426a-a08d-6dde0af6e6b5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:22:03.902278 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97871194-b704-426a-a08d-6dde0af6e6b5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:22:03.906988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2c288-d4df-434b-a840-a210e68f3045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:22:03.907642 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2c288-d4df-434b-a840-a210e68f3045 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:03.907922 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2c288-d4df-434b-a840-a210e68f3045 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:03.908195 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd2c288-d4df-434b-a840-a210e68f3045 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:03.908923 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2c288-d4df-434b-a840-a210e68f3045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:22:03.910560 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd2c288-d4df-434b-a840-a210e68f3045 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:22:03.920774 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1132/2252] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:22:03 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:22:03.924717 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caaa09-5d6c-4270-a23e-b6555bc32a81 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:22:03.935067 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94caaa09-5d6c-4270-a23e-b6555bc32a81 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:22:03.939569 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab3031-4127-48bc-8bba-781221e68a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:22:03.940211 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab3031-4127-48bc-8bba-781221e68a61 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:03.940496 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab3031-4127-48bc-8bba-781221e68a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:03.940771 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab3031-4127-48bc-8bba-781221e68a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:03.941508 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab3031-4127-48bc-8bba-781221e68a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:22:03.943109 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab3031-4127-48bc-8bba-781221e68a61 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:22:03.952605 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1121/2253] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:22:03 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:22:03.956746 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2c288-d4df-434b-a840-a210e68f3045 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:22:03.966371 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd2c288-d4df-434b-a840-a210e68f3045 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:22:03.970896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c4ff7-4181-4f52-8ec6-29ceb6dc3ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:22:03.971752 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c4ff7-4181-4f52-8ec6-29ceb6dc3ccd admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:03.972030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c4ff7-4181-4f52-8ec6-29ceb6dc3ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:03.972296 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c4ff7-4181-4f52-8ec6-29ceb6dc3ccd admin admin] PATH_INFO: `/v3/projects/599eed21a57b489cba0e8974cea26a57/users/afe026a09771480ba9dec97bffc248cb/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:03.986664 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c4ff7-4181-4f52-8ec6-29ceb6dc3ccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=599eed21a57b489cba0e8974cea26a57, user_id=afe026a09771480ba9dec97bffc248cb, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:22:03.989307 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c4ff7-4181-4f52-8ec6-29ceb6dc3ccd admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:22:04.002253 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1133/2254] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:22:03 2021] PUT /identity/v3/projects/599eed21a57b489cba0e8974cea26a57/users/afe026a09771480ba9dec97bffc248cb/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:22:04.012147 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3c335-ae3e-4241-b393-8b79268a69b0 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:04.012440 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3c335-ae3e-4241-b393-8b79268a69b0 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:04.012723 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d3c335-ae3e-4241-b393-8b79268a69b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:04.038435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-45d3c335-ae3e-4241-b393-8b79268a69b0 None None] MFA Rules not processed for user `afe026a09771480ba9dec97bffc248cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:22:04.039632 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-45d3c335-ae3e-4241-b393-8b79268a69b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:04.104355 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1122/2255] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:22:04 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:22:04.116588 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c4ff7-4181-4f52-8ec6-29ceb6dc3ccd admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:22:04.118370 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-2e1c4ff7-4181-4f52-8ec6-29ceb6dc3ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:04.180954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c4ff7-4181-4f52-8ec6-29ceb6dc3ccd admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:22:04.184923 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81b581-d759-4b45-b7b0-14d215c2fa07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:22:04.185751 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81b581-d759-4b45-b7b0-14d215c2fa07 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:04.185989 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81b581-d759-4b45-b7b0-14d215c2fa07 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:04.186296 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81b581-d759-4b45-b7b0-14d215c2fa07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:04.194784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81b581-d759-4b45-b7b0-14d215c2fa07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:22:04.196313 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81b581-d759-4b45-b7b0-14d215c2fa07 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:22:04.205236 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1134/2256] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:22:04 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:22:07.020870 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207faec-9d4d-4090-b74c-b580f2ed0019 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:07.021306 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207faec-9d4d-4090-b74c-b580f2ed0019 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:07.021421 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1207faec-9d4d-4090-b74c-b580f2ed0019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:07.067261 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-1207faec-9d4d-4090-b74c-b580f2ed0019 None None] MFA Rules not processed for user `10b4daa146fa4b638d90ea1e9a4878eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:22:07.068458 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1207faec-9d4d-4090-b74c-b580f2ed0019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:07.130620 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1123/2257] 10.222.0.41 () {58 vars in 967 bytes} [Fri Oct 29 16:22:07 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:22:07.176175 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81b581-d759-4b45-b7b0-14d215c2fa07 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:22:07.177618 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-cf81b581-d759-4b45-b7b0-14d215c2fa07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:07.263230 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81b581-d759-4b45-b7b0-14d215c2fa07 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:22:07.268139 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c06305-db31-49d8-b551-883e66e597ad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f518ae309c4b4f7eacca882b58e58bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:22:07.268770 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c06305-db31-49d8-b551-883e66e597ad service swift] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:07.269047 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c06305-db31-49d8-b551-883e66e597ad service swift] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:07.269317 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c06305-db31-49d8-b551-883e66e597ad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:07.277045 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c06305-db31-49d8-b551-883e66e597ad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:22:07.278830 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c06305-db31-49d8-b551-883e66e597ad service swift] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:22:07.286436 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1135/2258] 10.222.0.41 () {60 vars in 1384 bytes} [Fri Oct 29 16:22:07 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 16:22:08.540062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207faec-9d4d-4090-b74c-b580f2ed0019 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:22:08.541462 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1207faec-9d4d-4090-b74c-b580f2ed0019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:08.577481 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3832568-143d-454f-b86e-85f488221a96 None None] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:08.578104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3832568-143d-454f-b86e-85f488221a96 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:08.578342 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3832568-143d-454f-b86e-85f488221a96 None None] PATH_INFO: `/` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:08.580312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1136/2259] 10.222.0.41 () {54 vars in 912 bytes} [Fri Oct 29 16:22:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 29 16:22:08.586749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e41c08-bad4-48f9-8205-15de2942a61b None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:08.587224 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e41c08-bad4-48f9-8205-15de2942a61b None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:08.587503 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e41c08-bad4-48f9-8205-15de2942a61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:08.606224 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-09e41c08-bad4-48f9-8205-15de2942a61b None None] MFA Rules not processed for user `34c34efa8fd24230aa45e0f67209260e`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:22:08.607549 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-09e41c08-bad4-48f9-8205-15de2942a61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:08.620684 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1207faec-9d4d-4090-b74c-b580f2ed0019 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:22:08.627616 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c6725-5612-46ab-8e0d-de20f96861d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:22:08.628670 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c6725-5612-46ab-8e0d-de20f96861d9 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:08.628960 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c6725-5612-46ab-8e0d-de20f96861d9 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:08.629239 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c6725-5612-46ab-8e0d-de20f96861d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:08.631397 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-553c6725-5612-46ab-8e0d-de20f96861d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:08.645724 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c6725-5612-46ab-8e0d-de20f96861d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:22:08.647357 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c6725-5612-46ab-8e0d-de20f96861d9 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:22:08.658841 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1124/2260] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:22:08 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:22:08.677961 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1137/2261] 10.222.0.41 () {58 vars in 1009 bytes} [Fri Oct 29 16:22:08 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:22:08.708229 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c6725-5612-46ab-8e0d-de20f96861d9 service nova] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:22:08.709914 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-553c6725-5612-46ab-8e0d-de20f96861d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:08.723113 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c6725-5612-46ab-8e0d-de20f96861d9 service nova] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:22:08.733360 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdf29e-1602-4a04-bfc0-c7c999ca609c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:22:08.734068 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdf29e-1602-4a04-bfc0-c7c999ca609c service placement] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:08.734354 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdf29e-1602-4a04-bfc0-c7c999ca609c service placement] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:08.734629 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdf29e-1602-4a04-bfc0-c7c999ca609c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:08.743984 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdf29e-1602-4a04-bfc0-c7c999ca609c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:22:08.746090 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdf29e-1602-4a04-bfc0-c7c999ca609c service placement] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:22:08.756185 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1125/2262] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:22:08 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:22:11.268764 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47731b9a-59b8-46d2-b53b-9ddfa82ff7a6 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:11.269310 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47731b9a-59b8-46d2-b53b-9ddfa82ff7a6 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:11.269417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47731b9a-59b8-46d2-b53b-9ddfa82ff7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:11.286448 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-47731b9a-59b8-46d2-b53b-9ddfa82ff7a6 None None] MFA Rules not processed for user `16c47acc08ad42ec9f14cbad92726027`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:22:11.287639 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-47731b9a-59b8-46d2-b53b-9ddfa82ff7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:11.339557 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1138/2263] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:22:11 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:22:11.628370 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdf29e-1602-4a04-bfc0-c7c999ca609c service placement] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:22:11.629745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-21bdf29e-1602-4a04-bfc0-c7c999ca609c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:11.683949 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdf29e-1602-4a04-bfc0-c7c999ca609c service placement] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:22:11.687533 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe69cb8-3f9d-4311-9436-d6e13e5c762c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:22:11.688169 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe69cb8-3f9d-4311-9436-d6e13e5c762c service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:11.688451 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe69cb8-3f9d-4311-9436-d6e13e5c762c service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:11.688730 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe69cb8-3f9d-4311-9436-d6e13e5c762c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:11.690475 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8fe69cb8-3f9d-4311-9436-d6e13e5c762c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:11.699789 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe69cb8-3f9d-4311-9436-d6e13e5c762c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:22:11.701203 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe69cb8-3f9d-4311-9436-d6e13e5c762c service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:22:11.709220 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1126/2264] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:22:11 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:22:12.011388 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47731b9a-59b8-46d2-b53b-9ddfa82ff7a6 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:22:12.012867 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-47731b9a-59b8-46d2-b53b-9ddfa82ff7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:12.029131 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47731b9a-59b8-46d2-b53b-9ddfa82ff7a6 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:22:12.040073 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1696d02-403b-4298-93e3-61b52c57505c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:22:12.040749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1696d02-403b-4298-93e3-61b52c57505c service placement] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:12.041031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1696d02-403b-4298-93e3-61b52c57505c service placement] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:12.041306 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1696d02-403b-4298-93e3-61b52c57505c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:12.043190 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c1696d02-403b-4298-93e3-61b52c57505c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:12.055113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1696d02-403b-4298-93e3-61b52c57505c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:22:12.056729 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1696d02-403b-4298-93e3-61b52c57505c service placement] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:22:12.067809 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1139/2265] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:22:12 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:22:19.813292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe69cb8-3f9d-4311-9436-d6e13e5c762c service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:22:19.814771 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8fe69cb8-3f9d-4311-9436-d6e13e5c762c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:19.832258 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe69cb8-3f9d-4311-9436-d6e13e5c762c service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:22:19.837729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fec5c-353e-40cf-b6c3-fd0e2b421a36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:22:19.838396 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fec5c-353e-40cf-b6c3-fd0e2b421a36 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:19.838680 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fec5c-353e-40cf-b6c3-fd0e2b421a36 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:19.838956 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fec5c-353e-40cf-b6c3-fd0e2b421a36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:19.841227 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-b51fec5c-353e-40cf-b6c3-fd0e2b421a36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:19.853491 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fec5c-353e-40cf-b6c3-fd0e2b421a36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:22:19.855759 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fec5c-353e-40cf-b6c3-fd0e2b421a36 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:22:19.866595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1127/2266] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:22:19 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:22:22.744355 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1696d02-403b-4298-93e3-61b52c57505c service placement] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:22:22.757388 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1696d02-403b-4298-93e3-61b52c57505c service placement] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:22:22.767913 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcdedd-ef49-468d-a769-44eb8d977d96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:22:22.768673 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcdedd-ef49-468d-a769-44eb8d977d96 service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:22:22.769024 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcdedd-ef49-468d-a769-44eb8d977d96 service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:22:22.769395 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dcdedd-ef49-468d-a769-44eb8d977d96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:22:22.771508 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-80dcdedd-ef49-468d-a769-44eb8d977d96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:22:22.787350 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcdedd-ef49-468d-a769-44eb8d977d96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:22:22.789024 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dcdedd-ef49-468d-a769-44eb8d977d96 service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:22:22.800570 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1140/2267] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:22:22 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:23:31.765192 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fec5c-353e-40cf-b6c3-fd0e2b421a36 service nova] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:23:31.776225 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fec5c-353e-40cf-b6c3-fd0e2b421a36 service nova] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:23:31.782338 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb310ba-1f1e-4e64-b173-7dd150b3a295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:23:31.783021 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb310ba-1f1e-4e64-b173-7dd150b3a295 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:23:31.783308 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb310ba-1f1e-4e64-b173-7dd150b3a295 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:23:31.783583 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb310ba-1f1e-4e64-b173-7dd150b3a295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:23:31.785372 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1cb310ba-1f1e-4e64-b173-7dd150b3a295 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:23:31.862133 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb310ba-1f1e-4e64-b173-7dd150b3a295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:23:31.863702 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb310ba-1f1e-4e64-b173-7dd150b3a295 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:23:31.881194 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1128/2268] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:23:31 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:23:36.229692 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcdedd-ef49-468d-a769-44eb8d977d96 service nova] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:23:36.231143 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-80dcdedd-ef49-468d-a769-44eb8d977d96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:23:36.242150 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dcdedd-ef49-468d-a769-44eb8d977d96 service nova] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:23:36.245684 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff6e0e-9b99-4497-a920-6bea3cd15505 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:23:36.246869 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff6e0e-9b99-4497-a920-6bea3cd15505 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:23:36.247153 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff6e0e-9b99-4497-a920-6bea3cd15505 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:23:36.247429 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff6e0e-9b99-4497-a920-6bea3cd15505 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:23:36.249121 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-33ff6e0e-9b99-4497-a920-6bea3cd15505 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:23:36.325297 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff6e0e-9b99-4497-a920-6bea3cd15505 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:23:36.326766 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ff6e0e-9b99-4497-a920-6bea3cd15505 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:23:36.335830 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1141/2269] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:23:36 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:23:47.342655 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb310ba-1f1e-4e64-b173-7dd150b3a295 service nova] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:23:47.351540 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb310ba-1f1e-4e64-b173-7dd150b3a295 service nova] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:23:47.355129 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd86b58-b2f1-47cb-af07-7b9ee118f916 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:23:47.355752 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd86b58-b2f1-47cb-af07-7b9ee118f916 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:23:47.356030 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd86b58-b2f1-47cb-af07-7b9ee118f916 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:23:47.356300 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd86b58-b2f1-47cb-af07-7b9ee118f916 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:23:47.358028 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-2bd86b58-b2f1-47cb-af07-7b9ee118f916 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:23:47.389396 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd86b58-b2f1-47cb-af07-7b9ee118f916 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:23:47.390837 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd86b58-b2f1-47cb-af07-7b9ee118f916 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:23:47.408777 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1129/2270] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:23:47 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:24:36.729659 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff6e0e-9b99-4497-a920-6bea3cd15505 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:24:36.731165 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-33ff6e0e-9b99-4497-a920-6bea3cd15505 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:24:36.743114 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff6e0e-9b99-4497-a920-6bea3cd15505 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:24:36.746716 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768d79c-e8dc-415e-ad6a-ee517a7c407c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:24:36.747352 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768d79c-e8dc-415e-ad6a-ee517a7c407c service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:24:36.747632 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768d79c-e8dc-415e-ad6a-ee517a7c407c service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:24:36.747914 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768d79c-e8dc-415e-ad6a-ee517a7c407c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:24:36.749582 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-6768d79c-e8dc-415e-ad6a-ee517a7c407c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:24:36.758602 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768d79c-e8dc-415e-ad6a-ee517a7c407c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:24:36.760020 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768d79c-e8dc-415e-ad6a-ee517a7c407c service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:24:36.768381 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1142/2271] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:24:36 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:24:57.043884 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd86b58-b2f1-47cb-af07-7b9ee118f916 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:24:57.052185 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd86b58-b2f1-47cb-af07-7b9ee118f916 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:24:57.055829 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b9fd6-dee3-49d5-8792-66298e04ea23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:24:57.056452 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b9fd6-dee3-49d5-8792-66298e04ea23 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:24:57.056736 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b9fd6-dee3-49d5-8792-66298e04ea23 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:24:57.057012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b9fd6-dee3-49d5-8792-66298e04ea23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:24:57.058795 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-ba9b9fd6-dee3-49d5-8792-66298e04ea23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:24:57.135407 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b9fd6-dee3-49d5-8792-66298e04ea23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:24:57.136840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b9fd6-dee3-49d5-8792-66298e04ea23 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:24:57.155077 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1130/2272] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:24:57 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:26:47.039731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768d79c-e8dc-415e-ad6a-ee517a7c407c service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:26:47.099141 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768d79c-e8dc-415e-ad6a-ee517a7c407c service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:26:47.104412 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982d651-731d-49cf-af77-320b76a36b47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:26:47.105061 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982d651-731d-49cf-af77-320b76a36b47 service placement] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:26:47.105346 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982d651-731d-49cf-af77-320b76a36b47 service placement] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:26:47.105623 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982d651-731d-49cf-af77-320b76a36b47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:26:47.107422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-6982d651-731d-49cf-af77-320b76a36b47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:26:47.138955 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982d651-731d-49cf-af77-320b76a36b47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:26:47.140531 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982d651-731d-49cf-af77-320b76a36b47 service placement] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:26:47.150662 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1143/2273] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:26:47 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:27:03.257657 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b9fd6-dee3-49d5-8792-66298e04ea23 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:27:03.277046 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b9fd6-dee3-49d5-8792-66298e04ea23 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:27:03.280930 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f12e72-cbe7-4b21-a75a-e76d997cb2c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:27:03.281572 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f12e72-cbe7-4b21-a75a-e76d997cb2c5 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:27:03.281858 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f12e72-cbe7-4b21-a75a-e76d997cb2c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:27:03.282161 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f12e72-cbe7-4b21-a75a-e76d997cb2c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:27:03.290652 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f12e72-cbe7-4b21-a75a-e76d997cb2c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:27:03.292332 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f12e72-cbe7-4b21-a75a-e76d997cb2c5 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:27:03.300966 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1131/2274] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:27:03 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:27:48.567564 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982d651-731d-49cf-af77-320b76a36b47 service placement] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:27:48.586387 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982d651-731d-49cf-af77-320b76a36b47 service placement] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:27:48.589960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77508ede-a033-4173-8cfd-896e602f9a0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:27:48.590594 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77508ede-a033-4173-8cfd-896e602f9a0d service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:27:48.590874 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77508ede-a033-4173-8cfd-896e602f9a0d service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:27:48.591148 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77508ede-a033-4173-8cfd-896e602f9a0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:27:48.594342 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-77508ede-a033-4173-8cfd-896e602f9a0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:27:48.608222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77508ede-a033-4173-8cfd-896e602f9a0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:27:48.609645 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77508ede-a033-4173-8cfd-896e602f9a0d service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:27:48.620959 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1144/2275] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:27:48 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:28:31.977259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f12e72-cbe7-4b21-a75a-e76d997cb2c5 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:28:32.005594 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f12e72-cbe7-4b21-a75a-e76d997cb2c5 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:28:32.011807 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6412b0a-dc34-4208-b241-2dfea6d5464e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:28:32.012433 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6412b0a-dc34-4208-b241-2dfea6d5464e service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:28:32.012718 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6412b0a-dc34-4208-b241-2dfea6d5464e service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:28:32.012996 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6412b0a-dc34-4208-b241-2dfea6d5464e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:28:32.020788 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6412b0a-dc34-4208-b241-2dfea6d5464e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:28:32.022395 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6412b0a-dc34-4208-b241-2dfea6d5464e service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:28:32.032046 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1132/2276] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:28:31 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:28:36.656248 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77508ede-a033-4173-8cfd-896e602f9a0d service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:28:36.674724 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77508ede-a033-4173-8cfd-896e602f9a0d service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:28:36.678309 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1b167-da0b-47ed-b2f6-ee949e541647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:28:36.679522 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1b167-da0b-47ed-b2f6-ee949e541647 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:28:36.679805 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1b167-da0b-47ed-b2f6-ee949e541647 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:28:36.680082 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce1b167-da0b-47ed-b2f6-ee949e541647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:28:36.688357 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1b167-da0b-47ed-b2f6-ee949e541647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:28:36.689793 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce1b167-da0b-47ed-b2f6-ee949e541647 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:28:36.707802 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1145/2277] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:28:36 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:28:47.248516 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6412b0a-dc34-4208-b241-2dfea6d5464e service nova] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:28:47.257459 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6412b0a-dc34-4208-b241-2dfea6d5464e service nova] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:28:47.261554 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770859e9-e88f-431c-bf65-0cd7a87c3044 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:28:47.262221 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770859e9-e88f-431c-bf65-0cd7a87c3044 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:28:47.262504 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770859e9-e88f-431c-bf65-0cd7a87c3044 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:28:47.262779 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770859e9-e88f-431c-bf65-0cd7a87c3044 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:28:47.272475 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770859e9-e88f-431c-bf65-0cd7a87c3044 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:28:47.273885 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770859e9-e88f-431c-bf65-0cd7a87c3044 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:28:47.282707 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1133/2278] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:28:47 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:29:01.101064 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1b167-da0b-47ed-b2f6-ee949e541647 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:29:01.110090 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce1b167-da0b-47ed-b2f6-ee949e541647 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:29:01.113653 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179e8b8-2658-4a33-b982-bf2a758d4e12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:29:01.114309 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179e8b8-2658-4a33-b982-bf2a758d4e12 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:29:01.114589 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179e8b8-2658-4a33-b982-bf2a758d4e12 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:29:01.114863 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179e8b8-2658-4a33-b982-bf2a758d4e12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:29:01.116587 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4179e8b8-2658-4a33-b982-bf2a758d4e12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:29:01.142784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179e8b8-2658-4a33-b982-bf2a758d4e12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:29:01.144215 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179e8b8-2658-4a33-b982-bf2a758d4e12 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:29:01.155987 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1146/2279] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:29:01 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:29:02.325589 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770859e9-e88f-431c-bf65-0cd7a87c3044 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:29:02.353312 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770859e9-e88f-431c-bf65-0cd7a87c3044 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:29:02.364570 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58ecb6-21a8-426f-a7d5-00c1eaff5d75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:29:02.365162 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58ecb6-21a8-426f-a7d5-00c1eaff5d75 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:29:02.365531 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58ecb6-21a8-426f-a7d5-00c1eaff5d75 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:29:02.365802 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb58ecb6-21a8-426f-a7d5-00c1eaff5d75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:29:02.376725 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58ecb6-21a8-426f-a7d5-00c1eaff5d75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:29:02.378678 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb58ecb6-21a8-426f-a7d5-00c1eaff5d75 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:29:02.406313 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1134/2280] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:29:02 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:29:41.728320 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179e8b8-2658-4a33-b982-bf2a758d4e12 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:29:41.736782 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179e8b8-2658-4a33-b982-bf2a758d4e12 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:29:41.741433 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6c1ea-c378-4c39-81a7-9f542dd6d6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:29:41.742105 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6c1ea-c378-4c39-81a7-9f542dd6d6dc service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:29:41.742392 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6c1ea-c378-4c39-81a7-9f542dd6d6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:29:41.742670 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c6c1ea-c378-4c39-81a7-9f542dd6d6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:29:41.749604 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6c1ea-c378-4c39-81a7-9f542dd6d6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:29:41.751090 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c6c1ea-c378-4c39-81a7-9f542dd6d6dc service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:29:41.759243 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1147/2281] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:29:41 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:29:56.979635 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58ecb6-21a8-426f-a7d5-00c1eaff5d75 service nova] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:29:56.990576 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb58ecb6-21a8-426f-a7d5-00c1eaff5d75 service nova] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:29:56.996045 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17644c2f-057a-48e7-9acc-81284f727f33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:29:56.996669 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17644c2f-057a-48e7-9acc-81284f727f33 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:29:56.996953 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17644c2f-057a-48e7-9acc-81284f727f33 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:29:56.997230 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17644c2f-057a-48e7-9acc-81284f727f33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:29:57.004834 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17644c2f-057a-48e7-9acc-81284f727f33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:29:57.006437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17644c2f-057a-48e7-9acc-81284f727f33 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:29:57.015634 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1135/2282] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:29:56 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:31:49.998538 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6c1ea-c378-4c39-81a7-9f542dd6d6dc service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:31:50.011337 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c6c1ea-c378-4c39-81a7-9f542dd6d6dc service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:31:50.016328 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffb3a6-a2f2-42cb-9074-8a3aac1e592f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:31:50.016991 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffb3a6-a2f2-42cb-9074-8a3aac1e592f service placement] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:31:50.017274 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffb3a6-a2f2-42cb-9074-8a3aac1e592f service placement] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:31:50.017550 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffb3a6-a2f2-42cb-9074-8a3aac1e592f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:31:50.026507 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffb3a6-a2f2-42cb-9074-8a3aac1e592f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:31:50.028147 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ffb3a6-a2f2-42cb-9074-8a3aac1e592f service placement] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:31:50.037682 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1148/2283] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:31:49 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:32:03.167636 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17644c2f-057a-48e7-9acc-81284f727f33 service nova] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:32:03.176819 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17644c2f-057a-48e7-9acc-81284f727f33 service nova] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:32:03.180366 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2b40e-333f-4b35-b3f3-dfa2cd4b29eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:32:03.180988 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2b40e-333f-4b35-b3f3-dfa2cd4b29eb service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:32:03.181272 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2b40e-333f-4b35-b3f3-dfa2cd4b29eb service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:32:03.181545 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2b40e-333f-4b35-b3f3-dfa2cd4b29eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:32:03.189542 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2b40e-333f-4b35-b3f3-dfa2cd4b29eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:32:03.190983 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2b40e-333f-4b35-b3f3-dfa2cd4b29eb service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:32:03.199535 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1136/2284] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:32:03 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:32:50.268410 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffb3a6-a2f2-42cb-9074-8a3aac1e592f service placement] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:32:50.270129 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a8ffb3a6-a2f2-42cb-9074-8a3aac1e592f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:32:50.459282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffb3a6-a2f2-42cb-9074-8a3aac1e592f service placement] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:32:50.463789 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec267271-bb11-40d7-989e-cbc1083806cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:32:50.464434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec267271-bb11-40d7-989e-cbc1083806cf service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:32:50.464713 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec267271-bb11-40d7-989e-cbc1083806cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:32:50.464988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec267271-bb11-40d7-989e-cbc1083806cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:32:50.527915 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec267271-bb11-40d7-989e-cbc1083806cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:32:50.529282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec267271-bb11-40d7-989e-cbc1083806cf service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:32:50.540496 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1149/2285] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:32:50 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:33:32.326661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2b40e-333f-4b35-b3f3-dfa2cd4b29eb service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:33:32.378623 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2b40e-333f-4b35-b3f3-dfa2cd4b29eb service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:33:32.382241 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172b286-e0ae-41dc-b1a7-fbe299a1b586 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:33:32.382872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172b286-e0ae-41dc-b1a7-fbe299a1b586 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:33:32.383159 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172b286-e0ae-41dc-b1a7-fbe299a1b586 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:33:32.383435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172b286-e0ae-41dc-b1a7-fbe299a1b586 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:33:32.385333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8172b286-e0ae-41dc-b1a7-fbe299a1b586 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:33:32.461099 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172b286-e0ae-41dc-b1a7-fbe299a1b586 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:33:32.462834 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172b286-e0ae-41dc-b1a7-fbe299a1b586 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:33:32.480703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1137/2286] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:33:32 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:33:37.062943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec267271-bb11-40d7-989e-cbc1083806cf service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:33:37.064457 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ec267271-bb11-40d7-989e-cbc1083806cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:33:37.088443 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec267271-bb11-40d7-989e-cbc1083806cf service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:33:37.092213 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b42f52-628d-423b-ac0f-3c582fc07178 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:33:37.092855 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b42f52-628d-423b-ac0f-3c582fc07178 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:33:37.093137 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b42f52-628d-423b-ac0f-3c582fc07178 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:33:37.093411 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b42f52-628d-423b-ac0f-3c582fc07178 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:33:37.095345 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a2b42f52-628d-423b-ac0f-3c582fc07178 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:33:37.170386 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b42f52-628d-423b-ac0f-3c582fc07178 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:33:37.171796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b42f52-628d-423b-ac0f-3c582fc07178 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:33:37.180474 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1150/2287] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:33:37 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:33:47.715864 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172b286-e0ae-41dc-b1a7-fbe299a1b586 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:33:47.726429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172b286-e0ae-41dc-b1a7-fbe299a1b586 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:33:47.730132 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17613c56-9edc-4e5b-a2d6-67cbb2a8ded1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:33:47.730765 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17613c56-9edc-4e5b-a2d6-67cbb2a8ded1 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:33:47.731048 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17613c56-9edc-4e5b-a2d6-67cbb2a8ded1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:33:47.731326 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17613c56-9edc-4e5b-a2d6-67cbb2a8ded1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:33:47.733339 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-17613c56-9edc-4e5b-a2d6-67cbb2a8ded1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:33:47.817665 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17613c56-9edc-4e5b-a2d6-67cbb2a8ded1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:33:47.819739 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17613c56-9edc-4e5b-a2d6-67cbb2a8ded1 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:33:47.837829 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1138/2288] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:33:47 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:34:04.321851 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b42f52-628d-423b-ac0f-3c582fc07178 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:04.323442 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a2b42f52-628d-423b-ac0f-3c582fc07178 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:34:04.413889 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b42f52-628d-423b-ac0f-3c582fc07178 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:04.418336 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce89c27-3c38-4bb3-a311-f24daca947db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:04.419184 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce89c27-3c38-4bb3-a311-f24daca947db admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:04.419461 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce89c27-3c38-4bb3-a311-f24daca947db admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:04.419731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce89c27-3c38-4bb3-a311-f24daca947db admin admin] PATH_INFO: `/v3/users/afe026a09771480ba9dec97bffc248cb` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:04.432645 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce89c27-3c38-4bb3-a311-f24daca947db admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe026a09771480ba9dec97bffc248cb)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:04.434642 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce89c27-3c38-4bb3-a311-f24daca947db admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:04.478422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7ce89c27-3c38-4bb3-a311-f24daca947db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe026a09771480ba9dec97bffc248cb'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:34:04.479082 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7ce89c27-3c38-4bb3-a311-f24daca947db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe026a09771480ba9dec97bffc248cb'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:34:04.490878 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7ce89c27-3c38-4bb3-a311-f24daca947db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe026a09771480ba9dec97bffc248cb'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:34:04.491520 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7ce89c27-3c38-4bb3-a311-f24daca947db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe026a09771480ba9dec97bffc248cb'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:34:04.499147 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7ce89c27-3c38-4bb3-a311-f24daca947db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe026a09771480ba9dec97bffc248cb'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:34:04.511781 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1151/2289] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:34:04 2021] DELETE /identity/v3/users/afe026a09771480ba9dec97bffc248cb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:34:04.516175 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf62af-c932-4dc7-8ce1-350fa5bd7a20 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:04.516681 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf62af-c932-4dc7-8ce1-350fa5bd7a20 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:04.516800 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf62af-c932-4dc7-8ce1-350fa5bd7a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:04.541968 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-abdf62af-c932-4dc7-8ce1-350fa5bd7a20 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:34:04.543154 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-abdf62af-c932-4dc7-8ce1-350fa5bd7a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:34:04.603036 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1139/2290] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:34:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:34:04.612565 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce89c27-3c38-4bb3-a311-f24daca947db admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:04.614001 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-7ce89c27-3c38-4bb3-a311-f24daca947db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:34:04.667918 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce89c27-3c38-4bb3-a311-f24daca947db admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:04.671439 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe45ae1b-e5eb-414d-bf27-f8e7c53a44a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:04.672078 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45ae1b-e5eb-414d-bf27-f8e7c53a44a8 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:04.672362 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45ae1b-e5eb-414d-bf27-f8e7c53a44a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:04.672638 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe45ae1b-e5eb-414d-bf27-f8e7c53a44a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:04.681898 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45ae1b-e5eb-414d-bf27-f8e7c53a44a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:04.683414 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe45ae1b-e5eb-414d-bf27-f8e7c53a44a8 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:04.692787 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1152/2291] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:34:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:34:04.951566 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf62af-c932-4dc7-8ce1-350fa5bd7a20 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:04.953028 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-abdf62af-c932-4dc7-8ce1-350fa5bd7a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:34:04.964835 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf62af-c932-4dc7-8ce1-350fa5bd7a20 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:04.969691 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452111b-f4d1-4f75-bd55-c0350f8bfd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:04.970550 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452111b-f4d1-4f75-bd55-c0350f8bfd0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:04.970828 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452111b-f4d1-4f75-bd55-c0350f8bfd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:04.971102 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452111b-f4d1-4f75-bd55-c0350f8bfd0c admin admin] PATH_INFO: `/v3/projects/599eed21a57b489cba0e8974cea26a57` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:04.983194 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452111b-f4d1-4f75-bd55-c0350f8bfd0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=599eed21a57b489cba0e8974cea26a57)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:04.985101 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452111b-f4d1-4f75-bd55-c0350f8bfd0c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:05.030553 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b452111b-f4d1-4f75-bd55-c0350f8bfd0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '599eed21a57b489cba0e8974cea26a57', 'request_id': 'req-b452111b-f4d1-4f75-bd55-c0350f8bfd0c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:34:05.035813 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b452111b-f4d1-4f75-bd55-c0350f8bfd0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '599eed21a57b489cba0e8974cea26a57', 'request_id': 'req-b452111b-f4d1-4f75-bd55-c0350f8bfd0c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:34:05.043196 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b452111b-f4d1-4f75-bd55-c0350f8bfd0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '599eed21a57b489cba0e8974cea26a57', 'request_id': 'req-b452111b-f4d1-4f75-bd55-c0350f8bfd0c'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:34:05.055109 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b452111b-f4d1-4f75-bd55-c0350f8bfd0c admin admin] The token cache is being invalidate because project 599eed21a57b489cba0e8974cea26a57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:34:05.055397 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b452111b-f4d1-4f75-bd55-c0350f8bfd0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:34:05.056024 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b452111b-f4d1-4f75-bd55-c0350f8bfd0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:34:05.057548 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1140/2292] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:34:04 2021] DELETE /identity/v3/projects/599eed21a57b489cba0e8974cea26a57 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:34:05.063848 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb8841-cf53-4613-8ef0-d14fd4ebbacf None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:05.064140 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb8841-cf53-4613-8ef0-d14fd4ebbacf None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:05.064416 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb8841-cf53-4613-8ef0-d14fd4ebbacf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:05.108739 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-97eb8841-cf53-4613-8ef0-d14fd4ebbacf None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:34:05.109983 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-97eb8841-cf53-4613-8ef0-d14fd4ebbacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:34:05.165194 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1153/2293] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:34:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:34:05.172900 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642ac08-b189-443e-b2c6-c796d3ac1136 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:05.173196 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642ac08-b189-443e-b2c6-c796d3ac1136 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:05.173477 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642ac08-b189-443e-b2c6-c796d3ac1136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:05.190951 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-8642ac08-b189-443e-b2c6-c796d3ac1136 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:34:05.192147 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8642ac08-b189-443e-b2c6-c796d3ac1136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:34:05.200110 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1141/2294] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:34:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:34:05.204278 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb8841-cf53-4613-8ef0-d14fd4ebbacf None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:05.215003 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb8841-cf53-4613-8ef0-d14fd4ebbacf None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:05.219688 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0947952-3c90-4393-8b7d-108c48e2fd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:05.220351 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0947952-3c90-4393-8b7d-108c48e2fd53 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:05.220641 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0947952-3c90-4393-8b7d-108c48e2fd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:05.220922 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0947952-3c90-4393-8b7d-108c48e2fd53 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:05.221712 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0947952-3c90-4393-8b7d-108c48e2fd53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:34:05.222055 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0947952-3c90-4393-8b7d-108c48e2fd53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:05.223621 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0947952-3c90-4393-8b7d-108c48e2fd53 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:05.236321 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1154/2295] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:34:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:34:05.240957 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642ac08-b189-443e-b2c6-c796d3ac1136 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:05.250230 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642ac08-b189-443e-b2c6-c796d3ac1136 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:05.254974 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47842acd-b37c-4764-9dbd-7a1079eeca55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:05.255621 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47842acd-b37c-4764-9dbd-7a1079eeca55 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:05.255905 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47842acd-b37c-4764-9dbd-7a1079eeca55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:05.256183 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47842acd-b37c-4764-9dbd-7a1079eeca55 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:05.256894 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47842acd-b37c-4764-9dbd-7a1079eeca55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:05.258850 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47842acd-b37c-4764-9dbd-7a1079eeca55 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:05.294315 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1142/2296] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:34:05 2021] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:34:05.298546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0947952-3c90-4393-8b7d-108c48e2fd53 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:05.308280 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0947952-3c90-4393-8b7d-108c48e2fd53 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:05.362479 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70a1f3-ae1c-4ae2-bffe-72979f70af04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:05.363176 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70a1f3-ae1c-4ae2-bffe-72979f70af04 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:05.363415 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70a1f3-ae1c-4ae2-bffe-72979f70af04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:05.363686 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70a1f3-ae1c-4ae2-bffe-72979f70af04 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:05.364391 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70a1f3-ae1c-4ae2-bffe-72979f70af04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:05.366339 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef70a1f3-ae1c-4ae2-bffe-72979f70af04 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:05.385442 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1155/2297] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:34:05 2021] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:34:05.389638 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47842acd-b37c-4764-9dbd-7a1079eeca55 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:05.400230 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47842acd-b37c-4764-9dbd-7a1079eeca55 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:05.404865 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90c3d9-ed27-432d-b8c7-e3dbeaae801f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:05.405509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90c3d9-ed27-432d-b8c7-e3dbeaae801f admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:05.405793 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90c3d9-ed27-432d-b8c7-e3dbeaae801f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:05.406109 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90c3d9-ed27-432d-b8c7-e3dbeaae801f admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:05.406847 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90c3d9-ed27-432d-b8c7-e3dbeaae801f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:05.408422 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90c3d9-ed27-432d-b8c7-e3dbeaae801f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:05.418633 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1143/2298] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:34:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:34:05.422391 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70a1f3-ae1c-4ae2-bffe-72979f70af04 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:05.432341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70a1f3-ae1c-4ae2-bffe-72979f70af04 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:05.436965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39203e69-ad4b-4bb1-82b2-f0c5f6ce0ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:05.437618 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39203e69-ad4b-4bb1-82b2-f0c5f6ce0ddb admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:05.437902 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39203e69-ad4b-4bb1-82b2-f0c5f6ce0ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:05.438209 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39203e69-ad4b-4bb1-82b2-f0c5f6ce0ddb admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:05.438943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39203e69-ad4b-4bb1-82b2-f0c5f6ce0ddb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:05.440539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39203e69-ad4b-4bb1-82b2-f0c5f6ce0ddb admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:05.450175 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1156/2299] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:34:05 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:34:05.454019 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90c3d9-ed27-432d-b8c7-e3dbeaae801f admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:05.464421 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90c3d9-ed27-432d-b8c7-e3dbeaae801f admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:05.469061 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10c39f-4877-47ce-8551-76fa729bf6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:05.469913 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10c39f-4877-47ce-8551-76fa729bf6af admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:05.470225 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10c39f-4877-47ce-8551-76fa729bf6af admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:05.470502 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10c39f-4877-47ce-8551-76fa729bf6af admin admin] PATH_INFO: `/v3/projects/be88dec6e0fd4a54a18c3e94fe8f370a/users/78248dce6b754687b48f306bcbf8cdb9/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:05.486379 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10c39f-4877-47ce-8551-76fa729bf6af admin admin] RBAC: Authorizing `identity:create_grant(project_id=be88dec6e0fd4a54a18c3e94fe8f370a, user_id=78248dce6b754687b48f306bcbf8cdb9, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:05.489136 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10c39f-4877-47ce-8551-76fa729bf6af admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:05.502228 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1144/2300] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:34:05 2021] PUT /identity/v3/projects/be88dec6e0fd4a54a18c3e94fe8f370a/users/78248dce6b754687b48f306bcbf8cdb9/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:34:05.512216 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad0d54-307b-4390-b507-f73cb775437d None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:05.512529 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad0d54-307b-4390-b507-f73cb775437d None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:05.512812 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ad0d54-307b-4390-b507-f73cb775437d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:05.540456 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-32ad0d54-307b-4390-b507-f73cb775437d None None] MFA Rules not processed for user `78248dce6b754687b48f306bcbf8cdb9`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:34:05.541648 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-32ad0d54-307b-4390-b507-f73cb775437d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:34:05.602913 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1157/2301] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:34:05 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:34:05.607451 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10c39f-4877-47ce-8551-76fa729bf6af admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:05.667588 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10c39f-4877-47ce-8551-76fa729bf6af admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:05.677404 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434476a-1892-4014-8638-c9e26279bb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:05.678106 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434476a-1892-4014-8638-c9e26279bb6e admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:05.678391 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434476a-1892-4014-8638-c9e26279bb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:05.678665 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1434476a-1892-4014-8638-c9e26279bb6e admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:05.679395 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434476a-1892-4014-8638-c9e26279bb6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:05.681299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1434476a-1892-4014-8638-c9e26279bb6e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:05.706264 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1145/2302] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:34:05 2021] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:34:05.710666 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad0d54-307b-4390-b507-f73cb775437d None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:05.721777 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ad0d54-307b-4390-b507-f73cb775437d None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:05.776433 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0c090-795a-4444-b275-023743c93725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:05.777103 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0c090-795a-4444-b275-023743c93725 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:05.777390 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0c090-795a-4444-b275-023743c93725 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:05.777662 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b0c090-795a-4444-b275-023743c93725 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:05.778422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0c090-795a-4444-b275-023743c93725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:05.780529 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b0c090-795a-4444-b275-023743c93725 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:05.799440 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1158/2303] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:34:05 2021] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:34:05.803431 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434476a-1892-4014-8638-c9e26279bb6e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:05.813429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1434476a-1892-4014-8638-c9e26279bb6e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:05.818005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514408c-92ff-437a-b0b6-b85c6a6dc566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:05.818651 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514408c-92ff-437a-b0b6-b85c6a6dc566 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:05.818931 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514408c-92ff-437a-b0b6-b85c6a6dc566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:05.819206 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f514408c-92ff-437a-b0b6-b85c6a6dc566 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:05.819947 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514408c-92ff-437a-b0b6-b85c6a6dc566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:05.822059 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f514408c-92ff-437a-b0b6-b85c6a6dc566 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:05.832459 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1146/2304] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:34:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:34:05.837009 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0c090-795a-4444-b275-023743c93725 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:05.846923 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b0c090-795a-4444-b275-023743c93725 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:05.851464 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ee43c-71f1-4396-858c-c0c293b404b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:05.852110 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ee43c-71f1-4396-858c-c0c293b404b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:05.852393 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ee43c-71f1-4396-858c-c0c293b404b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:05.852670 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ee43c-71f1-4396-858c-c0c293b404b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:05.853396 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ee43c-71f1-4396-858c-c0c293b404b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:05.855011 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ee43c-71f1-4396-858c-c0c293b404b4 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:05.865183 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1159/2305] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:34:05 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:34:05.869299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514408c-92ff-437a-b0b6-b85c6a6dc566 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:05.879827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f514408c-92ff-437a-b0b6-b85c6a6dc566 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:05.885330 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee6853-6abe-47fd-a164-356e5d3d7dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:05.886210 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee6853-6abe-47fd-a164-356e5d3d7dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:05.886491 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee6853-6abe-47fd-a164-356e5d3d7dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:05.886762 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee6853-6abe-47fd-a164-356e5d3d7dcd admin admin] PATH_INFO: `/v3/projects/3a235e9ba73c4cba9ec9f6dcd5634938/users/73f3379ced1a4bb3a2cd8599e914ee51/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:05.901589 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee6853-6abe-47fd-a164-356e5d3d7dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a235e9ba73c4cba9ec9f6dcd5634938, user_id=73f3379ced1a4bb3a2cd8599e914ee51, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:05.904275 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee6853-6abe-47fd-a164-356e5d3d7dcd admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:05.916543 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1147/2306] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:34:05 2021] PUT /identity/v3/projects/3a235e9ba73c4cba9ec9f6dcd5634938/users/73f3379ced1a4bb3a2cd8599e914ee51/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:34:05.927076 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15de073-d074-4813-b921-64f7557d73e7 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:05.927366 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15de073-d074-4813-b921-64f7557d73e7 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:05.927668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15de073-d074-4813-b921-64f7557d73e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:05.953843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-d15de073-d074-4813-b921-64f7557d73e7 None None] MFA Rules not processed for user `73f3379ced1a4bb3a2cd8599e914ee51`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:34:05.955083 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-d15de073-d074-4813-b921-64f7557d73e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:34:06.015542 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1160/2307] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:34:05 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:34:06.019829 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee6853-6abe-47fd-a164-356e5d3d7dcd admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:06.078930 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee6853-6abe-47fd-a164-356e5d3d7dcd admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:06.083530 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180fb65-6974-45e6-944f-38b8ecffa798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:06.084177 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180fb65-6974-45e6-944f-38b8ecffa798 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:06.084481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180fb65-6974-45e6-944f-38b8ecffa798 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:06.084754 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180fb65-6974-45e6-944f-38b8ecffa798 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:06.085460 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180fb65-6974-45e6-944f-38b8ecffa798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:06.087363 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5180fb65-6974-45e6-944f-38b8ecffa798 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:06.111244 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1148/2308] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:34:06 2021] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:34:06.115239 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15de073-d074-4813-b921-64f7557d73e7 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:06.126053 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15de073-d074-4813-b921-64f7557d73e7 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:06.178815 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126147a-6ae7-47fd-9229-f58d147c599e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:06.179965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126147a-6ae7-47fd-9229-f58d147c599e admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:06.180250 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126147a-6ae7-47fd-9229-f58d147c599e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:06.180528 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f126147a-6ae7-47fd-9229-f58d147c599e admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:06.181232 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126147a-6ae7-47fd-9229-f58d147c599e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:06.183392 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f126147a-6ae7-47fd-9229-f58d147c599e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:06.202409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1161/2309] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:34:06 2021] POST /identity/v3/users => generated 299 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:34:06.206308 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180fb65-6974-45e6-944f-38b8ecffa798 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:06.216547 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180fb65-6974-45e6-944f-38b8ecffa798 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:06.221375 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761eb85-39c4-4c39-9298-6db99fbc76c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:06.222452 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761eb85-39c4-4c39-9298-6db99fbc76c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:06.222739 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761eb85-39c4-4c39-9298-6db99fbc76c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:06.223073 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761eb85-39c4-4c39-9298-6db99fbc76c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:06.223821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761eb85-39c4-4c39-9298-6db99fbc76c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:06.225434 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761eb85-39c4-4c39-9298-6db99fbc76c0 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:06.236035 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1149/2310] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:34:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:34:06.240315 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126147a-6ae7-47fd-9229-f58d147c599e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:06.250616 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f126147a-6ae7-47fd-9229-f58d147c599e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:06.255182 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec78633-f6dd-41ed-a79d-90f6bc057c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:06.256050 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec78633-f6dd-41ed-a79d-90f6bc057c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:06.256326 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec78633-f6dd-41ed-a79d-90f6bc057c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:06.256591 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec78633-f6dd-41ed-a79d-90f6bc057c43 admin admin] PATH_INFO: `/v3/projects/3f2c03f43f244687ab2f19327bfc62c2/users/45af21285a0243738ba64914bec019f3/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:06.272095 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec78633-f6dd-41ed-a79d-90f6bc057c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f2c03f43f244687ab2f19327bfc62c2, user_id=45af21285a0243738ba64914bec019f3, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:06.274676 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec78633-f6dd-41ed-a79d-90f6bc057c43 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:06.287194 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1162/2311] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:34:06 2021] PUT /identity/v3/projects/3f2c03f43f244687ab2f19327bfc62c2/users/45af21285a0243738ba64914bec019f3/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:34:06.291769 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761eb85-39c4-4c39-9298-6db99fbc76c0 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:06.301616 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761eb85-39c4-4c39-9298-6db99fbc76c0 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:06.356004 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b2023-8ce8-4c7c-9432-ff980054ddc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:06.356655 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b2023-8ce8-4c7c-9432-ff980054ddc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:06.356932 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b2023-8ce8-4c7c-9432-ff980054ddc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:06.357201 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b2023-8ce8-4c7c-9432-ff980054ddc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:06.357947 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b2023-8ce8-4c7c-9432-ff980054ddc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:06.359517 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b2023-8ce8-4c7c-9432-ff980054ddc8 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:06.369432 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1150/2312] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:34:06 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:34:06.373440 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec78633-f6dd-41ed-a79d-90f6bc057c43 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:06.383441 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec78633-f6dd-41ed-a79d-90f6bc057c43 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:06.388104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecb4f1-1281-4277-9c25-ea822d46ff02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:06.388967 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecb4f1-1281-4277-9c25-ea822d46ff02 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:06.389264 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecb4f1-1281-4277-9c25-ea822d46ff02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:06.389520 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adecb4f1-1281-4277-9c25-ea822d46ff02 admin admin] PATH_INFO: `/v3/projects/3f2c03f43f244687ab2f19327bfc62c2/users/45af21285a0243738ba64914bec019f3/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:06.391536 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecb4f1-1281-4277-9c25-ea822d46ff02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f2c03f43f244687ab2f19327bfc62c2, user_id=45af21285a0243738ba64914bec019f3, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:06.394191 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adecb4f1-1281-4277-9c25-ea822d46ff02 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:06.404012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1163/2313] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:34:06 2021] PUT /identity/v3/projects/3f2c03f43f244687ab2f19327bfc62c2/users/45af21285a0243738ba64914bec019f3/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:34:06.414393 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee20bf-c140-4cdf-97b8-1daf8e8001a7 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:06.414679 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee20bf-c140-4cdf-97b8-1daf8e8001a7 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:06.414958 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee20bf-c140-4cdf-97b8-1daf8e8001a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:06.441747 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-3bee20bf-c140-4cdf-97b8-1daf8e8001a7 None None] MFA Rules not processed for user `45af21285a0243738ba64914bec019f3`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:34:06.443031 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3bee20bf-c140-4cdf-97b8-1daf8e8001a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:34:06.508264 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1151/2314] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:34:06 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:34:06.518647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecb4f1-1281-4277-9c25-ea822d46ff02 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:06.520338 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-adecb4f1-1281-4277-9c25-ea822d46ff02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:34:06.575421 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adecb4f1-1281-4277-9c25-ea822d46ff02 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:06.579079 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacde92b-9eb6-42de-ad49-8cab1919df6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:06.579712 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacde92b-9eb6-42de-ad49-8cab1919df6c service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:06.579995 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacde92b-9eb6-42de-ad49-8cab1919df6c service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:06.580269 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacde92b-9eb6-42de-ad49-8cab1919df6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:06.633834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacde92b-9eb6-42de-ad49-8cab1919df6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:06.635284 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacde92b-9eb6-42de-ad49-8cab1919df6c service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:06.643801 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1164/2315] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:34:06 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:34:46.720605 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee20bf-c140-4cdf-97b8-1daf8e8001a7 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:46.721966 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3bee20bf-c140-4cdf-97b8-1daf8e8001a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:34:46.787554 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee20bf-c140-4cdf-97b8-1daf8e8001a7 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:46.791210 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfef677-5180-4281-93ab-2ae1281cef95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:46.791981 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfef677-5180-4281-93ab-2ae1281cef95 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:46.792131 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfef677-5180-4281-93ab-2ae1281cef95 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:46.792409 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfef677-5180-4281-93ab-2ae1281cef95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:46.794214 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-cbfef677-5180-4281-93ab-2ae1281cef95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:34:46.804032 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfef677-5180-4281-93ab-2ae1281cef95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:46.805466 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfef677-5180-4281-93ab-2ae1281cef95 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:46.816029 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1152/2316] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:34:46 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:34:57.694408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacde92b-9eb6-42de-ad49-8cab1919df6c service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:34:57.694408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-aacde92b-9eb6-42de-ad49-8cab1919df6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:34:57.704298 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacde92b-9eb6-42de-ad49-8cab1919df6c service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:34:57.707864 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f239666-d5e3-4f56-b3da-1f0bee9c450e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:34:57.708493 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f239666-d5e3-4f56-b3da-1f0bee9c450e service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:34:57.708772 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f239666-d5e3-4f56-b3da-1f0bee9c450e service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:34:57.709041 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f239666-d5e3-4f56-b3da-1f0bee9c450e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:34:57.711242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-5f239666-d5e3-4f56-b3da-1f0bee9c450e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:34:57.789440 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f239666-d5e3-4f56-b3da-1f0bee9c450e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:34:57.790907 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f239666-d5e3-4f56-b3da-1f0bee9c450e service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:34:57.811522 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1165/2317] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:34:57 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:35:19.979146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfef677-5180-4281-93ab-2ae1281cef95 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:35:19.987617 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfef677-5180-4281-93ab-2ae1281cef95 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:35:19.992408 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a87b2-874a-4998-babb-e2fcfa9ecdbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:35:19.993062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a87b2-874a-4998-babb-e2fcfa9ecdbd service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:35:19.993344 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a87b2-874a-4998-babb-e2fcfa9ecdbd service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:35:19.993620 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11a87b2-874a-4998-babb-e2fcfa9ecdbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:35:19.995461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a11a87b2-874a-4998-babb-e2fcfa9ecdbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:35:20.063551 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a87b2-874a-4998-babb-e2fcfa9ecdbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:35:20.064988 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11a87b2-874a-4998-babb-e2fcfa9ecdbd service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:35:20.075878 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1153/2318] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:35:19 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:36:50.965801 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f239666-d5e3-4f56-b3da-1f0bee9c450e service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:36:50.967207 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-5f239666-d5e3-4f56-b3da-1f0bee9c450e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:36:51.088319 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f239666-d5e3-4f56-b3da-1f0bee9c450e service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:36:51.093673 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0eaf3-cb7e-4b22-a6f0-f62e20131c9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:36:51.094348 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0eaf3-cb7e-4b22-a6f0-f62e20131c9f service placement] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:36:51.094631 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0eaf3-cb7e-4b22-a6f0-f62e20131c9f service placement] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:36:51.094908 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0eaf3-cb7e-4b22-a6f0-f62e20131c9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:36:51.096647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f8f0eaf3-cb7e-4b22-a6f0-f62e20131c9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:36:51.108300 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0eaf3-cb7e-4b22-a6f0-f62e20131c9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:36:51.109857 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0eaf3-cb7e-4b22-a6f0-f62e20131c9f service placement] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:36:51.119365 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1166/2319] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:36:50 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:37:51.649913 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a87b2-874a-4998-babb-e2fcfa9ecdbd service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:37:51.651412 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a11a87b2-874a-4998-babb-e2fcfa9ecdbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:37:51.699761 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11a87b2-874a-4998-babb-e2fcfa9ecdbd service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:37:51.703587 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e357b-4526-4b73-a1cd-dfb814cc3605 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:37:51.704250 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e357b-4526-4b73-a1cd-dfb814cc3605 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:37:51.704562 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e357b-4526-4b73-a1cd-dfb814cc3605 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:37:51.704837 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e357b-4526-4b73-a1cd-dfb814cc3605 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:37:51.706620 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-376e357b-4526-4b73-a1cd-dfb814cc3605 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:37:51.720052 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e357b-4526-4b73-a1cd-dfb814cc3605 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:37:51.721490 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e357b-4526-4b73-a1cd-dfb814cc3605 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:37:51.732786 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1154/2320] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:37:51 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:38:33.466642 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0eaf3-cb7e-4b22-a6f0-f62e20131c9f service placement] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:38:33.468128 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f8f0eaf3-cb7e-4b22-a6f0-f62e20131c9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:38:33.513373 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0eaf3-cb7e-4b22-a6f0-f62e20131c9f service placement] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:38:33.518626 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02eeb38-9b84-42a3-8282-1f86610993f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:38:33.519258 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02eeb38-9b84-42a3-8282-1f86610993f9 service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:38:33.519535 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02eeb38-9b84-42a3-8282-1f86610993f9 service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:38:33.519802 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02eeb38-9b84-42a3-8282-1f86610993f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:38:33.523107 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f02eeb38-9b84-42a3-8282-1f86610993f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:38:33.578423 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02eeb38-9b84-42a3-8282-1f86610993f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:38:33.580020 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02eeb38-9b84-42a3-8282-1f86610993f9 service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:38:33.589585 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1167/2321] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:38:33 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:38:37.102567 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e357b-4526-4b73-a1cd-dfb814cc3605 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:38:37.121049 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e357b-4526-4b73-a1cd-dfb814cc3605 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:38:37.124780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abb5fd-13ae-46a1-9259-72dd8c0a9698 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:38:37.125413 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abb5fd-13ae-46a1-9259-72dd8c0a9698 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:38:37.125696 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abb5fd-13ae-46a1-9259-72dd8c0a9698 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:38:37.125992 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abb5fd-13ae-46a1-9259-72dd8c0a9698 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:38:37.129304 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a8abb5fd-13ae-46a1-9259-72dd8c0a9698 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:38:37.187879 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abb5fd-13ae-46a1-9259-72dd8c0a9698 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:38:37.189323 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abb5fd-13ae-46a1-9259-72dd8c0a9698 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:38:37.208068 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1155/2322] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:38:37 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:38:40.827027 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02eeb38-9b84-42a3-8282-1f86610993f9 service nova] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:38:40.828340 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f02eeb38-9b84-42a3-8282-1f86610993f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:38:40.844087 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02eeb38-9b84-42a3-8282-1f86610993f9 service nova] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:38:40.851157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50396a-c560-4c65-8e42-a151aa48bd1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:38:40.851904 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50396a-c560-4c65-8e42-a151aa48bd1b service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:38:40.852259 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50396a-c560-4c65-8e42-a151aa48bd1b service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:38:40.852603 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50396a-c560-4c65-8e42-a151aa48bd1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:38:40.854515 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-0d50396a-c560-4c65-8e42-a151aa48bd1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:38:40.869978 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50396a-c560-4c65-8e42-a151aa48bd1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:38:40.872139 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d50396a-c560-4c65-8e42-a151aa48bd1b service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:38:40.884668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1168/2323] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:38:40 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:39:52.708789 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abb5fd-13ae-46a1-9259-72dd8c0a9698 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:39:52.718418 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abb5fd-13ae-46a1-9259-72dd8c0a9698 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:39:52.722069 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a1202-23f7-4fe2-86a9-f1ca3ab97c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:39:52.722820 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a1202-23f7-4fe2-86a9-f1ca3ab97c4a service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:39:52.723163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a1202-23f7-4fe2-86a9-f1ca3ab97c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:39:52.723521 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843a1202-23f7-4fe2-86a9-f1ca3ab97c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:39:52.731634 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a1202-23f7-4fe2-86a9-f1ca3ab97c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:39:52.733039 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843a1202-23f7-4fe2-86a9-f1ca3ab97c4a service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:39:52.740919 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1156/2324] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:39:52 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:40:18.965349 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50396a-c560-4c65-8e42-a151aa48bd1b service nova] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:40:18.974382 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d50396a-c560-4c65-8e42-a151aa48bd1b service nova] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:40:18.977864 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93bdfb-0822-4872-bbd0-c7571a09b9fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:40:18.978518 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93bdfb-0822-4872-bbd0-c7571a09b9fe service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:40:18.978797 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93bdfb-0822-4872-bbd0-c7571a09b9fe service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:40:18.979568 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93bdfb-0822-4872-bbd0-c7571a09b9fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:40:18.989312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93bdfb-0822-4872-bbd0-c7571a09b9fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:40:18.990791 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a93bdfb-0822-4872-bbd0-c7571a09b9fe service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:40:19.001792 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1169/2325] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:40:18 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:40:39.771876 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a1202-23f7-4fe2-86a9-f1ca3ab97c4a service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:40:39.781612 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843a1202-23f7-4fe2-86a9-f1ca3ab97c4a service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:40:39.785664 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932aad53-c25e-4e43-9851-acb841e428eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:40:39.786388 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932aad53-c25e-4e43-9851-acb841e428eb service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:40:39.786689 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932aad53-c25e-4e43-9851-acb841e428eb service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:40:39.786985 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932aad53-c25e-4e43-9851-acb841e428eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:40:39.795827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932aad53-c25e-4e43-9851-acb841e428eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:40:39.797230 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932aad53-c25e-4e43-9851-acb841e428eb service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:40:39.805656 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1157/2326] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:40:39 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:40:39.880281 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93bdfb-0822-4872-bbd0-c7571a09b9fe service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:40:39.889103 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93bdfb-0822-4872-bbd0-c7571a09b9fe service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:40:39.892686 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b37c55-564e-4a11-a583-f771dfa89485 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:40:39.893322 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b37c55-564e-4a11-a583-f771dfa89485 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:40:39.893607 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b37c55-564e-4a11-a583-f771dfa89485 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:40:39.893887 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b37c55-564e-4a11-a583-f771dfa89485 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:40:39.895691 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-99b37c55-564e-4a11-a583-f771dfa89485 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:40:39.952683 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b37c55-564e-4a11-a583-f771dfa89485 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:40:39.954146 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b37c55-564e-4a11-a583-f771dfa89485 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:40:39.963120 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1170/2327] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:40:39 2021] GET /identity/v3/auth/tokens => generated 3409 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:40:40.005014 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932aad53-c25e-4e43-9851-acb841e428eb service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:40:40.013286 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932aad53-c25e-4e43-9851-acb841e428eb service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:40:40.016989 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5080453-394a-4042-9767-b43e071854bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:40:40.017558 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5080453-394a-4042-9767-b43e071854bf service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:40:40.017839 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5080453-394a-4042-9767-b43e071854bf service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:40:40.018147 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5080453-394a-4042-9767-b43e071854bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:40:40.026781 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5080453-394a-4042-9767-b43e071854bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:40:40.028204 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5080453-394a-4042-9767-b43e071854bf service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:40:40.036840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1158/2328] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:40:40 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:41:20.535277 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a1035-1593-4fd1-872c-60c8a190363d None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:41:20.535810 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a1035-1593-4fd1-872c-60c8a190363d None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:41:20.535944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6a1035-1593-4fd1-872c-60c8a190363d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:41:20.561073 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-cf6a1035-1593-4fd1-872c-60c8a190363d None None] MFA Rules not processed for user `33143e95face4c81af346e9ca6991ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:41:20.562298 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-cf6a1035-1593-4fd1-872c-60c8a190363d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:41:20.568962 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1171/2329] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:41:20 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:41:21.025111 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5080453-394a-4042-9767-b43e071854bf service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:41:21.036318 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5080453-394a-4042-9767-b43e071854bf service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:41:21.039799 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c4a2c-eb21-492e-9b0e-e2c93943aa17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:41:21.040420 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c4a2c-eb21-492e-9b0e-e2c93943aa17 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:41:21.040697 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c4a2c-eb21-492e-9b0e-e2c93943aa17 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:41:21.040970 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150c4a2c-eb21-492e-9b0e-e2c93943aa17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:41:21.042744 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-150c4a2c-eb21-492e-9b0e-e2c93943aa17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:41:21.051781 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c4a2c-eb21-492e-9b0e-e2c93943aa17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:41:21.053172 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150c4a2c-eb21-492e-9b0e-e2c93943aa17 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:41:21.060786 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1159/2330] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:41:21 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:41:21.376977 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a1035-1593-4fd1-872c-60c8a190363d None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:41:21.378399 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-cf6a1035-1593-4fd1-872c-60c8a190363d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:41:21.393176 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6a1035-1593-4fd1-872c-60c8a190363d None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:41:21.398124 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715665e-1ea4-44d4-a543-f93f5b260bda service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:41:21.398763 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715665e-1ea4-44d4-a543-f93f5b260bda service placement] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:41:21.399042 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715665e-1ea4-44d4-a543-f93f5b260bda service placement] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:41:21.399319 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f715665e-1ea4-44d4-a543-f93f5b260bda service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:41:21.401072 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f715665e-1ea4-44d4-a543-f93f5b260bda service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:41:21.412611 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715665e-1ea4-44d4-a543-f93f5b260bda service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:41:21.414219 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f715665e-1ea4-44d4-a543-f93f5b260bda service placement] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:41:21.425636 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1172/2331] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:41:21 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:41:29.386258 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c4a2c-eb21-492e-9b0e-e2c93943aa17 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:41:29.399115 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150c4a2c-eb21-492e-9b0e-e2c93943aa17 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:41:29.404661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd50f8-e46d-4a74-aab7-7075fe6b8e53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:41:29.405298 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd50f8-e46d-4a74-aab7-7075fe6b8e53 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:41:29.405582 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd50f8-e46d-4a74-aab7-7075fe6b8e53 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:41:29.405861 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd50f8-e46d-4a74-aab7-7075fe6b8e53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:41:29.407680 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e7fd50f8-e46d-4a74-aab7-7075fe6b8e53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:41:29.433400 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd50f8-e46d-4a74-aab7-7075fe6b8e53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:41:29.435755 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd50f8-e46d-4a74-aab7-7075fe6b8e53 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:41:29.447049 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1160/2332] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:41:29 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:41:57.023087 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715665e-1ea4-44d4-a543-f93f5b260bda service placement] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:41:57.033141 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f715665e-1ea4-44d4-a543-f93f5b260bda service placement] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:41:57.038211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220ef1d-18f8-40d4-b64e-c928900446b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:41:57.038842 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220ef1d-18f8-40d4-b64e-c928900446b1 service placement] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:41:57.039123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220ef1d-18f8-40d4-b64e-c928900446b1 service placement] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:41:57.039402 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220ef1d-18f8-40d4-b64e-c928900446b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:41:57.048219 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220ef1d-18f8-40d4-b64e-c928900446b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:41:57.049786 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b220ef1d-18f8-40d4-b64e-c928900446b1 service placement] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:41:57.059974 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1173/2333] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:41:57 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:42:40.473209 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd50f8-e46d-4a74-aab7-7075fe6b8e53 service nova] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:42:40.482420 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd50f8-e46d-4a74-aab7-7075fe6b8e53 service nova] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:42:40.486070 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97657a53-b662-4ec5-bea6-5e0356fbb344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:42:40.486770 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97657a53-b662-4ec5-bea6-5e0356fbb344 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:40.487047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97657a53-b662-4ec5-bea6-5e0356fbb344 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:40.487509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97657a53-b662-4ec5-bea6-5e0356fbb344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:40.489402 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-97657a53-b662-4ec5-bea6-5e0356fbb344 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:42:40.555185 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97657a53-b662-4ec5-bea6-5e0356fbb344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:42:40.563507 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97657a53-b662-4ec5-bea6-5e0356fbb344 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:42:40.573186 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1161/2334] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:42:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:42:44.697073 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220ef1d-18f8-40d4-b64e-c928900446b1 service placement] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:42:44.698571 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b220ef1d-18f8-40d4-b64e-c928900446b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:42:44.717606 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220ef1d-18f8-40d4-b64e-c928900446b1 service placement] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:42:44.729503 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064d182-0c05-4500-897b-2eed598fa605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:42:44.730432 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064d182-0c05-4500-897b-2eed598fa605 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:44.731357 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064d182-0c05-4500-897b-2eed598fa605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:44.731633 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064d182-0c05-4500-897b-2eed598fa605 admin admin] PATH_INFO: `/v3/users/16c47acc08ad42ec9f14cbad92726027` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:44.732858 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064d182-0c05-4500-897b-2eed598fa605 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16c47acc08ad42ec9f14cbad92726027)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:42:44.734878 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064d182-0c05-4500-897b-2eed598fa605 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:42:44.783859 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a064d182-0c05-4500-897b-2eed598fa605 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16c47acc08ad42ec9f14cbad92726027'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:42:44.784625 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a064d182-0c05-4500-897b-2eed598fa605 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16c47acc08ad42ec9f14cbad92726027'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:42:44.796894 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a064d182-0c05-4500-897b-2eed598fa605 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16c47acc08ad42ec9f14cbad92726027'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:42:44.797654 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a064d182-0c05-4500-897b-2eed598fa605 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16c47acc08ad42ec9f14cbad92726027'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:42:44.804591 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-a064d182-0c05-4500-897b-2eed598fa605 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16c47acc08ad42ec9f14cbad92726027'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:42:44.816858 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1174/2335] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:42:44 2021] DELETE /identity/v3/users/16c47acc08ad42ec9f14cbad92726027 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:42:44.985058 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97657a53-b662-4ec5-bea6-5e0356fbb344 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:42:44.994852 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97657a53-b662-4ec5-bea6-5e0356fbb344 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:42:45.050695 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ade2f8-8caf-4826-bcaf-ee1846d3f834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:42:45.051542 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ade2f8-8caf-4826-bcaf-ee1846d3f834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:45.051826 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ade2f8-8caf-4826-bcaf-ee1846d3f834 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:45.052100 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ade2f8-8caf-4826-bcaf-ee1846d3f834 admin admin] PATH_INFO: `/v3/projects/cd477d4386d54c8c9bfaaf5ee2a5ddb5` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:45.053287 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ade2f8-8caf-4826-bcaf-ee1846d3f834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd477d4386d54c8c9bfaaf5ee2a5ddb5)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:42:45.055219 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ade2f8-8caf-4826-bcaf-ee1846d3f834 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:42:45.098881 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-31ade2f8-8caf-4826-bcaf-ee1846d3f834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd477d4386d54c8c9bfaaf5ee2a5ddb5', 'request_id': 'req-31ade2f8-8caf-4826-bcaf-ee1846d3f834'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:42:45.104262 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-31ade2f8-8caf-4826-bcaf-ee1846d3f834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd477d4386d54c8c9bfaaf5ee2a5ddb5', 'request_id': 'req-31ade2f8-8caf-4826-bcaf-ee1846d3f834'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:42:45.111984 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-31ade2f8-8caf-4826-bcaf-ee1846d3f834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd477d4386d54c8c9bfaaf5ee2a5ddb5', 'request_id': 'req-31ade2f8-8caf-4826-bcaf-ee1846d3f834'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:42:45.122925 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-31ade2f8-8caf-4826-bcaf-ee1846d3f834 admin admin] The token cache is being invalidate because project cd477d4386d54c8c9bfaaf5ee2a5ddb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:42:45.123209 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-31ade2f8-8caf-4826-bcaf-ee1846d3f834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:42:45.123820 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-31ade2f8-8caf-4826-bcaf-ee1846d3f834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:42:45.125335 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1162/2336] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:42:44 2021] DELETE /identity/v3/projects/cd477d4386d54c8c9bfaaf5ee2a5ddb5 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:42:45.131929 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1901e-41de-42f8-9edf-f872b85bdd0e None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:45.132221 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1901e-41de-42f8-9edf-f872b85bdd0e None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:45.132496 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d1901e-41de-42f8-9edf-f872b85bdd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:45.150639 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-01d1901e-41de-42f8-9edf-f872b85bdd0e None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:42:45.152018 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-01d1901e-41de-42f8-9edf-f872b85bdd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:42:45.208147 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1175/2337] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:42:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:42:45.216319 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0f31c-6525-4c89-b03b-b645fa388e8a None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:45.216587 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0f31c-6525-4c89-b03b-b645fa388e8a None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:45.216864 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a0f31c-6525-4c89-b03b-b645fa388e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:45.234501 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-73a0f31c-6525-4c89-b03b-b645fa388e8a None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:42:45.235606 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-73a0f31c-6525-4c89-b03b-b645fa388e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:42:45.243322 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1163/2338] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:42:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:42:45.248035 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1901e-41de-42f8-9edf-f872b85bdd0e None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:42:45.257443 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d1901e-41de-42f8-9edf-f872b85bdd0e None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:42:45.262680 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09add5e-1721-43ac-8d70-a6517ca45024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:42:45.263322 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09add5e-1721-43ac-8d70-a6517ca45024 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:45.263600 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09add5e-1721-43ac-8d70-a6517ca45024 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:45.263874 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09add5e-1721-43ac-8d70-a6517ca45024 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:45.264601 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09add5e-1721-43ac-8d70-a6517ca45024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:42:45.264902 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09add5e-1721-43ac-8d70-a6517ca45024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:42:45.266517 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09add5e-1721-43ac-8d70-a6517ca45024 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:42:45.277349 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1176/2339] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:42:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:42:45.281449 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0f31c-6525-4c89-b03b-b645fa388e8a None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:42:45.290361 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a0f31c-6525-4c89-b03b-b645fa388e8a None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:42:45.295074 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8696c-3ea7-428a-9522-f4e3faeb20c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:42:45.295822 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8696c-3ea7-428a-9522-f4e3faeb20c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:45.296165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8696c-3ea7-428a-9522-f4e3faeb20c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:45.296530 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8696c-3ea7-428a-9522-f4e3faeb20c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:45.297303 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8696c-3ea7-428a-9522-f4e3faeb20c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:42:45.299268 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc8696c-3ea7-428a-9522-f4e3faeb20c7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:42:45.323697 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1164/2340] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:42:45 2021] POST /identity/v3/projects => generated 403 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:42:45.328339 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09add5e-1721-43ac-8d70-a6517ca45024 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:42:45.337838 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09add5e-1721-43ac-8d70-a6517ca45024 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:42:45.391485 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd2b73-8cc8-4e29-8662-be30e21398e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:42:45.392148 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd2b73-8cc8-4e29-8662-be30e21398e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:45.392431 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd2b73-8cc8-4e29-8662-be30e21398e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:45.392710 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd2b73-8cc8-4e29-8662-be30e21398e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:45.393414 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd2b73-8cc8-4e29-8662-be30e21398e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:42:45.395516 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd2b73-8cc8-4e29-8662-be30e21398e7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:42:45.413273 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1177/2341] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:42:45 2021] POST /identity/v3/users => generated 302 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:42:45.417337 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8696c-3ea7-428a-9522-f4e3faeb20c7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:42:45.427461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8696c-3ea7-428a-9522-f4e3faeb20c7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:42:45.432103 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b95fbf-6f8a-4f57-8546-0619b7da11a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:42:45.432723 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b95fbf-6f8a-4f57-8546-0619b7da11a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:45.433146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b95fbf-6f8a-4f57-8546-0619b7da11a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:45.433427 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b95fbf-6f8a-4f57-8546-0619b7da11a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:45.434705 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b95fbf-6f8a-4f57-8546-0619b7da11a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:42:45.436283 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b95fbf-6f8a-4f57-8546-0619b7da11a9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:42:45.446886 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1165/2342] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:42:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:42:45.451310 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd2b73-8cc8-4e29-8662-be30e21398e7 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:42:45.460905 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd2b73-8cc8-4e29-8662-be30e21398e7 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:42:45.466187 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0544aa-76b3-43c4-bbc6-205aa268dfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:42:45.466888 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0544aa-76b3-43c4-bbc6-205aa268dfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:45.467201 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0544aa-76b3-43c4-bbc6-205aa268dfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:45.467476 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0544aa-76b3-43c4-bbc6-205aa268dfb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:45.468212 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0544aa-76b3-43c4-bbc6-205aa268dfb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:42:45.469904 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0544aa-76b3-43c4-bbc6-205aa268dfb5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:42:45.479524 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1178/2343] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:42:45 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:42:45.483422 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b95fbf-6f8a-4f57-8546-0619b7da11a9 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:42:45.493145 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b95fbf-6f8a-4f57-8546-0619b7da11a9 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:42:45.498238 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d6119-d0a7-43af-b868-1267aa7a47e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:42:45.499087 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d6119-d0a7-43af-b868-1267aa7a47e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:45.499370 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d6119-d0a7-43af-b868-1267aa7a47e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:45.499644 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d6119-d0a7-43af-b868-1267aa7a47e1 admin admin] PATH_INFO: `/v3/projects/2802ef25f02748c491d55a7b1abf557a/users/df32a8dae7524f90bfab095bdc5b3236/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:45.514265 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d6119-d0a7-43af-b868-1267aa7a47e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2802ef25f02748c491d55a7b1abf557a, user_id=df32a8dae7524f90bfab095bdc5b3236, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:42:45.516881 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d6119-d0a7-43af-b868-1267aa7a47e1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:42:45.529105 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1166/2344] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:42:45 2021] PUT /identity/v3/projects/2802ef25f02748c491d55a7b1abf557a/users/df32a8dae7524f90bfab095bdc5b3236/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:42:45.539041 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b818453-efae-4c9c-b99b-889cc9cc33dc None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:45.539319 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b818453-efae-4c9c-b99b-889cc9cc33dc None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:45.539627 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b818453-efae-4c9c-b99b-889cc9cc33dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:45.566017 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-5b818453-efae-4c9c-b99b-889cc9cc33dc None None] MFA Rules not processed for user `df32a8dae7524f90bfab095bdc5b3236`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:42:45.567217 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-5b818453-efae-4c9c-b99b-889cc9cc33dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:42:45.631232 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1179/2345] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:42:45 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:42:45.636252 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d6119-d0a7-43af-b868-1267aa7a47e1 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:42:45.699409 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d6119-d0a7-43af-b868-1267aa7a47e1 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:42:45.704021 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec95f1e-b269-4dea-ac94-eae3e7110c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:42:45.704669 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec95f1e-b269-4dea-ac94-eae3e7110c2c admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:45.704950 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec95f1e-b269-4dea-ac94-eae3e7110c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:45.705224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec95f1e-b269-4dea-ac94-eae3e7110c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:45.705946 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec95f1e-b269-4dea-ac94-eae3e7110c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:42:45.707837 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec95f1e-b269-4dea-ac94-eae3e7110c2c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:42:45.732785 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1167/2346] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:42:45 2021] POST /identity/v3/projects => generated 403 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:42:45.736894 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b818453-efae-4c9c-b99b-889cc9cc33dc None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:42:45.747896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b818453-efae-4c9c-b99b-889cc9cc33dc None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:42:45.807332 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a6c6c-92ba-4f94-ba13-86936fe0156b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:42:45.807995 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a6c6c-92ba-4f94-ba13-86936fe0156b admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:45.808273 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a6c6c-92ba-4f94-ba13-86936fe0156b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:45.809136 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38a6c6c-92ba-4f94-ba13-86936fe0156b admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:45.809856 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a6c6c-92ba-4f94-ba13-86936fe0156b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:42:45.811777 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38a6c6c-92ba-4f94-ba13-86936fe0156b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:42:45.829782 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1180/2347] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:42:45 2021] POST /identity/v3/users => generated 308 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:42:45.834144 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec95f1e-b269-4dea-ac94-eae3e7110c2c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:42:45.844517 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec95f1e-b269-4dea-ac94-eae3e7110c2c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:42:45.849245 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0ad3b-b8cd-4ce2-aa86-179f92bea437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:42:45.850009 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0ad3b-b8cd-4ce2-aa86-179f92bea437 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:45.850319 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0ad3b-b8cd-4ce2-aa86-179f92bea437 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:45.850609 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e0ad3b-b8cd-4ce2-aa86-179f92bea437 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:45.851321 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0ad3b-b8cd-4ce2-aa86-179f92bea437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:42:45.852930 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e0ad3b-b8cd-4ce2-aa86-179f92bea437 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:42:45.863132 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1168/2348] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:42:45 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:42:45.867089 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a6c6c-92ba-4f94-ba13-86936fe0156b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:42:45.877193 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38a6c6c-92ba-4f94-ba13-86936fe0156b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:42:45.881686 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbc814-765c-4132-afc3-840a5ff1bcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:42:45.882567 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbc814-765c-4132-afc3-840a5ff1bcf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:45.882851 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbc814-765c-4132-afc3-840a5ff1bcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:45.883123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bbc814-765c-4132-afc3-840a5ff1bcf1 admin admin] PATH_INFO: `/v3/projects/319b81c7fe004b42ac5c365c83dadbdf/users/12aa9ed7eece4aa7ad573581002d83e2/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:45.896927 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bbc814-765c-4132-afc3-840a5ff1bcf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=319b81c7fe004b42ac5c365c83dadbdf, user_id=12aa9ed7eece4aa7ad573581002d83e2, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:42:45.899641 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bbc814-765c-4132-afc3-840a5ff1bcf1 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:42:45.912033 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1181/2349] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:42:45 2021] PUT /identity/v3/projects/319b81c7fe004b42ac5c365c83dadbdf/users/12aa9ed7eece4aa7ad573581002d83e2/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:42:45.915804 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0ad3b-b8cd-4ce2-aa86-179f92bea437 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:42:45.926057 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e0ad3b-b8cd-4ce2-aa86-179f92bea437 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:42:45.981333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cb010f-300b-48c8-b848-b06fc7d436db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:42:45.982013 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb010f-300b-48c8-b848-b06fc7d436db admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:45.982339 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb010f-300b-48c8-b848-b06fc7d436db admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:45.982615 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cb010f-300b-48c8-b848-b06fc7d436db admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:45.983346 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb010f-300b-48c8-b848-b06fc7d436db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:42:45.984969 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cb010f-300b-48c8-b848-b06fc7d436db admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:42:45.994193 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1169/2350] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:42:45 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:42:45.998468 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbc814-765c-4132-afc3-840a5ff1bcf1 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:42:46.008521 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bbc814-765c-4132-afc3-840a5ff1bcf1 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:42:46.013130 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76223a16-2d6f-45ba-b212-553c7a9917ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:42:46.014026 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76223a16-2d6f-45ba-b212-553c7a9917ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:46.014307 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76223a16-2d6f-45ba-b212-553c7a9917ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:46.014580 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76223a16-2d6f-45ba-b212-553c7a9917ec admin admin] PATH_INFO: `/v3/projects/319b81c7fe004b42ac5c365c83dadbdf/users/12aa9ed7eece4aa7ad573581002d83e2/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:46.016528 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76223a16-2d6f-45ba-b212-553c7a9917ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=319b81c7fe004b42ac5c365c83dadbdf, user_id=12aa9ed7eece4aa7ad573581002d83e2, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:42:46.019187 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76223a16-2d6f-45ba-b212-553c7a9917ec admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:42:46.029574 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1182/2351] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:42:45 2021] PUT /identity/v3/projects/319b81c7fe004b42ac5c365c83dadbdf/users/12aa9ed7eece4aa7ad573581002d83e2/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:42:46.040581 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a30fd-49a4-4aab-9e1a-d6bc1d8b0740 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:46.040869 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a30fd-49a4-4aab-9e1a-d6bc1d8b0740 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:46.041150 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380a30fd-49a4-4aab-9e1a-d6bc1d8b0740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:46.067417 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-380a30fd-49a4-4aab-9e1a-d6bc1d8b0740 None None] MFA Rules not processed for user `12aa9ed7eece4aa7ad573581002d83e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:42:46.068621 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-380a30fd-49a4-4aab-9e1a-d6bc1d8b0740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:42:46.133044 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1170/2352] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:42:46 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:42:53.284526 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76223a16-2d6f-45ba-b212-553c7a9917ec admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:42:53.286242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-76223a16-2d6f-45ba-b212-553c7a9917ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:42:53.352317 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76223a16-2d6f-45ba-b212-553c7a9917ec admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:42:53.355863 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf2d92-d2ca-4bf0-8cc0-4a1a8adf4be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:42:53.356502 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf2d92-d2ca-4bf0-8cc0-4a1a8adf4be5 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:42:53.356784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf2d92-d2ca-4bf0-8cc0-4a1a8adf4be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:42:53.357059 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf2d92-d2ca-4bf0-8cc0-4a1a8adf4be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:42:53.358842 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-09bf2d92-d2ca-4bf0-8cc0-4a1a8adf4be5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:42:53.424982 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf2d92-d2ca-4bf0-8cc0-4a1a8adf4be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:42:53.426451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf2d92-d2ca-4bf0-8cc0-4a1a8adf4be5 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:42:53.437477 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1183/2353] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:42:53 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:43:37.100170 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a30fd-49a4-4aab-9e1a-d6bc1d8b0740 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:43:37.101627 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-380a30fd-49a4-4aab-9e1a-d6bc1d8b0740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:43:37.116647 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380a30fd-49a4-4aab-9e1a-d6bc1d8b0740 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:43:37.121932 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3093561-d79b-4ce8-87d6-87bf91a72f6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:43:37.122568 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3093561-d79b-4ce8-87d6-87bf91a72f6c service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:43:37.122845 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3093561-d79b-4ce8-87d6-87bf91a72f6c service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:43:37.123117 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3093561-d79b-4ce8-87d6-87bf91a72f6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:43:37.124801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d3093561-d79b-4ce8-87d6-87bf91a72f6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:43:37.199459 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3093561-d79b-4ce8-87d6-87bf91a72f6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:43:37.201038 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3093561-d79b-4ce8-87d6-87bf91a72f6c service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:43:37.210292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1171/2354] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:43:37 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:44:40.741519 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf2d92-d2ca-4bf0-8cc0-4a1a8adf4be5 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:44:40.742922 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-09bf2d92-d2ca-4bf0-8cc0-4a1a8adf4be5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:44:40.810726 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf2d92-d2ca-4bf0-8cc0-4a1a8adf4be5 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:44:40.814818 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52729b-c09e-44e2-8174-259dfc7a7ac3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:44:40.815455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52729b-c09e-44e2-8174-259dfc7a7ac3 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:44:40.815731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52729b-c09e-44e2-8174-259dfc7a7ac3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:44:40.816000 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52729b-c09e-44e2-8174-259dfc7a7ac3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:44:40.817858 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-fa52729b-c09e-44e2-8174-259dfc7a7ac3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:44:40.894468 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52729b-c09e-44e2-8174-259dfc7a7ac3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:44:40.895816 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52729b-c09e-44e2-8174-259dfc7a7ac3 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:44:40.913642 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1184/2355] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:44:40 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:44:41.303110 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3093561-d79b-4ce8-87d6-87bf91a72f6c service nova] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:44:41.304650 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d3093561-d79b-4ce8-87d6-87bf91a72f6c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:44:41.316047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3093561-d79b-4ce8-87d6-87bf91a72f6c service nova] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:44:41.319636 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8749d52-17d5-4992-a502-35153d1b8dbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:44:41.320261 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8749d52-17d5-4992-a502-35153d1b8dbf service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:44:41.320541 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8749d52-17d5-4992-a502-35153d1b8dbf service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:44:41.320815 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8749d52-17d5-4992-a502-35153d1b8dbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:44:41.330068 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8749d52-17d5-4992-a502-35153d1b8dbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:44:41.331531 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8749d52-17d5-4992-a502-35153d1b8dbf service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:44:41.340904 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1172/2356] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:44:41 2021] GET /identity/v3/auth/tokens => generated 3490 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:44:58.712326 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52729b-c09e-44e2-8174-259dfc7a7ac3 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:44:58.713738 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-fa52729b-c09e-44e2-8174-259dfc7a7ac3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:44:58.725214 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52729b-c09e-44e2-8174-259dfc7a7ac3 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:44:58.728775 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32464a41-0874-4a2f-9d4e-7920b1795282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:44:58.729405 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32464a41-0874-4a2f-9d4e-7920b1795282 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:44:58.729689 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32464a41-0874-4a2f-9d4e-7920b1795282 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:44:58.730001 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32464a41-0874-4a2f-9d4e-7920b1795282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:44:58.731723 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-32464a41-0874-4a2f-9d4e-7920b1795282 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:44:58.741155 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32464a41-0874-4a2f-9d4e-7920b1795282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:44:58.742599 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32464a41-0874-4a2f-9d4e-7920b1795282 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:44:58.750257 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1185/2357] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:44:58 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:45:21.069462 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8749d52-17d5-4992-a502-35153d1b8dbf service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:45:21.078594 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8749d52-17d5-4992-a502-35153d1b8dbf service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:45:21.082718 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2dfb7-50d7-4237-a48f-10a7fecadfb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:45:21.083343 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2dfb7-50d7-4237-a48f-10a7fecadfb1 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:45:21.083626 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2dfb7-50d7-4237-a48f-10a7fecadfb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:45:21.083903 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf2dfb7-50d7-4237-a48f-10a7fecadfb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:45:21.085662 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-dbf2dfb7-50d7-4237-a48f-10a7fecadfb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:45:21.100007 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2dfb7-50d7-4237-a48f-10a7fecadfb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:45:21.101424 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf2dfb7-50d7-4237-a48f-10a7fecadfb1 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:45:21.112360 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1173/2358] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:45:21 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:46:41.535209 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32464a41-0874-4a2f-9d4e-7920b1795282 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:41.544124 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32464a41-0874-4a2f-9d4e-7920b1795282 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:41.547608 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8d5b1-a076-4cc2-9203-73ac8b5f6018 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:41.548228 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8d5b1-a076-4cc2-9203-73ac8b5f6018 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:41.548504 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8d5b1-a076-4cc2-9203-73ac8b5f6018 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:41.548772 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8d5b1-a076-4cc2-9203-73ac8b5f6018 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:41.550504 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-83e8d5b1-a076-4cc2-9203-73ac8b5f6018 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:41.626552 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8d5b1-a076-4cc2-9203-73ac8b5f6018 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:41.628523 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8d5b1-a076-4cc2-9203-73ac8b5f6018 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:41.646772 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1186/2359] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:46:41 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:46:41.686909 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2dfb7-50d7-4237-a48f-10a7fecadfb1 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:41.696439 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf2dfb7-50d7-4237-a48f-10a7fecadfb1 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:41.700044 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14f99b-d784-40ff-84d7-abc038740709 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:41.700664 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14f99b-d784-40ff-84d7-abc038740709 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:41.700942 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14f99b-d784-40ff-84d7-abc038740709 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:41.701210 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b14f99b-d784-40ff-84d7-abc038740709 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:41.703008 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3b14f99b-d784-40ff-84d7-abc038740709 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:41.780707 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14f99b-d784-40ff-84d7-abc038740709 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:41.782187 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b14f99b-d784-40ff-84d7-abc038740709 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:41.801144 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1174/2360] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:46:41 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:46:45.926627 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af915f-f51d-4e0f-b2f9-cb048eafeefb None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:45.927654 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af915f-f51d-4e0f-b2f9-cb048eafeefb None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:45.927778 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af915f-f51d-4e0f-b2f9-cb048eafeefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:45.992380 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e9af915f-f51d-4e0f-b2f9-cb048eafeefb None None] MFA Rules not processed for user `8719b276102043fda5c941da84654009`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:45.995362 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e9af915f-f51d-4e0f-b2f9-cb048eafeefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:46.017639 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1187/2361] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:45 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:46:46.030440 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14f99b-d784-40ff-84d7-abc038740709 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:46.138151 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b14f99b-d784-40ff-84d7-abc038740709 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:46.142869 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a2ee48-5f37-465f-bd27-596c87332cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:46.143733 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2ee48-5f37-465f-bd27-596c87332cbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:46.144266 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2ee48-5f37-465f-bd27-596c87332cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:46.144547 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a2ee48-5f37-465f-bd27-596c87332cbf admin admin] PATH_INFO: `/v3/users/df32a8dae7524f90bfab095bdc5b3236` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:46.146054 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2ee48-5f37-465f-bd27-596c87332cbf admin admin] RBAC: Authorizing `identity:delete_user(user_id=df32a8dae7524f90bfab095bdc5b3236)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:46.148136 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a2ee48-5f37-465f-bd27-596c87332cbf admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:46.222285 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d5a2ee48-5f37-465f-bd27-596c87332cbf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df32a8dae7524f90bfab095bdc5b3236'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:46.237481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d5a2ee48-5f37-465f-bd27-596c87332cbf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df32a8dae7524f90bfab095bdc5b3236'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:46.247549 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d5a2ee48-5f37-465f-bd27-596c87332cbf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df32a8dae7524f90bfab095bdc5b3236'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:46.248278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d5a2ee48-5f37-465f-bd27-596c87332cbf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df32a8dae7524f90bfab095bdc5b3236'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:46.278818 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d5a2ee48-5f37-465f-bd27-596c87332cbf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df32a8dae7524f90bfab095bdc5b3236'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:46.283343 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af915f-f51d-4e0f-b2f9-cb048eafeefb None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:46.290448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1175/2362] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:46:46 2021] DELETE /identity/v3/users/df32a8dae7524f90bfab095bdc5b3236 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:46:46.294921 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464e34-69f9-496d-8d93-ab653912cdeb None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:46.295259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464e34-69f9-496d-8d93-ab653912cdeb None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:46.296060 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e464e34-69f9-496d-8d93-ab653912cdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:46.300408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af915f-f51d-4e0f-b2f9-cb048eafeefb None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:46.359441 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-4e464e34-69f9-496d-8d93-ab653912cdeb None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:46.360817 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-4e464e34-69f9-496d-8d93-ab653912cdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:46.384408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94222c2b-67c5-4557-97a5-fa29a5d9d10e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:46.385486 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94222c2b-67c5-4557-97a5-fa29a5d9d10e service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:46.386045 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94222c2b-67c5-4557-97a5-fa29a5d9d10e service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:46.386937 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94222c2b-67c5-4557-97a5-fa29a5d9d10e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:46.390082 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-94222c2b-67c5-4557-97a5-fa29a5d9d10e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:46.472243 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1176/2363] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:46:46.476408 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e464e34-69f9-496d-8d93-ab653912cdeb None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:46.476408 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-4e464e34-69f9-496d-8d93-ab653912cdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:46.539016 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94222c2b-67c5-4557-97a5-fa29a5d9d10e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:46.540409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94222c2b-67c5-4557-97a5-fa29a5d9d10e service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:46.546814 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e464e34-69f9-496d-8d93-ab653912cdeb None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:46.550711 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a203ad7-d4ad-4025-b8a4-2289111eb847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:46.551353 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a203ad7-d4ad-4025-b8a4-2289111eb847 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:46.551668 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a203ad7-d4ad-4025-b8a4-2289111eb847 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:46.551949 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a203ad7-d4ad-4025-b8a4-2289111eb847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:46.553792 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-9a203ad7-d4ad-4025-b8a4-2289111eb847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:46.563463 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a203ad7-d4ad-4025-b8a4-2289111eb847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:46.564900 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a203ad7-d4ad-4025-b8a4-2289111eb847 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:46.570472 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1188/2364] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:46:46 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:46:46.571322 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94222c2b-67c5-4557-97a5-fa29a5d9d10e service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:46.574606 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1177/2365] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:46:46 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:46:46.591202 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94222c2b-67c5-4557-97a5-fa29a5d9d10e service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:46.603644 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6b186-df8f-4343-bc3f-eabe04d91599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:46.604541 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6b186-df8f-4343-bc3f-eabe04d91599 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:46.604859 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6b186-df8f-4343-bc3f-eabe04d91599 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:46.605343 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6b186-df8f-4343-bc3f-eabe04d91599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:46.617384 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6b186-df8f-4343-bc3f-eabe04d91599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:46.619023 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6b186-df8f-4343-bc3f-eabe04d91599 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:46.632626 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1189/2366] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:46:46 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:46:47.149023 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a203ad7-d4ad-4025-b8a4-2289111eb847 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:47.150563 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-9a203ad7-d4ad-4025-b8a4-2289111eb847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:47.164411 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a203ad7-d4ad-4025-b8a4-2289111eb847 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:47.169709 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e370a17-68a9-469f-9243-5cead83179d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:47.171359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e370a17-68a9-469f-9243-5cead83179d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:47.171644 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e370a17-68a9-469f-9243-5cead83179d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:47.171917 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e370a17-68a9-469f-9243-5cead83179d0 admin admin] PATH_INFO: `/v3/projects/2802ef25f02748c491d55a7b1abf557a` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:47.173217 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e370a17-68a9-469f-9243-5cead83179d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2802ef25f02748c491d55a7b1abf557a)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:47.175265 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e370a17-68a9-469f-9243-5cead83179d0 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:47.250663 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-6e370a17-68a9-469f-9243-5cead83179d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2802ef25f02748c491d55a7b1abf557a', 'request_id': 'req-6e370a17-68a9-469f-9243-5cead83179d0'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:47.257875 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-6e370a17-68a9-469f-9243-5cead83179d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2802ef25f02748c491d55a7b1abf557a', 'request_id': 'req-6e370a17-68a9-469f-9243-5cead83179d0'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:47.267398 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-6e370a17-68a9-469f-9243-5cead83179d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2802ef25f02748c491d55a7b1abf557a', 'request_id': 'req-6e370a17-68a9-469f-9243-5cead83179d0'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:47.272802 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6b186-df8f-4343-bc3f-eabe04d91599 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:47.274242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-eff6b186-df8f-4343-bc3f-eabe04d91599 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:47.281156 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-6e370a17-68a9-469f-9243-5cead83179d0 admin admin] The token cache is being invalidate because project 2802ef25f02748c491d55a7b1abf557a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:46:47.281441 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-6e370a17-68a9-469f-9243-5cead83179d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:47.282109 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-6e370a17-68a9-469f-9243-5cead83179d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:47.283983 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1178/2367] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:46:47 2021] DELETE /identity/v3/projects/2802ef25f02748c491d55a7b1abf557a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:46:47.287433 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e370a17-68a9-469f-9243-5cead83179d0 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:47.288872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-6e370a17-68a9-469f-9243-5cead83179d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:47.359502 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6b186-df8f-4343-bc3f-eabe04d91599 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:47.360379 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e370a17-68a9-469f-9243-5cead83179d0 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:47.366645 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b4a53-7e9f-42d9-a56a-a48e2aec8d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:47.367602 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b4a53-7e9f-42d9-a56a-a48e2aec8d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:47.367962 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b4a53-7e9f-42d9-a56a-a48e2aec8d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:47.368315 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4b4a53-7e9f-42d9-a56a-a48e2aec8d8e admin admin] PATH_INFO: `/v3/users/12aa9ed7eece4aa7ad573581002d83e2` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:47.369610 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b4a53-7e9f-42d9-a56a-a48e2aec8d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=12aa9ed7eece4aa7ad573581002d83e2)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:47.371583 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4b4a53-7e9f-42d9-a56a-a48e2aec8d8e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:47.424392 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-9c4b4a53-7e9f-42d9-a56a-a48e2aec8d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12aa9ed7eece4aa7ad573581002d83e2'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:47.434521 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-9c4b4a53-7e9f-42d9-a56a-a48e2aec8d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12aa9ed7eece4aa7ad573581002d83e2'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:47.439015 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8405d48-371f-4b69-90ba-261e501572d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:47.439671 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8405d48-371f-4b69-90ba-261e501572d1 service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:47.439951 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8405d48-371f-4b69-90ba-261e501572d1 service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:47.440224 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8405d48-371f-4b69-90ba-261e501572d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:47.441801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-9c4b4a53-7e9f-42d9-a56a-a48e2aec8d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12aa9ed7eece4aa7ad573581002d83e2'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:47.442002 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a8405d48-371f-4b69-90ba-261e501572d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:47.442531 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-9c4b4a53-7e9f-42d9-a56a-a48e2aec8d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12aa9ed7eece4aa7ad573581002d83e2'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:47.454008 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8405d48-371f-4b69-90ba-261e501572d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:47.454312 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-9c4b4a53-7e9f-42d9-a56a-a48e2aec8d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12aa9ed7eece4aa7ad573581002d83e2'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:47.455584 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8405d48-371f-4b69-90ba-261e501572d1 service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:47.460851 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1179/2368] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:46:47 2021] DELETE /identity/v3/users/12aa9ed7eece4aa7ad573581002d83e2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:46:47.466622 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1190/2369] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:46:47 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:46:47.575115 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b4a53-7e9f-42d9-a56a-a48e2aec8d8e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:47.576551 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-9c4b4a53-7e9f-42d9-a56a-a48e2aec8d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:47.638550 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4b4a53-7e9f-42d9-a56a-a48e2aec8d8e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:47.642476 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e6512-69fb-4a7a-a27c-275ff7f37eb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:47.642938 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e6512-69fb-4a7a-a27c-275ff7f37eb8 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:47.643220 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e6512-69fb-4a7a-a27c-275ff7f37eb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:47.643493 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e6512-69fb-4a7a-a27c-275ff7f37eb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:47.645429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-9f7e6512-69fb-4a7a-a27c-275ff7f37eb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:47.711067 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e6512-69fb-4a7a-a27c-275ff7f37eb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:47.712916 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e6512-69fb-4a7a-a27c-275ff7f37eb8 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:47.725445 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1180/2370] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:46:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:46:47.744176 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8405d48-371f-4b69-90ba-261e501572d1 service nova] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:47.779031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8405d48-371f-4b69-90ba-261e501572d1 service nova] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:47.785754 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e3374-46da-44f5-b98b-12b3d382edaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:47.787882 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e3374-46da-44f5-b98b-12b3d382edaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:47.788341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e3374-46da-44f5-b98b-12b3d382edaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:47.788771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e3374-46da-44f5-b98b-12b3d382edaf admin admin] PATH_INFO: `/v3/projects/319b81c7fe004b42ac5c365c83dadbdf` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:47.790282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e3374-46da-44f5-b98b-12b3d382edaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=319b81c7fe004b42ac5c365c83dadbdf)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:47.792689 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e3374-46da-44f5-b98b-12b3d382edaf admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:47.869788 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ac4e3374-46da-44f5-b98b-12b3d382edaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '319b81c7fe004b42ac5c365c83dadbdf', 'request_id': 'req-ac4e3374-46da-44f5-b98b-12b3d382edaf'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:47.878438 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ac4e3374-46da-44f5-b98b-12b3d382edaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '319b81c7fe004b42ac5c365c83dadbdf', 'request_id': 'req-ac4e3374-46da-44f5-b98b-12b3d382edaf'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:47.891453 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ac4e3374-46da-44f5-b98b-12b3d382edaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '319b81c7fe004b42ac5c365c83dadbdf', 'request_id': 'req-ac4e3374-46da-44f5-b98b-12b3d382edaf'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:47.907237 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ac4e3374-46da-44f5-b98b-12b3d382edaf admin admin] The token cache is being invalidate because project 319b81c7fe004b42ac5c365c83dadbdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:46:47.907739 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ac4e3374-46da-44f5-b98b-12b3d382edaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:47.909045 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ac4e3374-46da-44f5-b98b-12b3d382edaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:47.910679 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1191/2371] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:46:47 2021] DELETE /identity/v3/projects/319b81c7fe004b42ac5c365c83dadbdf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:46:47.919690 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f478aa-4b02-4496-9d38-90bac1f1afa0 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:47.920289 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f478aa-4b02-4496-9d38-90bac1f1afa0 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:47.920598 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f478aa-4b02-4496-9d38-90bac1f1afa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:47.967120 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-c4f478aa-4b02-4496-9d38-90bac1f1afa0 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:47.968356 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-c4f478aa-4b02-4496-9d38-90bac1f1afa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:48.027867 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1181/2372] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:46:48.035980 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19879e-2f07-4fd9-9d23-175311f340a9 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:48.036869 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19879e-2f07-4fd9-9d23-175311f340a9 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:48.037494 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef19879e-2f07-4fd9-9d23-175311f340a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:48.061711 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-ef19879e-2f07-4fd9-9d23-175311f340a9 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:48.063378 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ef19879e-2f07-4fd9-9d23-175311f340a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:48.075539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1192/2373] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:46:48.079417 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f478aa-4b02-4496-9d38-90bac1f1afa0 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:48.083533 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19879e-2f07-4fd9-9d23-175311f340a9 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:48.085647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ef19879e-2f07-4fd9-9d23-175311f340a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:48.092195 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f478aa-4b02-4496-9d38-90bac1f1afa0 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:48.097652 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082604f-bd8d-4255-931f-9c41c3267f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:48.100389 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082604f-bd8d-4255-931f-9c41c3267f34 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:48.100389 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082604f-bd8d-4255-931f-9c41c3267f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:48.100389 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082604f-bd8d-4255-931f-9c41c3267f34 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:48.100757 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082604f-bd8d-4255-931f-9c41c3267f34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:46:48.101053 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082604f-bd8d-4255-931f-9c41c3267f34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:48.114861 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082604f-bd8d-4255-931f-9c41c3267f34 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:48.146173 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1182/2374] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:46:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:46:48.148602 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082604f-bd8d-4255-931f-9c41c3267f34 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:48.160629 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082604f-bd8d-4255-931f-9c41c3267f34 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:48.168996 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b2b0d-3cf2-4a49-b807-f5448405a0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:48.169788 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b2b0d-3cf2-4a49-b807-f5448405a0bd admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:48.170115 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b2b0d-3cf2-4a49-b807-f5448405a0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:48.170397 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b2b0d-3cf2-4a49-b807-f5448405a0bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:48.171110 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b2b0d-3cf2-4a49-b807-f5448405a0bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:48.173015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b2b0d-3cf2-4a49-b807-f5448405a0bd admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:48.191954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef19879e-2f07-4fd9-9d23-175311f340a9 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:48.199777 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ed8e1-c007-4491-bbd7-7307ce327d45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:48.200650 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ed8e1-c007-4491-bbd7-7307ce327d45 service placement] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:48.200927 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ed8e1-c007-4491-bbd7-7307ce327d45 service placement] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:48.201172 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ed8e1-c007-4491-bbd7-7307ce327d45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:48.203336 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-416ed8e1-c007-4491-bbd7-7307ce327d45 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:48.215903 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1183/2375] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:46:48 2021] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:46:48.217377 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b2b0d-3cf2-4a49-b807-f5448405a0bd admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:48.217540 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ed8e1-c007-4491-bbd7-7307ce327d45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:48.219033 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ed8e1-c007-4491-bbd7-7307ce327d45 service placement] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:48.230206 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1193/2376] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:46:48 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:46:48.291437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b2b0d-3cf2-4a49-b807-f5448405a0bd admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:48.296786 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36578dfa-a289-4c1f-bf83-d7987580d6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:48.297578 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36578dfa-a289-4c1f-bf83-d7987580d6bb admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:48.297955 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36578dfa-a289-4c1f-bf83-d7987580d6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:48.298321 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36578dfa-a289-4c1f-bf83-d7987580d6bb admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:48.299241 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36578dfa-a289-4c1f-bf83-d7987580d6bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:48.301407 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36578dfa-a289-4c1f-bf83-d7987580d6bb admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:48.323745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1184/2377] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:46:48 2021] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:46:48.328583 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ed8e1-c007-4491-bbd7-7307ce327d45 service placement] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:48.339746 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ed8e1-c007-4491-bbd7-7307ce327d45 service placement] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:48.345607 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4941e-bfde-4ad3-a46e-e6cc814eabb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:48.346572 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4941e-bfde-4ad3-a46e-e6cc814eabb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:48.346855 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4941e-bfde-4ad3-a46e-e6cc814eabb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:48.347128 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4941e-bfde-4ad3-a46e-e6cc814eabb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:48.347861 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4941e-bfde-4ad3-a46e-e6cc814eabb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:48.349483 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4941e-bfde-4ad3-a46e-e6cc814eabb6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:48.359868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1194/2378] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:46:48 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:46:48.366627 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36578dfa-a289-4c1f-bf83-d7987580d6bb admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:48.381707 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36578dfa-a289-4c1f-bf83-d7987580d6bb admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:48.386980 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6729a795-47af-4002-917c-18efa94bf678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:48.387641 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729a795-47af-4002-917c-18efa94bf678 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:48.387933 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729a795-47af-4002-917c-18efa94bf678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:48.388196 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6729a795-47af-4002-917c-18efa94bf678 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:48.388936 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729a795-47af-4002-917c-18efa94bf678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:48.390547 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6729a795-47af-4002-917c-18efa94bf678 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:48.404780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1185/2379] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:46:48 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:46:48.405961 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4941e-bfde-4ad3-a46e-e6cc814eabb6 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:48.417287 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4941e-bfde-4ad3-a46e-e6cc814eabb6 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:48.422945 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73cb22-8c0d-4a6a-aa1f-351d31da648c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:48.423974 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73cb22-8c0d-4a6a-aa1f-351d31da648c admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:48.424369 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73cb22-8c0d-4a6a-aa1f-351d31da648c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:48.424623 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d73cb22-8c0d-4a6a-aa1f-351d31da648c admin admin] PATH_INFO: `/v3/projects/273704d2b4d54bb9ab20fa44c613d102/users/886cb29d232b408baa782175438a2755/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:48.440763 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73cb22-8c0d-4a6a-aa1f-351d31da648c admin admin] RBAC: Authorizing `identity:create_grant(project_id=273704d2b4d54bb9ab20fa44c613d102, user_id=886cb29d232b408baa782175438a2755, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:48.444022 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d73cb22-8c0d-4a6a-aa1f-351d31da648c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:48.459505 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1195/2380] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:46:48 2021] PUT /identity/v3/projects/273704d2b4d54bb9ab20fa44c613d102/users/886cb29d232b408baa782175438a2755/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:46:48.469859 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0337b-c185-4311-9423-05edcd673e1d None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:48.470184 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0337b-c185-4311-9423-05edcd673e1d None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:48.470465 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0337b-c185-4311-9423-05edcd673e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:48.503737 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-0eb0337b-c185-4311-9423-05edcd673e1d None None] MFA Rules not processed for user `886cb29d232b408baa782175438a2755`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:48.505589 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-0eb0337b-c185-4311-9423-05edcd673e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:48.593886 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1186/2381] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:48 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:46:48.605213 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73cb22-8c0d-4a6a-aa1f-351d31da648c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:48.607001 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-9d73cb22-8c0d-4a6a-aa1f-351d31da648c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:48.672657 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d73cb22-8c0d-4a6a-aa1f-351d31da648c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:48.679162 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a8c2f-cd47-4b51-8644-c2497b33871f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:48.679839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a8c2f-cd47-4b51-8644-c2497b33871f service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:48.680121 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a8c2f-cd47-4b51-8644-c2497b33871f service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:48.680394 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a8c2f-cd47-4b51-8644-c2497b33871f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:48.691075 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a8c2f-cd47-4b51-8644-c2497b33871f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:48.693123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a8c2f-cd47-4b51-8644-c2497b33871f service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:48.704728 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1196/2382] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:46:48 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:46:48.931224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0337b-c185-4311-9423-05edcd673e1d None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:48.932943 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-0eb0337b-c185-4311-9423-05edcd673e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:49.006300 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0337b-c185-4311-9423-05edcd673e1d None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:49.011666 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5dd39-657d-4ddc-80d7-2d61bf0461d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:49.012675 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5dd39-657d-4ddc-80d7-2d61bf0461d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:49.013026 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5dd39-657d-4ddc-80d7-2d61bf0461d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:49.013401 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5dd39-657d-4ddc-80d7-2d61bf0461d6 admin admin] PATH_INFO: `/v3/users/78248dce6b754687b48f306bcbf8cdb9` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:49.015030 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5dd39-657d-4ddc-80d7-2d61bf0461d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78248dce6b754687b48f306bcbf8cdb9)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:49.018337 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5dd39-657d-4ddc-80d7-2d61bf0461d6 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:49.070949 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b0f5dd39-657d-4ddc-80d7-2d61bf0461d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78248dce6b754687b48f306bcbf8cdb9'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:49.079515 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b0f5dd39-657d-4ddc-80d7-2d61bf0461d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78248dce6b754687b48f306bcbf8cdb9'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:49.087466 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b0f5dd39-657d-4ddc-80d7-2d61bf0461d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78248dce6b754687b48f306bcbf8cdb9'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:49.088142 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b0f5dd39-657d-4ddc-80d7-2d61bf0461d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78248dce6b754687b48f306bcbf8cdb9'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:49.104461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-b0f5dd39-657d-4ddc-80d7-2d61bf0461d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78248dce6b754687b48f306bcbf8cdb9'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:49.113015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1187/2383] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:46:48 2021] DELETE /identity/v3/users/78248dce6b754687b48f306bcbf8cdb9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:46:49.117887 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205a4ea-25ca-4282-b701-e0ca41e09423 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:49.118200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205a4ea-25ca-4282-b701-e0ca41e09423 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:49.118672 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4205a4ea-25ca-4282-b701-e0ca41e09423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:49.139952 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-4205a4ea-25ca-4282-b701-e0ca41e09423 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:49.141736 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4205a4ea-25ca-4282-b701-e0ca41e09423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:49.217345 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1197/2384] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:46:49.284057 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5dd39-657d-4ddc-80d7-2d61bf0461d6 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:49.285408 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-b0f5dd39-657d-4ddc-80d7-2d61bf0461d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:49.352535 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5dd39-657d-4ddc-80d7-2d61bf0461d6 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:49.356435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f146ee-414c-4b7f-a42f-948cd17d4f1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:49.357082 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f146ee-414c-4b7f-a42f-948cd17d4f1d service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:49.357359 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f146ee-414c-4b7f-a42f-948cd17d4f1d service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:49.357628 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f146ee-414c-4b7f-a42f-948cd17d4f1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:49.367778 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f146ee-414c-4b7f-a42f-948cd17d4f1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:49.369211 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f146ee-414c-4b7f-a42f-948cd17d4f1d service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:49.380722 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1188/2385] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:46:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:46:49.940417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205a4ea-25ca-4282-b701-e0ca41e09423 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:49.942501 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4205a4ea-25ca-4282-b701-e0ca41e09423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:49.963165 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4205a4ea-25ca-4282-b701-e0ca41e09423 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:49.968934 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfbd4b-3912-410f-823f-fee967a5b809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:49.971160 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfbd4b-3912-410f-823f-fee967a5b809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:49.971790 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfbd4b-3912-410f-823f-fee967a5b809 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:49.972388 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfbd4b-3912-410f-823f-fee967a5b809 admin admin] PATH_INFO: `/v3/projects/be88dec6e0fd4a54a18c3e94fe8f370a` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:49.976758 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfbd4b-3912-410f-823f-fee967a5b809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be88dec6e0fd4a54a18c3e94fe8f370a)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:49.979247 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfbd4b-3912-410f-823f-fee967a5b809 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:50.051967 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-6fdfbd4b-3912-410f-823f-fee967a5b809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be88dec6e0fd4a54a18c3e94fe8f370a', 'request_id': 'req-6fdfbd4b-3912-410f-823f-fee967a5b809'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:50.060862 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-6fdfbd4b-3912-410f-823f-fee967a5b809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be88dec6e0fd4a54a18c3e94fe8f370a', 'request_id': 'req-6fdfbd4b-3912-410f-823f-fee967a5b809'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:50.071073 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-6fdfbd4b-3912-410f-823f-fee967a5b809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be88dec6e0fd4a54a18c3e94fe8f370a', 'request_id': 'req-6fdfbd4b-3912-410f-823f-fee967a5b809'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:50.087801 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-6fdfbd4b-3912-410f-823f-fee967a5b809 admin admin] The token cache is being invalidate because project be88dec6e0fd4a54a18c3e94fe8f370a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:46:50.088372 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-6fdfbd4b-3912-410f-823f-fee967a5b809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:50.090608 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-6fdfbd4b-3912-410f-823f-fee967a5b809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:50.093682 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1198/2386] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:46:49 2021] DELETE /identity/v3/projects/be88dec6e0fd4a54a18c3e94fe8f370a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:46:50.098016 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f146ee-414c-4b7f-a42f-948cd17d4f1d service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:50.113626 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f146ee-414c-4b7f-a42f-948cd17d4f1d service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:50.207219 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc3e70-8c52-4c17-a45c-a275f4c40b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:50.210726 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc3e70-8c52-4c17-a45c-a275f4c40b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:50.210726 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc3e70-8c52-4c17-a45c-a275f4c40b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:50.211171 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc3e70-8c52-4c17-a45c-a275f4c40b69 admin admin] PATH_INFO: `/v3/users/73f3379ced1a4bb3a2cd8599e914ee51` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:50.232370 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc3e70-8c52-4c17-a45c-a275f4c40b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f3379ced1a4bb3a2cd8599e914ee51)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:50.234944 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc3e70-8c52-4c17-a45c-a275f4c40b69 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:50.309189 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-32fc3e70-8c52-4c17-a45c-a275f4c40b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f3379ced1a4bb3a2cd8599e914ee51'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:50.326290 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-32fc3e70-8c52-4c17-a45c-a275f4c40b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f3379ced1a4bb3a2cd8599e914ee51'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:50.336492 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-32fc3e70-8c52-4c17-a45c-a275f4c40b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f3379ced1a4bb3a2cd8599e914ee51'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:50.337213 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-32fc3e70-8c52-4c17-a45c-a275f4c40b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f3379ced1a4bb3a2cd8599e914ee51'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:50.354021 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-32fc3e70-8c52-4c17-a45c-a275f4c40b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f3379ced1a4bb3a2cd8599e914ee51'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:50.361748 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1189/2387] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:46:50 2021] DELETE /identity/v3/users/73f3379ced1a4bb3a2cd8599e914ee51 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:46:50.671601 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfbd4b-3912-410f-823f-fee967a5b809 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:50.673127 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-6fdfbd4b-3912-410f-823f-fee967a5b809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:50.694607 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfbd4b-3912-410f-823f-fee967a5b809 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:50.755221 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0f240-9152-4951-9488-f2f7a3fcd12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:50.756076 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0f240-9152-4951-9488-f2f7a3fcd12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:50.756353 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0f240-9152-4951-9488-f2f7a3fcd12b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:50.756653 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0f240-9152-4951-9488-f2f7a3fcd12b admin admin] PATH_INFO: `/v3/projects/3a235e9ba73c4cba9ec9f6dcd5634938` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:50.769980 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0f240-9152-4951-9488-f2f7a3fcd12b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a235e9ba73c4cba9ec9f6dcd5634938)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:50.773369 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da0f240-9152-4951-9488-f2f7a3fcd12b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:50.818638 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-1da0f240-9152-4951-9488-f2f7a3fcd12b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a235e9ba73c4cba9ec9f6dcd5634938', 'request_id': 'req-1da0f240-9152-4951-9488-f2f7a3fcd12b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:50.824334 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-1da0f240-9152-4951-9488-f2f7a3fcd12b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a235e9ba73c4cba9ec9f6dcd5634938', 'request_id': 'req-1da0f240-9152-4951-9488-f2f7a3fcd12b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:50.832359 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-1da0f240-9152-4951-9488-f2f7a3fcd12b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a235e9ba73c4cba9ec9f6dcd5634938', 'request_id': 'req-1da0f240-9152-4951-9488-f2f7a3fcd12b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:50.844279 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-1da0f240-9152-4951-9488-f2f7a3fcd12b admin admin] The token cache is being invalidate because project 3a235e9ba73c4cba9ec9f6dcd5634938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:46:50.844570 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-1da0f240-9152-4951-9488-f2f7a3fcd12b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:50.845215 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-1da0f240-9152-4951-9488-f2f7a3fcd12b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:50.846779 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1199/2388] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:46:50 2021] DELETE /identity/v3/projects/3a235e9ba73c4cba9ec9f6dcd5634938 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:46:50.850814 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc3e70-8c52-4c17-a45c-a275f4c40b69 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:50.852220 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-32fc3e70-8c52-4c17-a45c-a275f4c40b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:50.874911 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc3e70-8c52-4c17-a45c-a275f4c40b69 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:50.968304 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d9e466-b5b9-424b-88e7-e00462c017d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:50.969204 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9e466-b5b9-424b-88e7-e00462c017d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:50.969491 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9e466-b5b9-424b-88e7-e00462c017d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:50.969854 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d9e466-b5b9-424b-88e7-e00462c017d1 admin admin] PATH_INFO: `/v3/users/45af21285a0243738ba64914bec019f3` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:50.973163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9e466-b5b9-424b-88e7-e00462c017d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45af21285a0243738ba64914bec019f3)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:50.975462 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d9e466-b5b9-424b-88e7-e00462c017d1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:51.045871 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-87d9e466-b5b9-424b-88e7-e00462c017d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45af21285a0243738ba64914bec019f3'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:51.054741 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-87d9e466-b5b9-424b-88e7-e00462c017d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45af21285a0243738ba64914bec019f3'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:51.061716 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-87d9e466-b5b9-424b-88e7-e00462c017d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45af21285a0243738ba64914bec019f3'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:51.062421 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-87d9e466-b5b9-424b-88e7-e00462c017d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45af21285a0243738ba64914bec019f3'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:51.075345 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-87d9e466-b5b9-424b-88e7-e00462c017d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45af21285a0243738ba64914bec019f3'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:51.081663 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1190/2389] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:46:50 2021] DELETE /identity/v3/users/45af21285a0243738ba64914bec019f3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:46:51.374242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0f240-9152-4951-9488-f2f7a3fcd12b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:51.376487 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-1da0f240-9152-4951-9488-f2f7a3fcd12b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:51.420826 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0f240-9152-4951-9488-f2f7a3fcd12b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:51.491731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20cdcd-84fe-485b-8924-cb537447447a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:51.492472 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20cdcd-84fe-485b-8924-cb537447447a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:51.492826 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20cdcd-84fe-485b-8924-cb537447447a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:51.493379 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20cdcd-84fe-485b-8924-cb537447447a admin admin] PATH_INFO: `/v3/projects/3f2c03f43f244687ab2f19327bfc62c2` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:51.494927 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20cdcd-84fe-485b-8924-cb537447447a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f2c03f43f244687ab2f19327bfc62c2)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:51.497892 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20cdcd-84fe-485b-8924-cb537447447a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:51.546365 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-3d20cdcd-84fe-485b-8924-cb537447447a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f2c03f43f244687ab2f19327bfc62c2', 'request_id': 'req-3d20cdcd-84fe-485b-8924-cb537447447a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:51.553121 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-3d20cdcd-84fe-485b-8924-cb537447447a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f2c03f43f244687ab2f19327bfc62c2', 'request_id': 'req-3d20cdcd-84fe-485b-8924-cb537447447a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:51.561486 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-3d20cdcd-84fe-485b-8924-cb537447447a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f2c03f43f244687ab2f19327bfc62c2', 'request_id': 'req-3d20cdcd-84fe-485b-8924-cb537447447a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:51.576546 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-3d20cdcd-84fe-485b-8924-cb537447447a admin admin] The token cache is being invalidate because project 3f2c03f43f244687ab2f19327bfc62c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:46:51.576797 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-3d20cdcd-84fe-485b-8924-cb537447447a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:51.577437 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-3d20cdcd-84fe-485b-8924-cb537447447a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:51.579494 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1200/2390] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:46:51 2021] DELETE /identity/v3/projects/3f2c03f43f244687ab2f19327bfc62c2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:46:51.585857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4699e59-be03-4c6a-b54e-6f153cff4ee1 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:51.586290 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4699e59-be03-4c6a-b54e-6f153cff4ee1 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:51.586542 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4699e59-be03-4c6a-b54e-6f153cff4ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:51.607299 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-f4699e59-be03-4c6a-b54e-6f153cff4ee1 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:51.608514 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-f4699e59-be03-4c6a-b54e-6f153cff4ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:51.677105 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1191/2391] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:46:51.685413 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83e245-eec8-4b7d-b990-45dcf5393c7b None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:51.685616 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83e245-eec8-4b7d-b990-45dcf5393c7b None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:51.685886 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b83e245-eec8-4b7d-b990-45dcf5393c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:51.707254 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-8b83e245-eec8-4b7d-b990-45dcf5393c7b None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:51.709551 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-8b83e245-eec8-4b7d-b990-45dcf5393c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:51.726369 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1201/2392] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:46:51.731331 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4699e59-be03-4c6a-b54e-6f153cff4ee1 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:51.745498 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4699e59-be03-4c6a-b54e-6f153cff4ee1 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:51.755856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026d449-74e2-440b-90e3-b82a26282491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:51.756593 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026d449-74e2-440b-90e3-b82a26282491 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:51.756885 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026d449-74e2-440b-90e3-b82a26282491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:51.757163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6026d449-74e2-440b-90e3-b82a26282491 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:51.758080 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026d449-74e2-440b-90e3-b82a26282491 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:46:51.758389 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026d449-74e2-440b-90e3-b82a26282491 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:51.762916 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6026d449-74e2-440b-90e3-b82a26282491 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:51.783869 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1192/2393] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:46:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:46:51.788894 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83e245-eec8-4b7d-b990-45dcf5393c7b None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:51.798130 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b83e245-eec8-4b7d-b990-45dcf5393c7b None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:51.802882 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20adc6-83ae-4f5a-869c-04f86fbfc8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:51.803659 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20adc6-83ae-4f5a-869c-04f86fbfc8a2 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:51.803945 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20adc6-83ae-4f5a-869c-04f86fbfc8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:51.804219 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20adc6-83ae-4f5a-869c-04f86fbfc8a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:51.804930 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20adc6-83ae-4f5a-869c-04f86fbfc8a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:51.806871 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20adc6-83ae-4f5a-869c-04f86fbfc8a2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:51.835779 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1202/2394] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:46:51 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:46:51.836939 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026d449-74e2-440b-90e3-b82a26282491 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:51.847911 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6026d449-74e2-440b-90e3-b82a26282491 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:51.922645 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72833a4-0743-4109-9532-367c3d91d37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:51.923516 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72833a4-0743-4109-9532-367c3d91d37b admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:51.923896 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72833a4-0743-4109-9532-367c3d91d37b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:51.924271 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72833a4-0743-4109-9532-367c3d91d37b admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:51.925091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72833a4-0743-4109-9532-367c3d91d37b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:51.927284 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72833a4-0743-4109-9532-367c3d91d37b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:51.950166 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1193/2395] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:46:51 2021] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:46:51.951696 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20adc6-83ae-4f5a-869c-04f86fbfc8a2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:51.962565 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20adc6-83ae-4f5a-869c-04f86fbfc8a2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:51.968176 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a089f-e785-40f7-b27f-cf9f812523db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:51.968839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a089f-e785-40f7-b27f-cf9f812523db admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:51.969120 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a089f-e785-40f7-b27f-cf9f812523db admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:51.969393 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462a089f-e785-40f7-b27f-cf9f812523db admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:51.970163 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a089f-e785-40f7-b27f-cf9f812523db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:51.972273 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462a089f-e785-40f7-b27f-cf9f812523db admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:51.982837 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1203/2396] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:46:51 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:46:51.986508 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72833a4-0743-4109-9532-367c3d91d37b admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:51.996789 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72833a4-0743-4109-9532-367c3d91d37b admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:52.002001 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5b0ac-6049-4ec5-ba29-eb9c95afe366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:52.002736 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5b0ac-6049-4ec5-ba29-eb9c95afe366 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:52.003089 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5b0ac-6049-4ec5-ba29-eb9c95afe366 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:52.003439 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5b0ac-6049-4ec5-ba29-eb9c95afe366 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:52.004377 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5b0ac-6049-4ec5-ba29-eb9c95afe366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:52.006588 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5b0ac-6049-4ec5-ba29-eb9c95afe366 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:52.017150 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1194/2397] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:46:51 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:46:52.021928 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a089f-e785-40f7-b27f-cf9f812523db admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:52.031920 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462a089f-e785-40f7-b27f-cf9f812523db admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:52.036585 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e5598-630b-4f34-9b36-6f3675d2cb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:52.037465 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e5598-630b-4f34-9b36-6f3675d2cb1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:52.037748 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e5598-630b-4f34-9b36-6f3675d2cb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:52.038057 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6e5598-630b-4f34-9b36-6f3675d2cb1b admin admin] PATH_INFO: `/v3/projects/1c800d9b8bd64d0b949b9ddd6031a6d2/users/b988f9d7fba841ff9a4af954f862096a/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:52.052775 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e5598-630b-4f34-9b36-6f3675d2cb1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c800d9b8bd64d0b949b9ddd6031a6d2, user_id=b988f9d7fba841ff9a4af954f862096a, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:52.055541 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6e5598-630b-4f34-9b36-6f3675d2cb1b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:52.069508 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1204/2398] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:46:52 2021] PUT /identity/v3/projects/1c800d9b8bd64d0b949b9ddd6031a6d2/users/b988f9d7fba841ff9a4af954f862096a/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:46:52.074627 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67310813-5374-4248-9843-d5012823833a None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:52.074992 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67310813-5374-4248-9843-d5012823833a None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:52.075405 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67310813-5374-4248-9843-d5012823833a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:52.094086 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-67310813-5374-4248-9843-d5012823833a None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:52.095383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-67310813-5374-4248-9843-d5012823833a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:52.154872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1195/2399] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:46:52.165049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e5598-630b-4f34-9b36-6f3675d2cb1b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:52.167638 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ec6e5598-630b-4f34-9b36-6f3675d2cb1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:52.230325 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6e5598-630b-4f34-9b36-6f3675d2cb1b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:52.232302 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a8c3c-c6f1-4da4-89f6-85e5b3ccad9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:52.232954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a8c3c-c6f1-4da4-89f6-85e5b3ccad9d service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:52.233240 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a8c3c-c6f1-4da4-89f6-85e5b3ccad9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:52.233513 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a8c3c-c6f1-4da4-89f6-85e5b3ccad9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:52.245957 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a8c3c-c6f1-4da4-89f6-85e5b3ccad9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:52.246224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67310813-5374-4248-9843-d5012823833a None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:52.247515 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a8c3c-c6f1-4da4-89f6-85e5b3ccad9d service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:52.247729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-67310813-5374-4248-9843-d5012823833a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:52.262002 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67310813-5374-4248-9843-d5012823833a None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:52.262291 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1205/2400] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:46:52 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:46:52.267024 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854cb3ef-be63-4c4a-951a-0ceb1cd660ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:52.267882 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cb3ef-be63-4c4a-951a-0ceb1cd660ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:52.268163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cb3ef-be63-4c4a-951a-0ceb1cd660ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:52.268436 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854cb3ef-be63-4c4a-951a-0ceb1cd660ea admin admin] PATH_INFO: `/v3/users/008bf02d56c44048a48f147490c7b073` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:52.269655 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cb3ef-be63-4c4a-951a-0ceb1cd660ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=008bf02d56c44048a48f147490c7b073)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:52.272182 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854cb3ef-be63-4c4a-951a-0ceb1cd660ea admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:52.325788 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-854cb3ef-be63-4c4a-951a-0ceb1cd660ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '008bf02d56c44048a48f147490c7b073'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:52.333840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-854cb3ef-be63-4c4a-951a-0ceb1cd660ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '008bf02d56c44048a48f147490c7b073'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:52.341204 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-854cb3ef-be63-4c4a-951a-0ceb1cd660ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '008bf02d56c44048a48f147490c7b073'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:52.342241 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-854cb3ef-be63-4c4a-951a-0ceb1cd660ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '008bf02d56c44048a48f147490c7b073'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:52.353678 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-854cb3ef-be63-4c4a-951a-0ceb1cd660ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '008bf02d56c44048a48f147490c7b073'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:52.360068 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1196/2401] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:46:52 2021] DELETE /identity/v3/users/008bf02d56c44048a48f147490c7b073 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:46:52.543631 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a8c3c-c6f1-4da4-89f6-85e5b3ccad9d service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:52.555351 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a8c3c-c6f1-4da4-89f6-85e5b3ccad9d service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:52.635720 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64b244-6670-463a-b269-880742b45678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:52.636748 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64b244-6670-463a-b269-880742b45678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:52.637097 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64b244-6670-463a-b269-880742b45678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:52.637903 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64b244-6670-463a-b269-880742b45678 admin admin] PATH_INFO: `/v3/projects/2b90a2dbd833411d82a0838bb8b7d8d6` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:52.639319 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64b244-6670-463a-b269-880742b45678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b90a2dbd833411d82a0838bb8b7d8d6)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:52.642870 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64b244-6670-463a-b269-880742b45678 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:52.696381 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5c64b244-6670-463a-b269-880742b45678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b90a2dbd833411d82a0838bb8b7d8d6', 'request_id': 'req-5c64b244-6670-463a-b269-880742b45678'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:52.703545 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5c64b244-6670-463a-b269-880742b45678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b90a2dbd833411d82a0838bb8b7d8d6', 'request_id': 'req-5c64b244-6670-463a-b269-880742b45678'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:52.713390 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5c64b244-6670-463a-b269-880742b45678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b90a2dbd833411d82a0838bb8b7d8d6', 'request_id': 'req-5c64b244-6670-463a-b269-880742b45678'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:52.728341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5c64b244-6670-463a-b269-880742b45678 admin admin] The token cache is being invalidate because project 2b90a2dbd833411d82a0838bb8b7d8d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:46:52.728565 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5c64b244-6670-463a-b269-880742b45678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:52.729212 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5c64b244-6670-463a-b269-880742b45678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:52.736275 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1206/2402] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:46:52 2021] DELETE /identity/v3/projects/2b90a2dbd833411d82a0838bb8b7d8d6 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:46:52.738317 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa3815-2157-4941-8316-5d088e700934 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:52.738832 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa3815-2157-4941-8316-5d088e700934 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:52.739647 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fa3815-2157-4941-8316-5d088e700934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:52.760175 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-38fa3815-2157-4941-8316-5d088e700934 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:52.761483 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-38fa3815-2157-4941-8316-5d088e700934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:52.840320 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1197/2403] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:46:52.849092 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b46cee-5d92-4646-8b6d-d3c63535b9a9 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:52.849378 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b46cee-5d92-4646-8b6d-d3c63535b9a9 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:52.849654 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b46cee-5d92-4646-8b6d-d3c63535b9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:52.871650 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-49b46cee-5d92-4646-8b6d-d3c63535b9a9 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:52.872854 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-49b46cee-5d92-4646-8b6d-d3c63535b9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:52.882381 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1207/2404] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:46:52.886781 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa3815-2157-4941-8316-5d088e700934 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:52.897183 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fa3815-2157-4941-8316-5d088e700934 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:52.902217 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d1af3-0347-4268-85c2-e877e431ccf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:52.903137 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d1af3-0347-4268-85c2-e877e431ccf6 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:52.903875 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d1af3-0347-4268-85c2-e877e431ccf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:52.904368 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d1af3-0347-4268-85c2-e877e431ccf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:52.905615 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d1af3-0347-4268-85c2-e877e431ccf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:46:52.906179 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d1af3-0347-4268-85c2-e877e431ccf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:52.908369 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d1af3-0347-4268-85c2-e877e431ccf6 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:52.922199 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1198/2405] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:46:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:46:52.934702 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b46cee-5d92-4646-8b6d-d3c63535b9a9 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:52.935501 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c29b29-22ae-4b37-bfe5-d834f1eb4d28 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:52.936140 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c29b29-22ae-4b37-bfe5-d834f1eb4d28 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:52.936649 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c29b29-22ae-4b37-bfe5-d834f1eb4d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:52.943752 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b46cee-5d92-4646-8b6d-d3c63535b9a9 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:52.949172 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f339817-b4aa-49b1-8eb8-29867ec112e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:52.949831 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f339817-b4aa-49b1-8eb8-29867ec112e4 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:52.950141 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f339817-b4aa-49b1-8eb8-29867ec112e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:52.950415 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f339817-b4aa-49b1-8eb8-29867ec112e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:52.951110 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f339817-b4aa-49b1-8eb8-29867ec112e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:52.953002 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f339817-b4aa-49b1-8eb8-29867ec112e4 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:52.969121 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-a1c29b29-22ae-4b37-bfe5-d834f1eb4d28 None None] MFA Rules not processed for user `b988f9d7fba841ff9a4af954f862096a`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:52.970455 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a1c29b29-22ae-4b37-bfe5-d834f1eb4d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:52.983030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1208/2406] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:46:52 2021] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:46:52.986896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f339817-b4aa-49b1-8eb8-29867ec112e4 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:53.046976 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1199/2407] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:52 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:46:53.051100 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f339817-b4aa-49b1-8eb8-29867ec112e4 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:53.055959 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ccbab-3532-4391-8437-4e7557de58d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:53.056852 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ccbab-3532-4391-8437-4e7557de58d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:53.057011 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ccbab-3532-4391-8437-4e7557de58d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:53.057165 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ccbab-3532-4391-8437-4e7557de58d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:53.057876 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ccbab-3532-4391-8437-4e7557de58d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:53.058216 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c29b29-22ae-4b37-bfe5-d834f1eb4d28 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:53.059711 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a1c29b29-22ae-4b37-bfe5-d834f1eb4d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:53.059843 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ccbab-3532-4391-8437-4e7557de58d4 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:53.080315 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1209/2408] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:46:52 2021] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:46:53.084783 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ccbab-3532-4391-8437-4e7557de58d4 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:53.095822 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ccbab-3532-4391-8437-4e7557de58d4 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:53.102190 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de595059-672c-4408-982c-bca6e56c9d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:53.103755 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de595059-672c-4408-982c-bca6e56c9d07 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:53.104042 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de595059-672c-4408-982c-bca6e56c9d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:53.104313 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de595059-672c-4408-982c-bca6e56c9d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:53.105341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de595059-672c-4408-982c-bca6e56c9d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:53.106678 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de595059-672c-4408-982c-bca6e56c9d07 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:53.119140 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1210/2409] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:46:53 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:46:53.122958 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de595059-672c-4408-982c-bca6e56c9d07 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:53.128253 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c29b29-22ae-4b37-bfe5-d834f1eb4d28 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:53.132894 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de595059-672c-4408-982c-bca6e56c9d07 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:53.139069 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2ee05-c112-480d-b38f-07e798eacfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:53.139983 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2ee05-c112-480d-b38f-07e798eacfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:53.140435 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2ee05-c112-480d-b38f-07e798eacfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:53.140892 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2ee05-c112-480d-b38f-07e798eacfd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:53.141637 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2ee05-c112-480d-b38f-07e798eacfd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:53.143278 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2ee05-c112-480d-b38f-07e798eacfd5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:53.154542 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1211/2410] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:46:53 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:46:53.158231 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2ee05-c112-480d-b38f-07e798eacfd5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:53.169031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2ee05-c112-480d-b38f-07e798eacfd5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:53.174034 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e39100-6d96-4730-92b2-7e227484c678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:53.174971 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e39100-6d96-4730-92b2-7e227484c678 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:53.175312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e39100-6d96-4730-92b2-7e227484c678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:53.175647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e39100-6d96-4730-92b2-7e227484c678 admin admin] PATH_INFO: `/v3/projects/0773aeed36524a539b758362ebe5493c/users/1a67a6ab054649b3bd760d088c791d2a/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:53.181876 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beae019-2397-406f-a006-92ea3842656d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:53.182575 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beae019-2397-406f-a006-92ea3842656d service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:53.182833 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beae019-2397-406f-a006-92ea3842656d service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:53.183115 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beae019-2397-406f-a006-92ea3842656d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:53.190030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e39100-6d96-4730-92b2-7e227484c678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0773aeed36524a539b758362ebe5493c, user_id=1a67a6ab054649b3bd760d088c791d2a, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:53.193025 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e39100-6d96-4730-92b2-7e227484c678 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:53.205201 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1212/2411] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:46:53 2021] PUT /identity/v3/projects/0773aeed36524a539b758362ebe5493c/users/1a67a6ab054649b3bd760d088c791d2a/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:46:53.215541 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d66c00-6e91-4451-866a-69142607fe05 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:53.216174 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d66c00-6e91-4451-866a-69142607fe05 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:53.216531 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d66c00-6e91-4451-866a-69142607fe05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:53.242502 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beae019-2397-406f-a006-92ea3842656d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:53.243886 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-96d66c00-6e91-4451-866a-69142607fe05 None None] MFA Rules not processed for user `1a67a6ab054649b3bd760d088c791d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:53.244645 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beae019-2397-406f-a006-92ea3842656d service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:53.245078 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-96d66c00-6e91-4451-866a-69142607fe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:53.254304 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1200/2412] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:46:53 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:46:53.325498 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1213/2413] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:53 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:46:53.338234 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beae019-2397-406f-a006-92ea3842656d service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:53.339719 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-6beae019-2397-406f-a006-92ea3842656d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:53.451190 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beae019-2397-406f-a006-92ea3842656d service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:53.529537 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb0ce5-b791-4a91-aa97-573023a29477 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:53.530478 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb0ce5-b791-4a91-aa97-573023a29477 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:53.530867 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb0ce5-b791-4a91-aa97-573023a29477 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:53.531240 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb0ce5-b791-4a91-aa97-573023a29477 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:53.552734 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb0ce5-b791-4a91-aa97-573023a29477 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:53.554468 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fb0ce5-b791-4a91-aa97-573023a29477 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:53.566443 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1201/2414] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:46:53 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:46:54.683997 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a6dc5-2200-4fea-9d28-8bc9e30d3bbc None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:54.684497 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a6dc5-2200-4fea-9d28-8bc9e30d3bbc None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:54.684631 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a6dc5-2200-4fea-9d28-8bc9e30d3bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:54.702141 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-756a6dc5-2200-4fea-9d28-8bc9e30d3bbc None None] MFA Rules not processed for user `b988f9d7fba841ff9a4af954f862096a`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:54.703323 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-756a6dc5-2200-4fea-9d28-8bc9e30d3bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:54.761836 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1214/2415] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:54 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:46:56.427531 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb0ce5-b791-4a91-aa97-573023a29477 service nova] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:56.502653 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb0ce5-b791-4a91-aa97-573023a29477 service nova] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:56.507916 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456983f4-e479-4b57-83f9-eb923b9577f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:56.508774 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456983f4-e479-4b57-83f9-eb923b9577f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:56.509057 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456983f4-e479-4b57-83f9-eb923b9577f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:56.509324 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456983f4-e479-4b57-83f9-eb923b9577f1 admin admin] PATH_INFO: `/v3/users/1a67a6ab054649b3bd760d088c791d2a` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:56.510547 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456983f4-e479-4b57-83f9-eb923b9577f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a67a6ab054649b3bd760d088c791d2a)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:56.512632 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456983f4-e479-4b57-83f9-eb923b9577f1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:56.575895 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-456983f4-e479-4b57-83f9-eb923b9577f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a67a6ab054649b3bd760d088c791d2a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:56.584801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-456983f4-e479-4b57-83f9-eb923b9577f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a67a6ab054649b3bd760d088c791d2a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:56.593360 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-456983f4-e479-4b57-83f9-eb923b9577f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a67a6ab054649b3bd760d088c791d2a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:56.594216 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-456983f4-e479-4b57-83f9-eb923b9577f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a67a6ab054649b3bd760d088c791d2a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:56.608980 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-456983f4-e479-4b57-83f9-eb923b9577f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a67a6ab054649b3bd760d088c791d2a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:56.619010 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1202/2416] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:46:56 2021] DELETE /identity/v3/users/1a67a6ab054649b3bd760d088c791d2a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:46:56.623019 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd604c02-eecc-4c3a-aaaf-bf4d80375666 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:56.623514 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd604c02-eecc-4c3a-aaaf-bf4d80375666 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:56.623640 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd604c02-eecc-4c3a-aaaf-bf4d80375666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:56.642585 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-dd604c02-eecc-4c3a-aaaf-bf4d80375666 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:56.643725 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-dd604c02-eecc-4c3a-aaaf-bf4d80375666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:56.705869 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1215/2417] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:46:56.717552 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456983f4-e479-4b57-83f9-eb923b9577f1 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:56.719270 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-456983f4-e479-4b57-83f9-eb923b9577f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:56.788060 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456983f4-e479-4b57-83f9-eb923b9577f1 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:56.792349 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0508a1-c4a6-41df-9a01-8eb2d5f85926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:56.793303 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0508a1-c4a6-41df-9a01-8eb2d5f85926 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:56.793679 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0508a1-c4a6-41df-9a01-8eb2d5f85926 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:56.794162 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0508a1-c4a6-41df-9a01-8eb2d5f85926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:56.804846 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0508a1-c4a6-41df-9a01-8eb2d5f85926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:56.806481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0508a1-c4a6-41df-9a01-8eb2d5f85926 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:56.817431 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1203/2418] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:46:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:46:57.116287 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd604c02-eecc-4c3a-aaaf-bf4d80375666 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:57.118217 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-dd604c02-eecc-4c3a-aaaf-bf4d80375666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:57.131360 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd604c02-eecc-4c3a-aaaf-bf4d80375666 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:57.136630 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3098cd0-eb98-44be-9583-87418dc4b1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:57.138125 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3098cd0-eb98-44be-9583-87418dc4b1f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:57.138600 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3098cd0-eb98-44be-9583-87418dc4b1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:57.139041 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3098cd0-eb98-44be-9583-87418dc4b1f8 admin admin] PATH_INFO: `/v3/projects/0773aeed36524a539b758362ebe5493c` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:57.140437 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3098cd0-eb98-44be-9583-87418dc4b1f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0773aeed36524a539b758362ebe5493c)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:57.142576 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3098cd0-eb98-44be-9583-87418dc4b1f8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:57.189572 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-c3098cd0-eb98-44be-9583-87418dc4b1f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0773aeed36524a539b758362ebe5493c', 'request_id': 'req-c3098cd0-eb98-44be-9583-87418dc4b1f8'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:57.195359 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-c3098cd0-eb98-44be-9583-87418dc4b1f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0773aeed36524a539b758362ebe5493c', 'request_id': 'req-c3098cd0-eb98-44be-9583-87418dc4b1f8'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:57.205105 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-c3098cd0-eb98-44be-9583-87418dc4b1f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0773aeed36524a539b758362ebe5493c', 'request_id': 'req-c3098cd0-eb98-44be-9583-87418dc4b1f8'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:57.218943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-c3098cd0-eb98-44be-9583-87418dc4b1f8 admin admin] The token cache is being invalidate because project 0773aeed36524a539b758362ebe5493c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:46:57.218943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-c3098cd0-eb98-44be-9583-87418dc4b1f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:57.218943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-c3098cd0-eb98-44be-9583-87418dc4b1f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:57.220242 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0508a1-c4a6-41df-9a01-8eb2d5f85926 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:57.220731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1216/2419] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:46:57 2021] DELETE /identity/v3/projects/0773aeed36524a539b758362ebe5493c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:46:57.222244 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-6b0508a1-c4a6-41df-9a01-8eb2d5f85926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:57.227306 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184ef42-0b28-4f2f-b761-1bfd18ae353d None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:57.227591 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184ef42-0b28-4f2f-b761-1bfd18ae353d None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:57.228858 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184ef42-0b28-4f2f-b761-1bfd18ae353d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:57.235457 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0508a1-c4a6-41df-9a01-8eb2d5f85926 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:57.247116 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-f184ef42-0b28-4f2f-b761-1bfd18ae353d None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:57.248606 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f184ef42-0b28-4f2f-b761-1bfd18ae353d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:57.296125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577b99c-673f-476c-83f6-ac8060881a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:57.297121 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577b99c-673f-476c-83f6-ac8060881a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:57.297411 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577b99c-673f-476c-83f6-ac8060881a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:57.297691 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577b99c-673f-476c-83f6-ac8060881a33 admin admin] PATH_INFO: `/v3/users/886cb29d232b408baa782175438a2755` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:57.298939 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577b99c-673f-476c-83f6-ac8060881a33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=886cb29d232b408baa782175438a2755)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:57.301027 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577b99c-673f-476c-83f6-ac8060881a33 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:57.318714 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1217/2420] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:46:57.326856 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa5e1b-4fc4-4c4f-bda7-1a2d2b81d019 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:57.327196 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa5e1b-4fc4-4c4f-bda7-1a2d2b81d019 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:57.327476 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fa5e1b-4fc4-4c4f-bda7-1a2d2b81d019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:57.354198 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-78fa5e1b-4fc4-4c4f-bda7-1a2d2b81d019 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:57.355599 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-78fa5e1b-4fc4-4c4f-bda7-1a2d2b81d019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:57.357831 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-8577b99c-673f-476c-83f6-ac8060881a33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '886cb29d232b408baa782175438a2755'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:57.365310 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1218/2421] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:46:57.367506 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-8577b99c-673f-476c-83f6-ac8060881a33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '886cb29d232b408baa782175438a2755'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:57.369722 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa5e1b-4fc4-4c4f-bda7-1a2d2b81d019 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:57.375775 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-8577b99c-673f-476c-83f6-ac8060881a33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '886cb29d232b408baa782175438a2755'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:57.376800 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-8577b99c-673f-476c-83f6-ac8060881a33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '886cb29d232b408baa782175438a2755'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:57.386618 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fa5e1b-4fc4-4c4f-bda7-1a2d2b81d019 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:57.390443 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-8577b99c-673f-476c-83f6-ac8060881a33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '886cb29d232b408baa782175438a2755'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:57.395680 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d5fb7-e7ad-4e48-ba1d-9602a42e13b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:57.397450 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d5fb7-e7ad-4e48-ba1d-9602a42e13b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:57.397659 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1204/2422] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:46:57 2021] DELETE /identity/v3/users/886cb29d232b408baa782175438a2755 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:46:57.398384 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d5fb7-e7ad-4e48-ba1d-9602a42e13b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:57.399981 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d5fb7-e7ad-4e48-ba1d-9602a42e13b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:57.401497 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d5fb7-e7ad-4e48-ba1d-9602a42e13b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:46:57.402148 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a037d3-af1f-487d-9188-555d72955246 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:57.402328 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d5fb7-e7ad-4e48-ba1d-9602a42e13b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:57.402441 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a037d3-af1f-487d-9188-555d72955246 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:57.402726 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a037d3-af1f-487d-9188-555d72955246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:57.404958 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d5fb7-e7ad-4e48-ba1d-9602a42e13b4 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:57.427600 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-91a037d3-af1f-487d-9188-555d72955246 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:57.428825 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-91a037d3-af1f-487d-9188-555d72955246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:57.433995 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1219/2423] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:46:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:46:57.435098 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d5fb7-e7ad-4e48-ba1d-9602a42e13b4 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:57.437463 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b22d5fb7-e7ad-4e48-ba1d-9602a42e13b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:57.453837 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d5fb7-e7ad-4e48-ba1d-9602a42e13b4 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:57.495532 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1205/2424] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:46:57.506067 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a037d3-af1f-487d-9188-555d72955246 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:57.507512 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-91a037d3-af1f-487d-9188-555d72955246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:57.528271 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649e5f2-eb51-4ae1-aa8f-d921e08d479b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:57.529717 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649e5f2-eb51-4ae1-aa8f-d921e08d479b admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:57.530429 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649e5f2-eb51-4ae1-aa8f-d921e08d479b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:57.530809 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2649e5f2-eb51-4ae1-aa8f-d921e08d479b admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:57.531933 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649e5f2-eb51-4ae1-aa8f-d921e08d479b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:57.534303 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2649e5f2-eb51-4ae1-aa8f-d921e08d479b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:57.578051 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1220/2425] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:46:57 2021] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:46:57.579853 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649e5f2-eb51-4ae1-aa8f-d921e08d479b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:57.583349 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-2649e5f2-eb51-4ae1-aa8f-d921e08d479b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:57.591261 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a037d3-af1f-487d-9188-555d72955246 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:57.656287 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74d3d8-9442-4652-843a-0225da11f134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:57.656900 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74d3d8-9442-4652-843a-0225da11f134 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:57.657179 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74d3d8-9442-4652-843a-0225da11f134 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:57.657451 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c74d3d8-9442-4652-843a-0225da11f134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:57.684065 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2649e5f2-eb51-4ae1-aa8f-d921e08d479b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:57.692223 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c93f4-e8f6-43c4-9d36-9ee2ef1472da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:57.693719 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c93f4-e8f6-43c4-9d36-9ee2ef1472da service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:57.694258 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c93f4-e8f6-43c4-9d36-9ee2ef1472da service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:57.694752 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44c93f4-e8f6-43c4-9d36-9ee2ef1472da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:57.696688 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a44c93f4-e8f6-43c4-9d36-9ee2ef1472da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:57.710023 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c93f4-e8f6-43c4-9d36-9ee2ef1472da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:57.712322 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44c93f4-e8f6-43c4-9d36-9ee2ef1472da service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:57.724783 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1221/2426] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:46:57 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:46:57.726037 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c93f4-e8f6-43c4-9d36-9ee2ef1472da service nova] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:57.730153 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74d3d8-9442-4652-843a-0225da11f134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:57.731826 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c74d3d8-9442-4652-843a-0225da11f134 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:57.737719 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44c93f4-e8f6-43c4-9d36-9ee2ef1472da service nova] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:57.750008 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1206/2427] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:46:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:46:57.762669 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b2f09-58a4-4e96-96b5-aa1bb85988cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:57.763574 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b2f09-58a4-4e96-96b5-aa1bb85988cd admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:57.764000 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b2f09-58a4-4e96-96b5-aa1bb85988cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:57.764383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b2f09-58a4-4e96-96b5-aa1bb85988cd admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:57.765257 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b2f09-58a4-4e96-96b5-aa1bb85988cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:57.771162 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b2f09-58a4-4e96-96b5-aa1bb85988cd admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:57.812294 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1222/2428] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:46:57 2021] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:46:57.817251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74d3d8-9442-4652-843a-0225da11f134 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:57.832057 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c74d3d8-9442-4652-843a-0225da11f134 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:57.838545 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50533a0-6a8b-433e-88d2-78dee81b87fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:57.839276 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50533a0-6a8b-433e-88d2-78dee81b87fd admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:57.839772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50533a0-6a8b-433e-88d2-78dee81b87fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:57.840052 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50533a0-6a8b-433e-88d2-78dee81b87fd admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:57.841208 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50533a0-6a8b-433e-88d2-78dee81b87fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:57.842926 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50533a0-6a8b-433e-88d2-78dee81b87fd admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:57.859809 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1207/2429] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:46:57 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:46:57.861285 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b2f09-58a4-4e96-96b5-aa1bb85988cd admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:57.874663 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b2f09-58a4-4e96-96b5-aa1bb85988cd admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:57.880748 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea7ae3c-385b-498a-933d-bf37173450b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:57.881839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7ae3c-385b-498a-933d-bf37173450b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:57.882495 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7ae3c-385b-498a-933d-bf37173450b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:57.882964 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea7ae3c-385b-498a-933d-bf37173450b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:57.883824 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7ae3c-385b-498a-933d-bf37173450b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:57.885744 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea7ae3c-385b-498a-933d-bf37173450b8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:57.901677 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1223/2430] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:46:57 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:46:57.903002 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50533a0-6a8b-433e-88d2-78dee81b87fd admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:57.915711 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50533a0-6a8b-433e-88d2-78dee81b87fd admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:57.920854 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df07c9-05de-4e9d-9f41-c3a9ab8fe556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:57.921813 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df07c9-05de-4e9d-9f41-c3a9ab8fe556 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:57.922212 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df07c9-05de-4e9d-9f41-c3a9ab8fe556 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:57.922726 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2df07c9-05de-4e9d-9f41-c3a9ab8fe556 admin admin] PATH_INFO: `/v3/projects/35b293025ab746fa8462e1357f825161/users/51b07e3de1804bef8b18645bd5898366/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:57.944437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df07c9-05de-4e9d-9f41-c3a9ab8fe556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35b293025ab746fa8462e1357f825161, user_id=51b07e3de1804bef8b18645bd5898366, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:57.950521 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2df07c9-05de-4e9d-9f41-c3a9ab8fe556 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:57.967680 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1208/2431] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:46:57 2021] PUT /identity/v3/projects/35b293025ab746fa8462e1357f825161/users/51b07e3de1804bef8b18645bd5898366/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:46:57.980041 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71672ee5-5a67-4761-b6ba-1ee8cc5389ec None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:57.980322 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71672ee5-5a67-4761-b6ba-1ee8cc5389ec None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:57.980806 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71672ee5-5a67-4761-b6ba-1ee8cc5389ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.012125 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-71672ee5-5a67-4761-b6ba-1ee8cc5389ec None None] MFA Rules not processed for user `51b07e3de1804bef8b18645bd5898366`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:58.013354 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-71672ee5-5a67-4761-b6ba-1ee8cc5389ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:58.091800 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1224/2432] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:57 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:46:58.096202 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df07c9-05de-4e9d-9f41-c3a9ab8fe556 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:58.174131 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2df07c9-05de-4e9d-9f41-c3a9ab8fe556 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:58.179527 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c680d-4189-41e8-b71c-087d372745a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:58.180360 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c680d-4189-41e8-b71c-087d372745a8 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.180790 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c680d-4189-41e8-b71c-087d372745a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.181072 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c680d-4189-41e8-b71c-087d372745a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.181794 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c680d-4189-41e8-b71c-087d372745a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:58.183723 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c680d-4189-41e8-b71c-087d372745a8 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:58.209649 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71672ee5-5a67-4761-b6ba-1ee8cc5389ec None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:58.211175 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-71672ee5-5a67-4761-b6ba-1ee8cc5389ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:58.216069 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1209/2433] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:46:58 2021] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:46:58.228635 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c680d-4189-41e8-b71c-087d372745a8 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:58.228992 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71672ee5-5a67-4761-b6ba-1ee8cc5389ec None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:58.294430 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c680d-4189-41e8-b71c-087d372745a8 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:58.295994 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bbd653-6c70-4aa0-b5d8-b46fc99b427d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:58.296874 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbd653-6c70-4aa0-b5d8-b46fc99b427d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.297155 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbd653-6c70-4aa0-b5d8-b46fc99b427d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.297432 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bbd653-6c70-4aa0-b5d8-b46fc99b427d admin admin] PATH_INFO: `/v3/projects/273704d2b4d54bb9ab20fa44c613d102` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.298659 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbd653-6c70-4aa0-b5d8-b46fc99b427d admin admin] RBAC: Authorizing `identity:delete_project(project_id=273704d2b4d54bb9ab20fa44c613d102)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:58.300103 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24daa28-671b-4da8-9153-79168be532c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:58.300584 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bbd653-6c70-4aa0-b5d8-b46fc99b427d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:58.300895 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24daa28-671b-4da8-9153-79168be532c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.301262 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24daa28-671b-4da8-9153-79168be532c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.301546 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24daa28-671b-4da8-9153-79168be532c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.302393 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24daa28-671b-4da8-9153-79168be532c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:58.304302 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24daa28-671b-4da8-9153-79168be532c1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:58.329462 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1210/2434] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:46:58 2021] POST /identity/v3/users => generated 294 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:46:58.332047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24daa28-671b-4da8-9153-79168be532c1 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:58.343531 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24daa28-671b-4da8-9153-79168be532c1 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:58.356158 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f2bbd653-6c70-4aa0-b5d8-b46fc99b427d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '273704d2b4d54bb9ab20fa44c613d102', 'request_id': 'req-f2bbd653-6c70-4aa0-b5d8-b46fc99b427d'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:58.362245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f2bbd653-6c70-4aa0-b5d8-b46fc99b427d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '273704d2b4d54bb9ab20fa44c613d102', 'request_id': 'req-f2bbd653-6c70-4aa0-b5d8-b46fc99b427d'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:58.376143 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f2bbd653-6c70-4aa0-b5d8-b46fc99b427d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '273704d2b4d54bb9ab20fa44c613d102', 'request_id': 'req-f2bbd653-6c70-4aa0-b5d8-b46fc99b427d'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:58.389913 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f2bbd653-6c70-4aa0-b5d8-b46fc99b427d admin admin] The token cache is being invalidate because project 273704d2b4d54bb9ab20fa44c613d102 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:46:58.390176 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f2bbd653-6c70-4aa0-b5d8-b46fc99b427d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:58.390883 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-f2bbd653-6c70-4aa0-b5d8-b46fc99b427d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:46:58.392709 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1225/2435] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:46:58 2021] DELETE /identity/v3/projects/273704d2b4d54bb9ab20fa44c613d102 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:46:58.398485 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401cd36-41f2-4098-b96d-07732d1562e5 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.398776 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401cd36-41f2-4098-b96d-07732d1562e5 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.399057 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b401cd36-41f2-4098-b96d-07732d1562e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.408347 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddc956-2e07-4043-9cdf-1ba08f5556bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:58.409017 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddc956-2e07-4043-9cdf-1ba08f5556bb admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.409301 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddc956-2e07-4043-9cdf-1ba08f5556bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.409577 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddc956-2e07-4043-9cdf-1ba08f5556bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.410342 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddc956-2e07-4043-9cdf-1ba08f5556bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:58.412496 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddc956-2e07-4043-9cdf-1ba08f5556bb admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:58.417781 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-b401cd36-41f2-4098-b96d-07732d1562e5 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:58.418901 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b401cd36-41f2-4098-b96d-07732d1562e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:58.422801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1211/2436] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:46:58 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:46:58.426701 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddc956-2e07-4043-9cdf-1ba08f5556bb admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:58.428427 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1226/2437] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:46:58.430130 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-14ddc956-2e07-4043-9cdf-1ba08f5556bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:58.437351 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7344b2-b02a-4820-b458-db3ce7df9ea7 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.437647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7344b2-b02a-4820-b458-db3ce7df9ea7 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.438010 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7344b2-b02a-4820-b458-db3ce7df9ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.445684 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddc956-2e07-4043-9cdf-1ba08f5556bb admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:58.452558 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e366b1-bbbe-4555-850c-b59390782f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:58.453360 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e366b1-bbbe-4555-850c-b59390782f12 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.453688 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e366b1-bbbe-4555-850c-b59390782f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.453996 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e366b1-bbbe-4555-850c-b59390782f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.454737 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e366b1-bbbe-4555-850c-b59390782f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:58.456805 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e366b1-bbbe-4555-850c-b59390782f12 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:58.456946 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-7a7344b2-b02a-4820-b458-db3ce7df9ea7 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:58.457964 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-7a7344b2-b02a-4820-b458-db3ce7df9ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:58.467221 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1227/2438] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:46:58.470759 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1212/2439] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:46:58 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:46:58.472023 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7344b2-b02a-4820-b458-db3ce7df9ea7 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:58.472374 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e366b1-bbbe-4555-850c-b59390782f12 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:58.482808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7344b2-b02a-4820-b458-db3ce7df9ea7 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:58.484375 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e366b1-bbbe-4555-850c-b59390782f12 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:58.487710 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4cc86-48b6-4a1b-b700-c14d2bbd57e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:58.488420 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4cc86-48b6-4a1b-b700-c14d2bbd57e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.488772 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4cc86-48b6-4a1b-b700-c14d2bbd57e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.489138 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4cc86-48b6-4a1b-b700-c14d2bbd57e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.490051 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4cc86-48b6-4a1b-b700-c14d2bbd57e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:46:58.490197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4381e-40dc-476d-b5bd-3dcc03f3dcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:58.490366 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4cc86-48b6-4a1b-b700-c14d2bbd57e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:58.490914 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4381e-40dc-476d-b5bd-3dcc03f3dcf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.491201 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4381e-40dc-476d-b5bd-3dcc03f3dcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.491476 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4381e-40dc-476d-b5bd-3dcc03f3dcf2 admin admin] PATH_INFO: `/v3/projects/d52b869deb1542098a29e87f0ddce388/users/7eb508d90c984c3fafa5cae3dc3a2e62/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.492304 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4cc86-48b6-4a1b-b700-c14d2bbd57e5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:58.504899 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1228/2440] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:46:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:46:58.509036 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4cc86-48b6-4a1b-b700-c14d2bbd57e5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:58.509557 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4381e-40dc-476d-b5bd-3dcc03f3dcf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d52b869deb1542098a29e87f0ddce388, user_id=7eb508d90c984c3fafa5cae3dc3a2e62, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:58.512492 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f4381e-40dc-476d-b5bd-3dcc03f3dcf2 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:58.519036 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4cc86-48b6-4a1b-b700-c14d2bbd57e5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:58.525052 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e9a80-14fe-4027-b467-959d5d42c280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:58.526006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e9a80-14fe-4027-b467-959d5d42c280 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.526425 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e9a80-14fe-4027-b467-959d5d42c280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.526679 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4e9a80-14fe-4027-b467-959d5d42c280 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.527402 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e9a80-14fe-4027-b467-959d5d42c280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:58.529313 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4e9a80-14fe-4027-b467-959d5d42c280 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:58.529758 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1213/2441] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:46:58 2021] PUT /identity/v3/projects/d52b869deb1542098a29e87f0ddce388/users/7eb508d90c984c3fafa5cae3dc3a2e62/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:46:58.540836 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbeb54-a9df-48e2-b5f2-8dbfc0afa1ed None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.541125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbeb54-a9df-48e2-b5f2-8dbfc0afa1ed None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.541452 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afbeb54-a9df-48e2-b5f2-8dbfc0afa1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.559350 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1229/2442] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:46:58 2021] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:46:58.563507 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e9a80-14fe-4027-b467-959d5d42c280 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:58.573499 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-3afbeb54-a9df-48e2-b5f2-8dbfc0afa1ed None None] MFA Rules not processed for user `7eb508d90c984c3fafa5cae3dc3a2e62`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:58.574795 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3afbeb54-a9df-48e2-b5f2-8dbfc0afa1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:58.630778 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4e9a80-14fe-4027-b467-959d5d42c280 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:58.636658 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d15e3-ba8b-402f-8e21-8683ec97bf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:58.637441 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d15e3-ba8b-402f-8e21-8683ec97bf29 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.637727 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d15e3-ba8b-402f-8e21-8683ec97bf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.638042 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248d15e3-ba8b-402f-8e21-8683ec97bf29 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.638746 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d15e3-ba8b-402f-8e21-8683ec97bf29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:58.640662 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248d15e3-ba8b-402f-8e21-8683ec97bf29 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:58.645222 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1214/2443] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:58 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:46:58.650249 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbeb54-a9df-48e2-b5f2-8dbfc0afa1ed None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:58.661066 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afbeb54-a9df-48e2-b5f2-8dbfc0afa1ed None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:58.663106 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1230/2444] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:46:58 2021] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:46:58.666882 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d15e3-ba8b-402f-8e21-8683ec97bf29 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:58.669046 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65697501-f996-40bb-87f6-4a2048a39409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:58.669643 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65697501-f996-40bb-87f6-4a2048a39409 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.669954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65697501-f996-40bb-87f6-4a2048a39409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.670231 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65697501-f996-40bb-87f6-4a2048a39409 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.670946 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65697501-f996-40bb-87f6-4a2048a39409 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:58.672861 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65697501-f996-40bb-87f6-4a2048a39409 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:58.677355 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248d15e3-ba8b-402f-8e21-8683ec97bf29 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:58.682251 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ef84b-08ad-4d02-85dd-5eae645f3ff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:58.683168 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ef84b-08ad-4d02-85dd-5eae645f3ff7 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.683306 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ef84b-08ad-4d02-85dd-5eae645f3ff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.683536 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8ef84b-08ad-4d02-85dd-5eae645f3ff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.684318 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ef84b-08ad-4d02-85dd-5eae645f3ff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:58.686037 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8ef84b-08ad-4d02-85dd-5eae645f3ff7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:58.697190 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1231/2445] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:46:58 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:46:58.701298 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ef84b-08ad-4d02-85dd-5eae645f3ff7 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:58.704664 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1215/2446] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:46:58 2021] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:46:58.710050 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65697501-f996-40bb-87f6-4a2048a39409 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:58.712289 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8ef84b-08ad-4d02-85dd-5eae645f3ff7 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:58.779480 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24299a-9eff-447f-9b14-b227245a0ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:58.779746 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65697501-f996-40bb-87f6-4a2048a39409 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:58.780176 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24299a-9eff-447f-9b14-b227245a0ecb admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.780544 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24299a-9eff-447f-9b14-b227245a0ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.780825 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff24299a-9eff-447f-9b14-b227245a0ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.781583 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24299a-9eff-447f-9b14-b227245a0ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:58.783259 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff24299a-9eff-447f-9b14-b227245a0ecb admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:58.785337 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f9abf-7596-438c-b59c-e15e2afe380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:58.786535 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f9abf-7596-438c-b59c-e15e2afe380e admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.786820 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f9abf-7596-438c-b59c-e15e2afe380e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.787096 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f9abf-7596-438c-b59c-e15e2afe380e admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.787856 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f9abf-7596-438c-b59c-e15e2afe380e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:58.789964 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f9abf-7596-438c-b59c-e15e2afe380e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:58.794301 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1232/2447] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:46:58 2021] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:46:58.798244 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24299a-9eff-447f-9b14-b227245a0ecb admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:58.808208 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff24299a-9eff-447f-9b14-b227245a0ecb admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:58.813948 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edae00-f7a5-4c97-9df9-74a4255634cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:58.814800 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edae00-f7a5-4c97-9df9-74a4255634cc admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.815080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edae00-f7a5-4c97-9df9-74a4255634cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.815357 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edae00-f7a5-4c97-9df9-74a4255634cc admin admin] PATH_INFO: `/v3/projects/3c54463535cc4419a43ee93d7bdd2ded/users/987537c0a1234f35bb8e615a71a775a1/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.822483 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1216/2448] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:46:58 2021] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:46:58.827255 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f9abf-7596-438c-b59c-e15e2afe380e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:58.833277 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edae00-f7a5-4c97-9df9-74a4255634cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c54463535cc4419a43ee93d7bdd2ded, user_id=987537c0a1234f35bb8e615a71a775a1, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:58.837123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38edae00-f7a5-4c97-9df9-74a4255634cc admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:58.839658 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f9abf-7596-438c-b59c-e15e2afe380e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:58.845591 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb277e4-6a07-4824-8786-fd931053169c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:58.846298 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb277e4-6a07-4824-8786-fd931053169c admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.846582 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb277e4-6a07-4824-8786-fd931053169c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.846862 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb277e4-6a07-4824-8786-fd931053169c admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.847611 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb277e4-6a07-4824-8786-fd931053169c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:58.849248 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb277e4-6a07-4824-8786-fd931053169c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:58.857536 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1233/2449] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:46:58 2021] PUT /identity/v3/projects/3c54463535cc4419a43ee93d7bdd2ded/users/987537c0a1234f35bb8e615a71a775a1/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:46:58.866528 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1217/2450] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:46:58 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:46:58.866657 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edae00-f7a5-4c97-9df9-74a4255634cc admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:58.867889 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a992e-7f25-4ba2-87af-1dbe458dcab9 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.868184 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a992e-7f25-4ba2-87af-1dbe458dcab9 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.868465 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a992e-7f25-4ba2-87af-1dbe458dcab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.900968 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-1c4a992e-7f25-4ba2-87af-1dbe458dcab9 None None] MFA Rules not processed for user `987537c0a1234f35bb8e615a71a775a1`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:58.902689 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1c4a992e-7f25-4ba2-87af-1dbe458dcab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:58.966782 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edae00-f7a5-4c97-9df9-74a4255634cc admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:58.973190 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1218/2451] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:58 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:46:58.974107 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41028e5f-f6df-4808-acf3-cc8361f01cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:58.975007 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41028e5f-f6df-4808-acf3-cc8361f01cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:58.975294 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41028e5f-f6df-4808-acf3-cc8361f01cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:58.975564 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41028e5f-f6df-4808-acf3-cc8361f01cf2 admin admin] PATH_INFO: `/v3/projects/6c9e2b28c07d4be2bd3428312dcbfd3a/users/52c74f7cffec442ea9d2538a43445bee/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:58.982748 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a992e-7f25-4ba2-87af-1dbe458dcab9 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:58.984243 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1c4a992e-7f25-4ba2-87af-1dbe458dcab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:58.992422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41028e5f-f6df-4808-acf3-cc8361f01cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9e2b28c07d4be2bd3428312dcbfd3a, user_id=52c74f7cffec442ea9d2538a43445bee, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:58.995222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41028e5f-f6df-4808-acf3-cc8361f01cf2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:59.012592 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1234/2452] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:46:58 2021] PUT /identity/v3/projects/6c9e2b28c07d4be2bd3428312dcbfd3a/users/52c74f7cffec442ea9d2538a43445bee/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:46:59.016977 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41028e5f-f6df-4808-acf3-cc8361f01cf2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:59.055952 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4a992e-7f25-4ba2-87af-1dbe458dcab9 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:59.120853 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41028e5f-f6df-4808-acf3-cc8361f01cf2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:59.129308 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d256a17-5c07-4009-826a-daf09e7fc915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:59.129308 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d256a17-5c07-4009-826a-daf09e7fc915 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:59.129308 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d256a17-5c07-4009-826a-daf09e7fc915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:59.129308 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d256a17-5c07-4009-826a-daf09e7fc915 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:59.129808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d256a17-5c07-4009-826a-daf09e7fc915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:59.132856 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d256a17-5c07-4009-826a-daf09e7fc915 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:59.133861 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e8c32-bfbe-4144-a2d0-54033575b083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:59.134559 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e8c32-bfbe-4144-a2d0-54033575b083 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:59.134846 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e8c32-bfbe-4144-a2d0-54033575b083 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:59.135125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89e8c32-bfbe-4144-a2d0-54033575b083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:59.146038 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1235/2453] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:46:59 2021] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:46:59.150921 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d256a17-5c07-4009-826a-daf09e7fc915 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:59.163185 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d256a17-5c07-4009-826a-daf09e7fc915 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:59.169534 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73dc5e-e3e9-4d5c-8c2e-00701e67989d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:59.170692 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73dc5e-e3e9-4d5c-8c2e-00701e67989d admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:59.171004 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73dc5e-e3e9-4d5c-8c2e-00701e67989d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:59.171555 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73dc5e-e3e9-4d5c-8c2e-00701e67989d admin admin] PATH_INFO: `/v3/projects/6c9e2b28c07d4be2bd3428312dcbfd3a/users/52c74f7cffec442ea9d2538a43445bee/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:59.173697 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73dc5e-e3e9-4d5c-8c2e-00701e67989d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c9e2b28c07d4be2bd3428312dcbfd3a, user_id=52c74f7cffec442ea9d2538a43445bee, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:59.176347 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d73dc5e-e3e9-4d5c-8c2e-00701e67989d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:59.190541 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1236/2454] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:46:59 2021] PUT /identity/v3/projects/6c9e2b28c07d4be2bd3428312dcbfd3a/users/52c74f7cffec442ea9d2538a43445bee/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:46:59.200709 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ef038-88f5-42aa-99ef-4ee359fd469f None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:59.201010 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ef038-88f5-42aa-99ef-4ee359fd469f None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:59.201263 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ef038-88f5-42aa-99ef-4ee359fd469f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:59.213074 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e8c32-bfbe-4144-a2d0-54033575b083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:59.215045 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89e8c32-bfbe-4144-a2d0-54033575b083 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:59.227127 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1219/2455] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:46:58 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:46:59.241867 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-f74ef038-88f5-42aa-99ef-4ee359fd469f None None] MFA Rules not processed for user `52c74f7cffec442ea9d2538a43445bee`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:46:59.243122 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f74ef038-88f5-42aa-99ef-4ee359fd469f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:59.336733 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1237/2456] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:46:59 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:46:59.347569 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e8c32-bfbe-4144-a2d0-54033575b083 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:46:59.349675 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d89e8c32-bfbe-4144-a2d0-54033575b083 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:46:59.360999 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89e8c32-bfbe-4144-a2d0-54033575b083 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:46:59.447682 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc746a-1ad3-41f2-8150-494d621b27eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:46:59.448350 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc746a-1ad3-41f2-8150-494d621b27eb service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:46:59.448616 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc746a-1ad3-41f2-8150-494d621b27eb service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:46:59.448896 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cc746a-1ad3-41f2-8150-494d621b27eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:46:59.460695 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc746a-1ad3-41f2-8150-494d621b27eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:46:59.462873 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cc746a-1ad3-41f2-8150-494d621b27eb service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:46:59.476173 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1220/2457] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:46:59 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:47:00.009677 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ef038-88f5-42aa-99ef-4ee359fd469f None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:00.018968 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ef038-88f5-42aa-99ef-4ee359fd469f None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:00.023003 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f6996-8c53-433f-adc3-de5069e42747 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:00.023635 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f6996-8c53-433f-adc3-de5069e42747 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:00.023919 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f6996-8c53-433f-adc3-de5069e42747 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:00.024225 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f6996-8c53-433f-adc3-de5069e42747 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:00.026071 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ef1f6996-8c53-433f-adc3-de5069e42747 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:00.081162 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f6996-8c53-433f-adc3-de5069e42747 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:00.082622 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f6996-8c53-433f-adc3-de5069e42747 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:00.092064 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1238/2458] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:47:00 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:47:01.979044 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc746a-1ad3-41f2-8150-494d621b27eb service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:01.980447 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-23cc746a-1ad3-41f2-8150-494d621b27eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:02.068638 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cc746a-1ad3-41f2-8150-494d621b27eb service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:02.073574 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da082fa0-bec6-4e6c-8ecb-ac14b2e36353 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:02.074241 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da082fa0-bec6-4e6c-8ecb-ac14b2e36353 service placement] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:02.074524 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da082fa0-bec6-4e6c-8ecb-ac14b2e36353 service placement] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:02.074797 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da082fa0-bec6-4e6c-8ecb-ac14b2e36353 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:02.076543 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-da082fa0-bec6-4e6c-8ecb-ac14b2e36353 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:02.087494 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da082fa0-bec6-4e6c-8ecb-ac14b2e36353 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:02.089051 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da082fa0-bec6-4e6c-8ecb-ac14b2e36353 service placement] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:02.098934 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1221/2459] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:47:01 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:47:02.305142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f6996-8c53-433f-adc3-de5069e42747 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:02.363722 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f6996-8c53-433f-adc3-de5069e42747 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:02.369539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a5c92-0866-41ca-bd82-73573e9bc0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:02.370439 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a5c92-0866-41ca-bd82-73573e9bc0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:02.370723 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a5c92-0866-41ca-bd82-73573e9bc0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:02.370997 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230a5c92-0866-41ca-bd82-73573e9bc0bb admin admin] PATH_INFO: `/v3/users/987537c0a1234f35bb8e615a71a775a1` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:02.372177 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a5c92-0866-41ca-bd82-73573e9bc0bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=987537c0a1234f35bb8e615a71a775a1)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:02.374161 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230a5c92-0866-41ca-bd82-73573e9bc0bb admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:02.417085 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-230a5c92-0866-41ca-bd82-73573e9bc0bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '987537c0a1234f35bb8e615a71a775a1'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:02.417720 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-230a5c92-0866-41ca-bd82-73573e9bc0bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '987537c0a1234f35bb8e615a71a775a1'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:02.429552 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-230a5c92-0866-41ca-bd82-73573e9bc0bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '987537c0a1234f35bb8e615a71a775a1'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:02.430212 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-230a5c92-0866-41ca-bd82-73573e9bc0bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '987537c0a1234f35bb8e615a71a775a1'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:02.437186 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-230a5c92-0866-41ca-bd82-73573e9bc0bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '987537c0a1234f35bb8e615a71a775a1'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:02.448743 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1239/2460] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:47:02 2021] DELETE /identity/v3/users/987537c0a1234f35bb8e615a71a775a1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:47:02.453067 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e58f5-9d88-4c4e-8fc6-1817b1c820be None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:02.453349 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e58f5-9d88-4c4e-8fc6-1817b1c820be None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:02.453619 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5e58f5-9d88-4c4e-8fc6-1817b1c820be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:02.470560 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-bf5e58f5-9d88-4c4e-8fc6-1817b1c820be None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:02.471763 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-bf5e58f5-9d88-4c4e-8fc6-1817b1c820be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:02.531892 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1222/2461] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:47:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:47:02.542381 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a5c92-0866-41ca-bd82-73573e9bc0bb admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:02.543822 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-230a5c92-0866-41ca-bd82-73573e9bc0bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:02.607283 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230a5c92-0866-41ca-bd82-73573e9bc0bb admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:02.610995 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d149cbd-db0f-491e-a37b-0c7db3654464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:02.611641 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d149cbd-db0f-491e-a37b-0c7db3654464 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:02.611925 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d149cbd-db0f-491e-a37b-0c7db3654464 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:02.612197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d149cbd-db0f-491e-a37b-0c7db3654464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:02.621731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d149cbd-db0f-491e-a37b-0c7db3654464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:02.623214 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d149cbd-db0f-491e-a37b-0c7db3654464 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:02.632710 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1240/2462] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:47:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:47:02.941825 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e58f5-9d88-4c4e-8fc6-1817b1c820be None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:02.943701 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-bf5e58f5-9d88-4c4e-8fc6-1817b1c820be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:02.957950 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5e58f5-9d88-4c4e-8fc6-1817b1c820be None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:02.963083 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be290ca-91e0-4bce-ad46-cb46339814d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:02.964226 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be290ca-91e0-4bce-ad46-cb46339814d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:02.964626 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be290ca-91e0-4bce-ad46-cb46339814d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:02.964779 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be290ca-91e0-4bce-ad46-cb46339814d1 admin admin] PATH_INFO: `/v3/projects/3c54463535cc4419a43ee93d7bdd2ded` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:02.966383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be290ca-91e0-4bce-ad46-cb46339814d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c54463535cc4419a43ee93d7bdd2ded)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:02.968154 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be290ca-91e0-4bce-ad46-cb46339814d1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:03.014671 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0be290ca-91e0-4bce-ad46-cb46339814d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c54463535cc4419a43ee93d7bdd2ded', 'request_id': 'req-0be290ca-91e0-4bce-ad46-cb46339814d1'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:03.019851 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0be290ca-91e0-4bce-ad46-cb46339814d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c54463535cc4419a43ee93d7bdd2ded', 'request_id': 'req-0be290ca-91e0-4bce-ad46-cb46339814d1'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:03.027429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0be290ca-91e0-4bce-ad46-cb46339814d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c54463535cc4419a43ee93d7bdd2ded', 'request_id': 'req-0be290ca-91e0-4bce-ad46-cb46339814d1'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:03.038971 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0be290ca-91e0-4bce-ad46-cb46339814d1 admin admin] The token cache is being invalidate because project 3c54463535cc4419a43ee93d7bdd2ded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:47:03.039280 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0be290ca-91e0-4bce-ad46-cb46339814d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:03.039910 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0be290ca-91e0-4bce-ad46-cb46339814d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:03.041430 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1223/2463] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:47:02 2021] DELETE /identity/v3/projects/3c54463535cc4419a43ee93d7bdd2ded => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:47:03.047123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60adeb6b-9f97-47f5-9f37-a0b95a8a9ef0 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:03.047431 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60adeb6b-9f97-47f5-9f37-a0b95a8a9ef0 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:03.047705 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60adeb6b-9f97-47f5-9f37-a0b95a8a9ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:03.064569 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-60adeb6b-9f97-47f5-9f37-a0b95a8a9ef0 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:03.065737 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-60adeb6b-9f97-47f5-9f37-a0b95a8a9ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:03.125762 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1241/2464] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:47:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:47:03.134253 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b067e-03de-4917-a58b-e313a0cf4c8c None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:03.134453 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b067e-03de-4917-a58b-e313a0cf4c8c None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:03.134723 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b067e-03de-4917-a58b-e313a0cf4c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:03.153362 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-123b067e-03de-4917-a58b-e313a0cf4c8c None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:03.154593 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-123b067e-03de-4917-a58b-e313a0cf4c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:03.162343 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1224/2465] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:47:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:47:03.166552 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60adeb6b-9f97-47f5-9f37-a0b95a8a9ef0 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:03.175912 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60adeb6b-9f97-47f5-9f37-a0b95a8a9ef0 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:03.180385 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe6360-eb5b-46af-8002-1e47d5636e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:03.181023 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe6360-eb5b-46af-8002-1e47d5636e34 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:03.181309 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe6360-eb5b-46af-8002-1e47d5636e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:03.181585 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe6360-eb5b-46af-8002-1e47d5636e34 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:03.182347 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe6360-eb5b-46af-8002-1e47d5636e34 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:47:03.182648 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe6360-eb5b-46af-8002-1e47d5636e34 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:03.184228 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbe6360-eb5b-46af-8002-1e47d5636e34 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:03.195637 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1242/2466] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:47:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:47:03.199703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b067e-03de-4917-a58b-e313a0cf4c8c None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:03.209266 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b067e-03de-4917-a58b-e313a0cf4c8c None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:03.214039 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4b53a-898e-4d05-8824-fcbc16d1b38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:03.214677 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4b53a-898e-4d05-8824-fcbc16d1b38c admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:03.214974 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4b53a-898e-4d05-8824-fcbc16d1b38c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:03.215252 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4b53a-898e-4d05-8824-fcbc16d1b38c admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:03.216213 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4b53a-898e-4d05-8824-fcbc16d1b38c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:03.218120 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a4b53a-898e-4d05-8824-fcbc16d1b38c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:03.242209 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1225/2467] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:47:03 2021] POST /identity/v3/projects => generated 399 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:47:03.246312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe6360-eb5b-46af-8002-1e47d5636e34 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:03.256797 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe6360-eb5b-46af-8002-1e47d5636e34 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:03.310743 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5427b0-3b17-4bfb-aea1-7e797b2820a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:03.311419 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5427b0-3b17-4bfb-aea1-7e797b2820a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:03.311706 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5427b0-3b17-4bfb-aea1-7e797b2820a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:03.311985 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5427b0-3b17-4bfb-aea1-7e797b2820a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:03.312720 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5427b0-3b17-4bfb-aea1-7e797b2820a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:03.314663 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5427b0-3b17-4bfb-aea1-7e797b2820a7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:03.336300 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1243/2468] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:47:03 2021] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:47:03.340239 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4b53a-898e-4d05-8824-fcbc16d1b38c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:03.350582 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4b53a-898e-4d05-8824-fcbc16d1b38c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:03.355534 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8de3a1-e5c7-4c08-8cea-5b7e4aed7064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:03.355920 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8de3a1-e5c7-4c08-8cea-5b7e4aed7064 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:03.356200 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8de3a1-e5c7-4c08-8cea-5b7e4aed7064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:03.356480 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8de3a1-e5c7-4c08-8cea-5b7e4aed7064 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:03.357217 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8de3a1-e5c7-4c08-8cea-5b7e4aed7064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:03.358840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8de3a1-e5c7-4c08-8cea-5b7e4aed7064 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:03.370472 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1226/2469] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:47:03 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:47:03.374526 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5427b0-3b17-4bfb-aea1-7e797b2820a7 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:03.384806 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5427b0-3b17-4bfb-aea1-7e797b2820a7 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:03.389536 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc1d99-f0cf-419e-a8e7-6110045ae510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:03.390338 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc1d99-f0cf-419e-a8e7-6110045ae510 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:03.390695 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc1d99-f0cf-419e-a8e7-6110045ae510 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:03.391044 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc1d99-f0cf-419e-a8e7-6110045ae510 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:03.391878 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc1d99-f0cf-419e-a8e7-6110045ae510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:03.393898 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cc1d99-f0cf-419e-a8e7-6110045ae510 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:03.404867 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1244/2470] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:47:03 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:47:03.409160 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8de3a1-e5c7-4c08-8cea-5b7e4aed7064 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:03.418885 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8de3a1-e5c7-4c08-8cea-5b7e4aed7064 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:03.423826 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c5d3b-d6dd-46dd-a540-1f7736f3d2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:03.424698 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c5d3b-d6dd-46dd-a540-1f7736f3d2be admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:03.424979 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c5d3b-d6dd-46dd-a540-1f7736f3d2be admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:03.425252 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c5d3b-d6dd-46dd-a540-1f7736f3d2be admin admin] PATH_INFO: `/v3/projects/a01d0346d2894708aba98e5242409c22/users/bf0bb353241e4bc0b79ba90e68f3545e/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:03.439715 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c5d3b-d6dd-46dd-a540-1f7736f3d2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=a01d0346d2894708aba98e5242409c22, user_id=bf0bb353241e4bc0b79ba90e68f3545e, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:03.442935 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6c5d3b-d6dd-46dd-a540-1f7736f3d2be admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:03.466774 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1227/2471] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:47:03 2021] PUT /identity/v3/projects/a01d0346d2894708aba98e5242409c22/users/bf0bb353241e4bc0b79ba90e68f3545e/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:47:03.471788 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d05972-4a79-4cdf-8224-8c41dc398aaf None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:03.472527 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d05972-4a79-4cdf-8224-8c41dc398aaf None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:03.472982 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d05972-4a79-4cdf-8224-8c41dc398aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:03.501968 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-d0d05972-4a79-4cdf-8224-8c41dc398aaf None None] MFA Rules not processed for user `bf0bb353241e4bc0b79ba90e68f3545e`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:03.503238 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-d0d05972-4a79-4cdf-8224-8c41dc398aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:03.592111 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1245/2472] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:47:03 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:47:03.603759 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c5d3b-d6dd-46dd-a540-1f7736f3d2be admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:03.608063 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7a6c5d3b-d6dd-46dd-a540-1f7736f3d2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:03.701027 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6c5d3b-d6dd-46dd-a540-1f7736f3d2be admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:03.706726 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76233f12-933c-4286-9d94-d13979aae704 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:03.707486 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76233f12-933c-4286-9d94-d13979aae704 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:03.707882 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76233f12-933c-4286-9d94-d13979aae704 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:03.708188 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76233f12-933c-4286-9d94-d13979aae704 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:03.717789 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76233f12-933c-4286-9d94-d13979aae704 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:03.719292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76233f12-933c-4286-9d94-d13979aae704 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:03.729653 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1228/2473] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:47:03 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:47:04.258590 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d05972-4a79-4cdf-8224-8c41dc398aaf None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:04.267930 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d05972-4a79-4cdf-8224-8c41dc398aaf None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:04.272098 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad278c-07d4-4b97-8241-bfd5441884fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:04.272674 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad278c-07d4-4b97-8241-bfd5441884fd service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:04.272956 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad278c-07d4-4b97-8241-bfd5441884fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:04.273234 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad278c-07d4-4b97-8241-bfd5441884fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:04.275029 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-15ad278c-07d4-4b97-8241-bfd5441884fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:04.329849 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad278c-07d4-4b97-8241-bfd5441884fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:04.331310 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad278c-07d4-4b97-8241-bfd5441884fd service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:04.341340 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1246/2474] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:47:04 2021] GET /identity/v3/auth/tokens => generated 3407 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:47:06.440876 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76233f12-933c-4286-9d94-d13979aae704 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:06.442336 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-76233f12-933c-4286-9d94-d13979aae704 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:06.505075 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76233f12-933c-4286-9d94-d13979aae704 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:06.509515 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a733e-9b32-4a68-a48a-a0a459e4d13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:06.510386 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a733e-9b32-4a68-a48a-a0a459e4d13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:06.510666 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a733e-9b32-4a68-a48a-a0a459e4d13f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:06.510936 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241a733e-9b32-4a68-a48a-a0a459e4d13f admin admin] PATH_INFO: `/v3/users/51b07e3de1804bef8b18645bd5898366` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:06.512311 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a733e-9b32-4a68-a48a-a0a459e4d13f admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b07e3de1804bef8b18645bd5898366)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:06.514244 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241a733e-9b32-4a68-a48a-a0a459e4d13f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:06.559977 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-241a733e-9b32-4a68-a48a-a0a459e4d13f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b07e3de1804bef8b18645bd5898366'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:06.566884 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-241a733e-9b32-4a68-a48a-a0a459e4d13f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b07e3de1804bef8b18645bd5898366'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:06.573569 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-241a733e-9b32-4a68-a48a-a0a459e4d13f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b07e3de1804bef8b18645bd5898366'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:06.574219 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-241a733e-9b32-4a68-a48a-a0a459e4d13f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b07e3de1804bef8b18645bd5898366'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:06.586248 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-241a733e-9b32-4a68-a48a-a0a459e4d13f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b07e3de1804bef8b18645bd5898366'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:06.592647 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1229/2475] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:47:06 2021] DELETE /identity/v3/users/51b07e3de1804bef8b18645bd5898366 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:47:06.597203 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b57959-55ec-4a27-8767-13cb5f34d75e None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:06.597683 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b57959-55ec-4a27-8767-13cb5f34d75e None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:06.597792 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b57959-55ec-4a27-8767-13cb5f34d75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:06.614890 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-b5b57959-55ec-4a27-8767-13cb5f34d75e None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:06.616083 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b5b57959-55ec-4a27-8767-13cb5f34d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:06.674301 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1247/2476] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:47:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:47:06.684014 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a733e-9b32-4a68-a48a-a0a459e4d13f admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:06.685460 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-241a733e-9b32-4a68-a48a-a0a459e4d13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:06.740438 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241a733e-9b32-4a68-a48a-a0a459e4d13f admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:06.744039 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01141347-de30-4695-992a-5f1bd6b5e461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:06.744668 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01141347-de30-4695-992a-5f1bd6b5e461 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:06.744946 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01141347-de30-4695-992a-5f1bd6b5e461 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:06.745220 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01141347-de30-4695-992a-5f1bd6b5e461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:06.754226 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01141347-de30-4695-992a-5f1bd6b5e461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:06.755639 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01141347-de30-4695-992a-5f1bd6b5e461 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:06.765805 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1230/2477] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:47:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:47:07.024334 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b57959-55ec-4a27-8767-13cb5f34d75e None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:07.025879 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b5b57959-55ec-4a27-8767-13cb5f34d75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:07.039229 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b57959-55ec-4a27-8767-13cb5f34d75e None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:07.045879 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f5c4e-94fc-4e1d-8a4e-ca35113164d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:07.047157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f5c4e-94fc-4e1d-8a4e-ca35113164d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:07.047634 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f5c4e-94fc-4e1d-8a4e-ca35113164d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:07.048185 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f5c4e-94fc-4e1d-8a4e-ca35113164d5 admin admin] PATH_INFO: `/v3/projects/35b293025ab746fa8462e1357f825161` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:07.049645 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f5c4e-94fc-4e1d-8a4e-ca35113164d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35b293025ab746fa8462e1357f825161)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:07.051596 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f5c4e-94fc-4e1d-8a4e-ca35113164d5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:07.096065 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cb4f5c4e-94fc-4e1d-8a4e-ca35113164d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35b293025ab746fa8462e1357f825161', 'request_id': 'req-cb4f5c4e-94fc-4e1d-8a4e-ca35113164d5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.101156 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cb4f5c4e-94fc-4e1d-8a4e-ca35113164d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35b293025ab746fa8462e1357f825161', 'request_id': 'req-cb4f5c4e-94fc-4e1d-8a4e-ca35113164d5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.108462 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cb4f5c4e-94fc-4e1d-8a4e-ca35113164d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35b293025ab746fa8462e1357f825161', 'request_id': 'req-cb4f5c4e-94fc-4e1d-8a4e-ca35113164d5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.119125 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cb4f5c4e-94fc-4e1d-8a4e-ca35113164d5 admin admin] The token cache is being invalidate because project 35b293025ab746fa8462e1357f825161 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:47:07.119402 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cb4f5c4e-94fc-4e1d-8a4e-ca35113164d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.120032 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cb4f5c4e-94fc-4e1d-8a4e-ca35113164d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.121813 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1248/2478] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:47:07 2021] DELETE /identity/v3/projects/35b293025ab746fa8462e1357f825161 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:47:07.125898 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01141347-de30-4695-992a-5f1bd6b5e461 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:07.135803 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01141347-de30-4695-992a-5f1bd6b5e461 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:07.189380 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d159d-09cd-4cc1-b755-bab9ff22eb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:07.190273 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d159d-09cd-4cc1-b755-bab9ff22eb47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:07.190562 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d159d-09cd-4cc1-b755-bab9ff22eb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:07.190841 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d159d-09cd-4cc1-b755-bab9ff22eb47 admin admin] PATH_INFO: `/v3/users/7eb508d90c984c3fafa5cae3dc3a2e62` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:07.192046 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d159d-09cd-4cc1-b755-bab9ff22eb47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eb508d90c984c3fafa5cae3dc3a2e62)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:07.194506 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d159d-09cd-4cc1-b755-bab9ff22eb47 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:07.237648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a18d159d-09cd-4cc1-b755-bab9ff22eb47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eb508d90c984c3fafa5cae3dc3a2e62'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.246913 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a18d159d-09cd-4cc1-b755-bab9ff22eb47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eb508d90c984c3fafa5cae3dc3a2e62'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.253822 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a18d159d-09cd-4cc1-b755-bab9ff22eb47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eb508d90c984c3fafa5cae3dc3a2e62'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.254485 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a18d159d-09cd-4cc1-b755-bab9ff22eb47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eb508d90c984c3fafa5cae3dc3a2e62'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.266515 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a18d159d-09cd-4cc1-b755-bab9ff22eb47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eb508d90c984c3fafa5cae3dc3a2e62'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.272226 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1231/2479] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:47:07 2021] DELETE /identity/v3/users/7eb508d90c984c3fafa5cae3dc3a2e62 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:47:07.543216 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f5c4e-94fc-4e1d-8a4e-ca35113164d5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:07.544667 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-cb4f5c4e-94fc-4e1d-8a4e-ca35113164d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:07.558925 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f5c4e-94fc-4e1d-8a4e-ca35113164d5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:07.614089 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ead785-b9c9-4d58-9283-31ff4e5b84a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:07.615583 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ead785-b9c9-4d58-9283-31ff4e5b84a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:07.615863 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ead785-b9c9-4d58-9283-31ff4e5b84a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:07.616134 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ead785-b9c9-4d58-9283-31ff4e5b84a5 admin admin] PATH_INFO: `/v3/projects/d52b869deb1542098a29e87f0ddce388` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:07.617320 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ead785-b9c9-4d58-9283-31ff4e5b84a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d52b869deb1542098a29e87f0ddce388)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:07.619259 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ead785-b9c9-4d58-9283-31ff4e5b84a5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:07.661796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d9ead785-b9c9-4d58-9283-31ff4e5b84a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd52b869deb1542098a29e87f0ddce388', 'request_id': 'req-d9ead785-b9c9-4d58-9283-31ff4e5b84a5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.666988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d9ead785-b9c9-4d58-9283-31ff4e5b84a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd52b869deb1542098a29e87f0ddce388', 'request_id': 'req-d9ead785-b9c9-4d58-9283-31ff4e5b84a5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.673716 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d9ead785-b9c9-4d58-9283-31ff4e5b84a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd52b869deb1542098a29e87f0ddce388', 'request_id': 'req-d9ead785-b9c9-4d58-9283-31ff4e5b84a5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.684675 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d9ead785-b9c9-4d58-9283-31ff4e5b84a5 admin admin] The token cache is being invalidate because project d52b869deb1542098a29e87f0ddce388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:47:07.684960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d9ead785-b9c9-4d58-9283-31ff4e5b84a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.685582 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d9ead785-b9c9-4d58-9283-31ff4e5b84a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.687113 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1249/2480] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:47:07 2021] DELETE /identity/v3/projects/d52b869deb1542098a29e87f0ddce388 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:47:07.691373 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d159d-09cd-4cc1-b755-bab9ff22eb47 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:07.692830 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a18d159d-09cd-4cc1-b755-bab9ff22eb47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:07.705176 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d159d-09cd-4cc1-b755-bab9ff22eb47 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:07.759514 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55976014-c00d-4d2c-9c81-311abd1f9877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:07.760313 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55976014-c00d-4d2c-9c81-311abd1f9877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:07.760598 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55976014-c00d-4d2c-9c81-311abd1f9877 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:07.760908 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55976014-c00d-4d2c-9c81-311abd1f9877 admin admin] PATH_INFO: `/v3/users/52c74f7cffec442ea9d2538a43445bee` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:07.762160 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55976014-c00d-4d2c-9c81-311abd1f9877 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52c74f7cffec442ea9d2538a43445bee)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:07.764153 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55976014-c00d-4d2c-9c81-311abd1f9877 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:07.809130 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-55976014-c00d-4d2c-9c81-311abd1f9877 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52c74f7cffec442ea9d2538a43445bee'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.817054 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-55976014-c00d-4d2c-9c81-311abd1f9877 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52c74f7cffec442ea9d2538a43445bee'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.824606 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-55976014-c00d-4d2c-9c81-311abd1f9877 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52c74f7cffec442ea9d2538a43445bee'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.825239 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-55976014-c00d-4d2c-9c81-311abd1f9877 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52c74f7cffec442ea9d2538a43445bee'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.836393 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-55976014-c00d-4d2c-9c81-311abd1f9877 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52c74f7cffec442ea9d2538a43445bee'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:07.842752 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1232/2481] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:47:07 2021] DELETE /identity/v3/users/52c74f7cffec442ea9d2538a43445bee => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:47:08.100089 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ead785-b9c9-4d58-9283-31ff4e5b84a5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:08.101535 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-d9ead785-b9c9-4d58-9283-31ff4e5b84a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:08.114473 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ead785-b9c9-4d58-9283-31ff4e5b84a5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:08.169335 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc76680a-89fc-4843-acdd-4d5875ff8534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:08.170235 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76680a-89fc-4843-acdd-4d5875ff8534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:08.170524 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76680a-89fc-4843-acdd-4d5875ff8534 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:08.170798 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc76680a-89fc-4843-acdd-4d5875ff8534 admin admin] PATH_INFO: `/v3/projects/6c9e2b28c07d4be2bd3428312dcbfd3a` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:08.171987 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76680a-89fc-4843-acdd-4d5875ff8534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c9e2b28c07d4be2bd3428312dcbfd3a)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:08.173881 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc76680a-89fc-4843-acdd-4d5875ff8534 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:08.216820 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-bc76680a-89fc-4843-acdd-4d5875ff8534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c9e2b28c07d4be2bd3428312dcbfd3a', 'request_id': 'req-bc76680a-89fc-4843-acdd-4d5875ff8534'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:08.222009 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-bc76680a-89fc-4843-acdd-4d5875ff8534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c9e2b28c07d4be2bd3428312dcbfd3a', 'request_id': 'req-bc76680a-89fc-4843-acdd-4d5875ff8534'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:08.229231 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-bc76680a-89fc-4843-acdd-4d5875ff8534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c9e2b28c07d4be2bd3428312dcbfd3a', 'request_id': 'req-bc76680a-89fc-4843-acdd-4d5875ff8534'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:08.239643 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-bc76680a-89fc-4843-acdd-4d5875ff8534 admin admin] The token cache is being invalidate because project 6c9e2b28c07d4be2bd3428312dcbfd3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:47:08.239935 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-bc76680a-89fc-4843-acdd-4d5875ff8534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:08.240634 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-bc76680a-89fc-4843-acdd-4d5875ff8534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:08.242111 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1250/2482] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:47:08 2021] DELETE /identity/v3/projects/6c9e2b28c07d4be2bd3428312dcbfd3a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:47:08.250708 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3951a-bf96-4d34-b35d-967a4ef978ed None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:08.250998 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3951a-bf96-4d34-b35d-967a4ef978ed None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:08.251297 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3951a-bf96-4d34-b35d-967a4ef978ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:08.268252 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-77b3951a-bf96-4d34-b35d-967a4ef978ed None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:08.269447 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-77b3951a-bf96-4d34-b35d-967a4ef978ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:08.327015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1233/2483] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:47:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:47:08.337730 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f000c-7524-4888-9966-48e3037cec25 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:08.338050 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f000c-7524-4888-9966-48e3037cec25 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:08.338327 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3f000c-7524-4888-9966-48e3037cec25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:08.357035 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-0e3f000c-7524-4888-9966-48e3037cec25 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:08.358382 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-0e3f000c-7524-4888-9966-48e3037cec25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:08.366450 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1251/2484] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:47:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:47:08.370774 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3951a-bf96-4d34-b35d-967a4ef978ed None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:08.390191 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3951a-bf96-4d34-b35d-967a4ef978ed None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:08.394903 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2608481-13de-4bbf-8016-0430c3fa2fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:08.396201 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2608481-13de-4bbf-8016-0430c3fa2fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:08.396484 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2608481-13de-4bbf-8016-0430c3fa2fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:08.396763 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2608481-13de-4bbf-8016-0430c3fa2fa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:08.397508 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2608481-13de-4bbf-8016-0430c3fa2fa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:47:08.397818 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2608481-13de-4bbf-8016-0430c3fa2fa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:08.399468 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2608481-13de-4bbf-8016-0430c3fa2fa1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:08.410706 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1234/2485] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:47:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 16:47:08.415059 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f000c-7524-4888-9966-48e3037cec25 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:08.423956 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3f000c-7524-4888-9966-48e3037cec25 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:08.428588 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840316b0-5bd3-4dac-aadf-c8b25df531f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:08.429227 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840316b0-5bd3-4dac-aadf-c8b25df531f9 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:08.429508 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840316b0-5bd3-4dac-aadf-c8b25df531f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:08.429780 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840316b0-5bd3-4dac-aadf-c8b25df531f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:08.430513 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840316b0-5bd3-4dac-aadf-c8b25df531f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:08.432376 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840316b0-5bd3-4dac-aadf-c8b25df531f9 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:08.457896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1252/2486] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:47:08 2021] POST /identity/v3/projects => generated 373 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:47:08.462384 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2608481-13de-4bbf-8016-0430c3fa2fa1 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:08.472528 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2608481-13de-4bbf-8016-0430c3fa2fa1 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:08.528648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed04d7c-1bc0-4607-9b3e-1332fcda6eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:08.529219 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04d7c-1bc0-4607-9b3e-1332fcda6eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:08.529504 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04d7c-1bc0-4607-9b3e-1332fcda6eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:08.529783 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed04d7c-1bc0-4607-9b3e-1332fcda6eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:08.530534 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed04d7c-1bc0-4607-9b3e-1332fcda6eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:08.532457 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed04d7c-1bc0-4607-9b3e-1332fcda6eb7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:08.553225 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1235/2487] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:47:08 2021] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:47:08.557463 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840316b0-5bd3-4dac-aadf-c8b25df531f9 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:08.568282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840316b0-5bd3-4dac-aadf-c8b25df531f9 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:08.572780 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c59a0f-99d4-47be-977b-c5a64d779bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:08.573428 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c59a0f-99d4-47be-977b-c5a64d779bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:08.573705 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c59a0f-99d4-47be-977b-c5a64d779bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:08.574006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c59a0f-99d4-47be-977b-c5a64d779bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:08.574760 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c59a0f-99d4-47be-977b-c5a64d779bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:08.576341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c59a0f-99d4-47be-977b-c5a64d779bf3 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:08.589510 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1253/2488] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:47:08 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:47:08.593765 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed04d7c-1bc0-4607-9b3e-1332fcda6eb7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:08.603614 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed04d7c-1bc0-4607-9b3e-1332fcda6eb7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:08.609557 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5487c93-1fdb-405d-b589-a74ba0fde8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:08.610236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5487c93-1fdb-405d-b589-a74ba0fde8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:08.610638 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5487c93-1fdb-405d-b589-a74ba0fde8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:08.610797 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5487c93-1fdb-405d-b589-a74ba0fde8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:08.611796 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5487c93-1fdb-405d-b589-a74ba0fde8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:08.613358 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5487c93-1fdb-405d-b589-a74ba0fde8e7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:08.623428 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1236/2489] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:47:08 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:47:08.627489 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c59a0f-99d4-47be-977b-c5a64d779bf3 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:08.637667 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c59a0f-99d4-47be-977b-c5a64d779bf3 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:08.642505 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35039464-2577-46e8-be6a-d6a883ddbaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:08.643375 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35039464-2577-46e8-be6a-d6a883ddbaf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:08.643653 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35039464-2577-46e8-be6a-d6a883ddbaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:08.643919 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35039464-2577-46e8-be6a-d6a883ddbaf1 admin admin] PATH_INFO: `/v3/projects/c92d01c81a8e490e9c103c0351f7ad1b/users/5f31ab27b7e34eaa8c02e06c9c6a14ec/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:08.658872 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35039464-2577-46e8-be6a-d6a883ddbaf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c92d01c81a8e490e9c103c0351f7ad1b, user_id=5f31ab27b7e34eaa8c02e06c9c6a14ec, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:08.661508 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35039464-2577-46e8-be6a-d6a883ddbaf1 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:08.673661 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1254/2490] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:47:08 2021] PUT /identity/v3/projects/c92d01c81a8e490e9c103c0351f7ad1b/users/5f31ab27b7e34eaa8c02e06c9c6a14ec/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:47:08.678607 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccced9f4-9604-42bf-9df2-85d69a026765 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:08.678895 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccced9f4-9604-42bf-9df2-85d69a026765 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:08.679174 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccced9f4-9604-42bf-9df2-85d69a026765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:08.698301 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-ccced9f4-9604-42bf-9df2-85d69a026765 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:08.699478 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-ccced9f4-9604-42bf-9df2-85d69a026765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:08.755606 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1237/2491] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:47:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:47:08.765440 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35039464-2577-46e8-be6a-d6a883ddbaf1 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:08.767197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-35039464-2577-46e8-be6a-d6a883ddbaf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:08.823925 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35039464-2577-46e8-be6a-d6a883ddbaf1 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:08.827726 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c28941-5f2c-4727-aa82-b758a5335372 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:08.828371 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c28941-5f2c-4727-aa82-b758a5335372 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:08.828657 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c28941-5f2c-4727-aa82-b758a5335372 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:08.828937 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c28941-5f2c-4727-aa82-b758a5335372 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:08.838148 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c28941-5f2c-4727-aa82-b758a5335372 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:08.839606 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c28941-5f2c-4727-aa82-b758a5335372 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:08.849281 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1255/2492] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:47:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:47:09.485337 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797e083-f136-40ae-8fb7-f35f817c584f None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:09.485626 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797e083-f136-40ae-8fb7-f35f817c584f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:09.486187 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797e083-f136-40ae-8fb7-f35f817c584f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:09.515558 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-5797e083-f136-40ae-8fb7-f35f817c584f None None] MFA Rules not processed for user `5f31ab27b7e34eaa8c02e06c9c6a14ec`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:09.516881 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-5797e083-f136-40ae-8fb7-f35f817c584f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:09.596623 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1238/2493] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:47:09 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:47:09.602417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c28941-5f2c-4727-aa82-b758a5335372 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:09.612104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c28941-5f2c-4727-aa82-b758a5335372 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:09.617668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa971-7ccb-44a9-9028-f8550724823c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:09.618538 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa971-7ccb-44a9-9028-f8550724823c admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:09.618822 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa971-7ccb-44a9-9028-f8550724823c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:09.619100 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa971-7ccb-44a9-9028-f8550724823c admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:09.619801 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72aa971-7ccb-44a9-9028-f8550724823c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:09.622228 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72aa971-7ccb-44a9-9028-f8550724823c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:09.652461 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1256/2494] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:47:09 2021] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:47:09.656278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797e083-f136-40ae-8fb7-f35f817c584f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:09.667428 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797e083-f136-40ae-8fb7-f35f817c584f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:09.724251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0caac3c-1533-48ca-9b69-d41676110b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:09.725021 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caac3c-1533-48ca-9b69-d41676110b12 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:09.725378 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caac3c-1533-48ca-9b69-d41676110b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:09.725728 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caac3c-1533-48ca-9b69-d41676110b12 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:09.726548 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0caac3c-1533-48ca-9b69-d41676110b12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:09.728539 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0caac3c-1533-48ca-9b69-d41676110b12 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:09.751632 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1239/2495] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:47:09 2021] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:47:09.752896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa971-7ccb-44a9-9028-f8550724823c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:09.763092 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa971-7ccb-44a9-9028-f8550724823c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:09.767788 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8b953-aee0-4cc0-8a57-36c102098012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:09.768525 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8b953-aee0-4cc0-8a57-36c102098012 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:09.768874 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8b953-aee0-4cc0-8a57-36c102098012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:09.769150 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8b953-aee0-4cc0-8a57-36c102098012 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:09.770180 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8b953-aee0-4cc0-8a57-36c102098012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:09.772493 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8b953-aee0-4cc0-8a57-36c102098012 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:09.783227 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1257/2496] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:47:09 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:47:09.787977 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0caac3c-1533-48ca-9b69-d41676110b12 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:09.798516 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0caac3c-1533-48ca-9b69-d41676110b12 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:09.803130 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf9b90-98e8-45fd-8a49-8e6495d58a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:09.803997 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf9b90-98e8-45fd-8a49-8e6495d58a64 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:09.804279 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf9b90-98e8-45fd-8a49-8e6495d58a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:09.804555 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf9b90-98e8-45fd-8a49-8e6495d58a64 admin admin] PATH_INFO: `/v3/projects/2777faa3a60d4316ba614f91b1146109/users/7d5fef1ce3e94490a946ed7305af4930/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:09.819164 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf9b90-98e8-45fd-8a49-8e6495d58a64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2777faa3a60d4316ba614f91b1146109, user_id=7d5fef1ce3e94490a946ed7305af4930, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:09.821874 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bf9b90-98e8-45fd-8a49-8e6495d58a64 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:09.835190 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1240/2497] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:47:09 2021] PUT /identity/v3/projects/2777faa3a60d4316ba614f91b1146109/users/7d5fef1ce3e94490a946ed7305af4930/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:47:09.839170 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8b953-aee0-4cc0-8a57-36c102098012 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:09.850863 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8b953-aee0-4cc0-8a57-36c102098012 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:09.911966 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91625c6-4b24-4ca2-8cfe-fd61c0535857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:09.912637 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91625c6-4b24-4ca2-8cfe-fd61c0535857 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:09.912919 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91625c6-4b24-4ca2-8cfe-fd61c0535857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:09.913201 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91625c6-4b24-4ca2-8cfe-fd61c0535857 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:09.913988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91625c6-4b24-4ca2-8cfe-fd61c0535857 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:09.915583 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91625c6-4b24-4ca2-8cfe-fd61c0535857 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:09.925143 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1258/2498] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:47:09 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:47:09.929258 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf9b90-98e8-45fd-8a49-8e6495d58a64 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:09.940745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bf9b90-98e8-45fd-8a49-8e6495d58a64 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:09.946978 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a7475-d795-4036-bae3-c3e3b8ab99c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:09.947852 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a7475-d795-4036-bae3-c3e3b8ab99c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:09.948134 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a7475-d795-4036-bae3-c3e3b8ab99c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:09.948404 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a7475-d795-4036-bae3-c3e3b8ab99c0 admin admin] PATH_INFO: `/v3/projects/2777faa3a60d4316ba614f91b1146109/users/7d5fef1ce3e94490a946ed7305af4930/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:09.950414 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a7475-d795-4036-bae3-c3e3b8ab99c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2777faa3a60d4316ba614f91b1146109, user_id=7d5fef1ce3e94490a946ed7305af4930, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:09.954235 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a7475-d795-4036-bae3-c3e3b8ab99c0 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:09.966582 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1241/2499] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:47:09 2021] PUT /identity/v3/projects/2777faa3a60d4316ba614f91b1146109/users/7d5fef1ce3e94490a946ed7305af4930/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:47:10.698452 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e6d1d-d9ae-442d-8ad5-e6aa3088da98 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:10.699302 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e6d1d-d9ae-442d-8ad5-e6aa3088da98 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:10.699750 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6e6d1d-d9ae-442d-8ad5-e6aa3088da98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:10.746468 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-ef6e6d1d-d9ae-442d-8ad5-e6aa3088da98 None None] MFA Rules not processed for user `7d5fef1ce3e94490a946ed7305af4930`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:10.748036 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ef6e6d1d-d9ae-442d-8ad5-e6aa3088da98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:10.851314 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1259/2500] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:47:10 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:47:10.859008 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a7475-d795-4036-bae3-c3e3b8ab99c0 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:10.861357 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-4b9a7475-d795-4036-bae3-c3e3b8ab99c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:10.934658 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a7475-d795-4036-bae3-c3e3b8ab99c0 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:10.938305 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f137d405-727f-4ed2-977b-02d310ea28f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:10.939266 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137d405-727f-4ed2-977b-02d310ea28f2 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:10.939559 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137d405-727f-4ed2-977b-02d310ea28f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:10.939840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f137d405-727f-4ed2-977b-02d310ea28f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:11.006493 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137d405-727f-4ed2-977b-02d310ea28f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:11.008371 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f137d405-727f-4ed2-977b-02d310ea28f2 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:11.019094 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1242/2501] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:47:10 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:47:14.459948 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e6d1d-d9ae-442d-8ad5-e6aa3088da98 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:14.461364 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ef6e6d1d-d9ae-442d-8ad5-e6aa3088da98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:14.473362 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6e6d1d-d9ae-442d-8ad5-e6aa3088da98 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:14.477337 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91ddd5-f699-46ff-beae-a0441dc59682 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:14.478036 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91ddd5-f699-46ff-beae-a0441dc59682 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:14.478390 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91ddd5-f699-46ff-beae-a0441dc59682 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:14.478649 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91ddd5-f699-46ff-beae-a0441dc59682 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:14.487929 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91ddd5-f699-46ff-beae-a0441dc59682 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:14.489419 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf91ddd5-f699-46ff-beae-a0441dc59682 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:14.498581 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1260/2502] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:47:14 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:47:14.776251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fa6b9-a69d-4c9d-9933-b01b897af81d None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:14.777070 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fa6b9-a69d-4c9d-9933-b01b897af81d None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:14.777500 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fa6b9-a69d-4c9d-9933-b01b897af81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:14.795403 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-c46fa6b9-a69d-4c9d-9933-b01b897af81d None None] MFA Rules not processed for user `b988f9d7fba841ff9a4af954f862096a`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:14.796729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-c46fa6b9-a69d-4c9d-9933-b01b897af81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:14.861908 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1243/2503] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:47:14 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:47:14.996439 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91ddd5-f699-46ff-beae-a0441dc59682 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:14.998155 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-cf91ddd5-f699-46ff-beae-a0441dc59682 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:15.061255 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91ddd5-f699-46ff-beae-a0441dc59682 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:15.066360 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf986f-b28e-4fe6-a18b-6192ee9486d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:15.068142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf986f-b28e-4fe6-a18b-6192ee9486d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:15.068142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf986f-b28e-4fe6-a18b-6192ee9486d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:15.068336 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcf986f-b28e-4fe6-a18b-6192ee9486d9 admin admin] PATH_INFO: `/v3/users/bf0bb353241e4bc0b79ba90e68f3545e` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:15.069527 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf986f-b28e-4fe6-a18b-6192ee9486d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf0bb353241e4bc0b79ba90e68f3545e)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:15.071485 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcf986f-b28e-4fe6-a18b-6192ee9486d9 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:15.130584 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ebcf986f-b28e-4fe6-a18b-6192ee9486d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf0bb353241e4bc0b79ba90e68f3545e'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:15.131223 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ebcf986f-b28e-4fe6-a18b-6192ee9486d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf0bb353241e4bc0b79ba90e68f3545e'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:15.142607 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ebcf986f-b28e-4fe6-a18b-6192ee9486d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf0bb353241e4bc0b79ba90e68f3545e'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:15.143304 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ebcf986f-b28e-4fe6-a18b-6192ee9486d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf0bb353241e4bc0b79ba90e68f3545e'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:15.150979 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ebcf986f-b28e-4fe6-a18b-6192ee9486d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf0bb353241e4bc0b79ba90e68f3545e'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:15.163580 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1261/2504] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:47:14 2021] DELETE /identity/v3/users/bf0bb353241e4bc0b79ba90e68f3545e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:47:15.168054 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585688d-0806-46a3-a487-2c0f585873ba None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:15.168342 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585688d-0806-46a3-a487-2c0f585873ba None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:15.168619 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585688d-0806-46a3-a487-2c0f585873ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:15.186807 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-1585688d-0806-46a3-a487-2c0f585873ba None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:15.188002 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1585688d-0806-46a3-a487-2c0f585873ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:15.245318 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1244/2505] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:47:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:47:15.254794 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf986f-b28e-4fe6-a18b-6192ee9486d9 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:15.256193 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ebcf986f-b28e-4fe6-a18b-6192ee9486d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:15.313659 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcf986f-b28e-4fe6-a18b-6192ee9486d9 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:15.317386 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1872f6-998a-4379-b30d-a601c260be64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:15.318143 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1872f6-998a-4379-b30d-a601c260be64 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:15.318434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1872f6-998a-4379-b30d-a601c260be64 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:15.318708 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1872f6-998a-4379-b30d-a601c260be64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:15.328532 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1872f6-998a-4379-b30d-a601c260be64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:15.330030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1872f6-998a-4379-b30d-a601c260be64 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:15.340630 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1262/2506] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:47:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:47:15.612481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585688d-0806-46a3-a487-2c0f585873ba None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:15.616237 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1585688d-0806-46a3-a487-2c0f585873ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:15.630915 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585688d-0806-46a3-a487-2c0f585873ba None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:15.636893 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c71390-05d3-4207-9540-cebe3ee02098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:15.637903 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c71390-05d3-4207-9540-cebe3ee02098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:15.638317 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c71390-05d3-4207-9540-cebe3ee02098 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:15.638683 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c71390-05d3-4207-9540-cebe3ee02098 admin admin] PATH_INFO: `/v3/projects/a01d0346d2894708aba98e5242409c22` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:15.639970 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c71390-05d3-4207-9540-cebe3ee02098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a01d0346d2894708aba98e5242409c22)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:15.642928 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c71390-05d3-4207-9540-cebe3ee02098 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:15.704271 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-53c71390-05d3-4207-9540-cebe3ee02098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a01d0346d2894708aba98e5242409c22', 'request_id': 'req-53c71390-05d3-4207-9540-cebe3ee02098'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:15.704271 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-53c71390-05d3-4207-9540-cebe3ee02098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a01d0346d2894708aba98e5242409c22', 'request_id': 'req-53c71390-05d3-4207-9540-cebe3ee02098'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:15.713419 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-53c71390-05d3-4207-9540-cebe3ee02098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a01d0346d2894708aba98e5242409c22', 'request_id': 'req-53c71390-05d3-4207-9540-cebe3ee02098'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:15.726440 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-53c71390-05d3-4207-9540-cebe3ee02098 admin admin] The token cache is being invalidate because project a01d0346d2894708aba98e5242409c22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:47:15.726727 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-53c71390-05d3-4207-9540-cebe3ee02098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:15.727377 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-53c71390-05d3-4207-9540-cebe3ee02098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:47:15.729034 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1245/2507] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:47:15 2021] DELETE /identity/v3/projects/a01d0346d2894708aba98e5242409c22 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:47:15.735820 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94944e9-c52c-462a-8161-e764b8c20098 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:15.736329 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94944e9-c52c-462a-8161-e764b8c20098 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:15.738115 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94944e9-c52c-462a-8161-e764b8c20098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:15.759084 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e94944e9-c52c-462a-8161-e764b8c20098 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:15.759834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e94944e9-c52c-462a-8161-e764b8c20098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:15.834339 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1263/2508] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:47:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:47:15.843112 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abec38e-0054-46c6-b90f-871a1f2d539e None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:15.843595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abec38e-0054-46c6-b90f-871a1f2d539e None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:15.843595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abec38e-0054-46c6-b90f-871a1f2d539e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:15.866590 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-2abec38e-0054-46c6-b90f-871a1f2d539e None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:15.868136 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-2abec38e-0054-46c6-b90f-871a1f2d539e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:15.878479 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1246/2509] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:47:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:47:15.883204 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94944e9-c52c-462a-8161-e764b8c20098 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:15.893359 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94944e9-c52c-462a-8161-e764b8c20098 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:15.900918 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c540ab-2ca7-4d0c-9a96-ae8980c4d49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:15.901853 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c540ab-2ca7-4d0c-9a96-ae8980c4d49d admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:15.902134 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c540ab-2ca7-4d0c-9a96-ae8980c4d49d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:15.902418 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c540ab-2ca7-4d0c-9a96-ae8980c4d49d admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:15.903197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c540ab-2ca7-4d0c-9a96-ae8980c4d49d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:47:15.903658 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c540ab-2ca7-4d0c-9a96-ae8980c4d49d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:15.905355 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c540ab-2ca7-4d0c-9a96-ae8980c4d49d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:15.917895 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1264/2510] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:47:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:47:15.926609 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abec38e-0054-46c6-b90f-871a1f2d539e None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:15.937049 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abec38e-0054-46c6-b90f-871a1f2d539e None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:15.950975 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863aa1b9-ff51-4be7-b201-e2e4589d9e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:15.952005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aa1b9-ff51-4be7-b201-e2e4589d9e8d admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:15.952553 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aa1b9-ff51-4be7-b201-e2e4589d9e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:15.953200 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863aa1b9-ff51-4be7-b201-e2e4589d9e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:15.954440 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863aa1b9-ff51-4be7-b201-e2e4589d9e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:15.956838 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863aa1b9-ff51-4be7-b201-e2e4589d9e8d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:16.012012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1247/2511] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:47:15 2021] POST /identity/v3/projects => generated 385 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:47:16.013264 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c540ab-2ca7-4d0c-9a96-ae8980c4d49d admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:16.025696 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c540ab-2ca7-4d0c-9a96-ae8980c4d49d admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:16.096993 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026e48e-d133-4de2-a857-2c96fa3a4bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:16.097675 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026e48e-d133-4de2-a857-2c96fa3a4bfc admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:16.098036 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026e48e-d133-4de2-a857-2c96fa3a4bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:16.098723 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d026e48e-d133-4de2-a857-2c96fa3a4bfc admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:16.099562 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026e48e-d133-4de2-a857-2c96fa3a4bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:16.101595 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d026e48e-d133-4de2-a857-2c96fa3a4bfc admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:16.125214 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1265/2512] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:47:16 2021] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:47:16.126628 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863aa1b9-ff51-4be7-b201-e2e4589d9e8d admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:16.137706 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863aa1b9-ff51-4be7-b201-e2e4589d9e8d admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:16.142465 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9e36f-d1c9-4a7c-9e82-f13d38992997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:16.143203 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9e36f-d1c9-4a7c-9e82-f13d38992997 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:16.143483 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9e36f-d1c9-4a7c-9e82-f13d38992997 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:16.143755 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d9e36f-d1c9-4a7c-9e82-f13d38992997 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:16.144484 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9e36f-d1c9-4a7c-9e82-f13d38992997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:16.146770 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d9e36f-d1c9-4a7c-9e82-f13d38992997 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:16.161022 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1248/2513] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:47:16 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:47:16.162288 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026e48e-d133-4de2-a857-2c96fa3a4bfc admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:16.172414 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d026e48e-d133-4de2-a857-2c96fa3a4bfc admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:16.177161 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacfab48-404e-4345-bf67-f758d894455d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:16.177821 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfab48-404e-4345-bf67-f758d894455d admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:16.178145 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfab48-404e-4345-bf67-f758d894455d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:16.178491 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacfab48-404e-4345-bf67-f758d894455d admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:16.179229 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfab48-404e-4345-bf67-f758d894455d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:16.180821 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacfab48-404e-4345-bf67-f758d894455d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:16.190742 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1266/2514] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:47:16 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:47:16.195290 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9e36f-d1c9-4a7c-9e82-f13d38992997 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:16.204966 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d9e36f-d1c9-4a7c-9e82-f13d38992997 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:16.210229 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00167262-d83a-442d-9938-7c19893dfeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:16.211158 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00167262-d83a-442d-9938-7c19893dfeba admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:16.211441 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00167262-d83a-442d-9938-7c19893dfeba admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:16.211723 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00167262-d83a-442d-9938-7c19893dfeba admin admin] PATH_INFO: `/v3/projects/fe8e3de0e96049638fab9d116d4de1b4/users/b82bc9ff0fd64991b2718f31e215deef/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:16.226863 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00167262-d83a-442d-9938-7c19893dfeba admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe8e3de0e96049638fab9d116d4de1b4, user_id=b82bc9ff0fd64991b2718f31e215deef, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:16.229645 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00167262-d83a-442d-9938-7c19893dfeba admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:16.244280 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1249/2515] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:47:16 2021] PUT /identity/v3/projects/fe8e3de0e96049638fab9d116d4de1b4/users/b82bc9ff0fd64991b2718f31e215deef/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:47:16.249535 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d49dc-a0a8-40b6-97c2-aa31cbc16a7a None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:16.249897 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d49dc-a0a8-40b6-97c2-aa31cbc16a7a None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:16.250259 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386d49dc-a0a8-40b6-97c2-aa31cbc16a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:16.270141 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-386d49dc-a0a8-40b6-97c2-aa31cbc16a7a None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:16.271291 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-386d49dc-a0a8-40b6-97c2-aa31cbc16a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:16.326835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1267/2516] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:47:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 16:47:16.336699 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00167262-d83a-442d-9938-7c19893dfeba admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:16.338378 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-00167262-d83a-442d-9938-7c19893dfeba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:16.392081 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00167262-d83a-442d-9938-7c19893dfeba admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:16.395677 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab8fc4-21ab-4f2e-8e0c-311f80beb38d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:16.396302 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab8fc4-21ab-4f2e-8e0c-311f80beb38d service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:16.396581 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab8fc4-21ab-4f2e-8e0c-311f80beb38d service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:16.396853 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab8fc4-21ab-4f2e-8e0c-311f80beb38d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:16.405556 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab8fc4-21ab-4f2e-8e0c-311f80beb38d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:16.406994 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab8fc4-21ab-4f2e-8e0c-311f80beb38d service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:16.416059 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1250/2517] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:47:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:47:21.013836 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66a38e-937b-4e61-91f4-49ff409f2b75 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:21.015310 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66a38e-937b-4e61-91f4-49ff409f2b75 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:21.015784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66a38e-937b-4e61-91f4-49ff409f2b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:21.050734 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-dd66a38e-937b-4e61-91f4-49ff409f2b75 None None] MFA Rules not processed for user `b82bc9ff0fd64991b2718f31e215deef`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:21.052272 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-dd66a38e-937b-4e61-91f4-49ff409f2b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:21.125506 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1268/2518] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:47:21 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:47:21.130296 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab8fc4-21ab-4f2e-8e0c-311f80beb38d service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:21.140431 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab8fc4-21ab-4f2e-8e0c-311f80beb38d service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:21.145244 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a7662-2da1-4753-9128-e67a66e3874f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:21.146759 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a7662-2da1-4753-9128-e67a66e3874f admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:21.147117 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a7662-2da1-4753-9128-e67a66e3874f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:21.147399 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a7662-2da1-4753-9128-e67a66e3874f admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:21.148130 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a7662-2da1-4753-9128-e67a66e3874f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:21.150064 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a7662-2da1-4753-9128-e67a66e3874f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:21.175419 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1251/2519] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:47:21 2021] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:47:21.179260 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66a38e-937b-4e61-91f4-49ff409f2b75 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:21.190236 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66a38e-937b-4e61-91f4-49ff409f2b75 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:21.255741 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac292488-4e30-4ffd-aa0c-279826d865da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:21.256566 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac292488-4e30-4ffd-aa0c-279826d865da admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:21.256919 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac292488-4e30-4ffd-aa0c-279826d865da admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:21.257268 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac292488-4e30-4ffd-aa0c-279826d865da admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:21.258124 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac292488-4e30-4ffd-aa0c-279826d865da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:21.260091 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac292488-4e30-4ffd-aa0c-279826d865da admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:21.281234 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1269/2520] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:47:21 2021] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:47:21.285188 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a7662-2da1-4753-9128-e67a66e3874f admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:21.297400 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a7662-2da1-4753-9128-e67a66e3874f admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:21.302461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7527797-1c68-4d05-938e-05ce22a5c80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:21.303159 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7527797-1c68-4d05-938e-05ce22a5c80c admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:21.303446 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7527797-1c68-4d05-938e-05ce22a5c80c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:21.303727 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7527797-1c68-4d05-938e-05ce22a5c80c admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:21.304469 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7527797-1c68-4d05-938e-05ce22a5c80c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:21.306097 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7527797-1c68-4d05-938e-05ce22a5c80c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:21.320820 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1252/2521] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:47:21 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 16:47:21.324967 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac292488-4e30-4ffd-aa0c-279826d865da admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:21.338621 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac292488-4e30-4ffd-aa0c-279826d865da admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:21.349872 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17dc0d-61ee-416e-b590-e06a664261a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:21.350956 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17dc0d-61ee-416e-b590-e06a664261a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:21.351366 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17dc0d-61ee-416e-b590-e06a664261a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:21.351706 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c17dc0d-61ee-416e-b590-e06a664261a7 admin admin] PATH_INFO: `/v3/projects/4affcf541cc144d7be507c9cc69088b8/users/f8754107b86942ba8ddd71076c268c30/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:21.367351 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17dc0d-61ee-416e-b590-e06a664261a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4affcf541cc144d7be507c9cc69088b8, user_id=f8754107b86942ba8ddd71076c268c30, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:21.371677 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c17dc0d-61ee-416e-b590-e06a664261a7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:21.389914 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1270/2522] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:47:21 2021] PUT /identity/v3/projects/4affcf541cc144d7be507c9cc69088b8/users/f8754107b86942ba8ddd71076c268c30/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:47:21.394438 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7527797-1c68-4d05-938e-05ce22a5c80c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:21.405033 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7527797-1c68-4d05-938e-05ce22a5c80c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:21.459204 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed864059-1505-46bb-8181-5d7eb1e1bcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:21.459857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed864059-1505-46bb-8181-5d7eb1e1bcfa admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:21.460135 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed864059-1505-46bb-8181-5d7eb1e1bcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:21.460402 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed864059-1505-46bb-8181-5d7eb1e1bcfa admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:21.461123 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed864059-1505-46bb-8181-5d7eb1e1bcfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:21.462737 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed864059-1505-46bb-8181-5d7eb1e1bcfa admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:21.472378 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1253/2523] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:47:21 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:47:21.476609 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17dc0d-61ee-416e-b590-e06a664261a7 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:21.486647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c17dc0d-61ee-416e-b590-e06a664261a7 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:21.491771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bf5c3-f63f-48e8-8b98-931d635ae501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:21.492639 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bf5c3-f63f-48e8-8b98-931d635ae501 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:21.492923 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bf5c3-f63f-48e8-8b98-931d635ae501 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:21.493198 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175bf5c3-f63f-48e8-8b98-931d635ae501 admin admin] PATH_INFO: `/v3/projects/4affcf541cc144d7be507c9cc69088b8/users/f8754107b86942ba8ddd71076c268c30/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:21.495254 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bf5c3-f63f-48e8-8b98-931d635ae501 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4affcf541cc144d7be507c9cc69088b8, user_id=f8754107b86942ba8ddd71076c268c30, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:21.497873 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175bf5c3-f63f-48e8-8b98-931d635ae501 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:21.508304 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1271/2524] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:47:21 2021] PUT /identity/v3/projects/4affcf541cc144d7be507c9cc69088b8/users/f8754107b86942ba8ddd71076c268c30/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:47:26.633117 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36882346-e7c5-4dba-9432-12caa9b19c6c None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:26.633598 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36882346-e7c5-4dba-9432-12caa9b19c6c None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:26.633714 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36882346-e7c5-4dba-9432-12caa9b19c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:26.667662 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-36882346-e7c5-4dba-9432-12caa9b19c6c None None] MFA Rules not processed for user `f8754107b86942ba8ddd71076c268c30`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:26.669339 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-36882346-e7c5-4dba-9432-12caa9b19c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:26.755026 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1254/2525] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:47:26 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:47:26.768027 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bf5c3-f63f-48e8-8b98-931d635ae501 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:26.769794 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-175bf5c3-f63f-48e8-8b98-931d635ae501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:26.853142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175bf5c3-f63f-48e8-8b98-931d635ae501 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:26.858443 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7a468-fceb-4c9c-9652-44ee225accc8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27a0c9ae2bf40caa92e9dbceff8d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:26.859134 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7a468-fceb-4c9c-9652-44ee225accc8 service glance] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:26.859418 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7a468-fceb-4c9c-9652-44ee225accc8 service glance] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:26.859694 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7a468-fceb-4c9c-9652-44ee225accc8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:26.926476 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7a468-fceb-4c9c-9652-44ee225accc8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:26.928049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7a468-fceb-4c9c-9652-44ee225accc8 service glance] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:26.937883 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1272/2526] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:47:26 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:47:27.063715 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377f13b-d479-4e2f-97fa-e20636881f04 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:27.064004 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377f13b-d479-4e2f-97fa-e20636881f04 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:27.064277 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377f13b-d479-4e2f-97fa-e20636881f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:27.125460 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-5377f13b-d479-4e2f-97fa-e20636881f04 None None] MFA Rules not processed for user `10b4daa146fa4b638d90ea1e9a4878eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:27.126721 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-5377f13b-d479-4e2f-97fa-e20636881f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:27.196546 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1255/2527] 10.222.0.41 () {58 vars in 1009 bytes} [Fri Oct 29 16:47:27 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:47:27.256650 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7a468-fceb-4c9c-9652-44ee225accc8 service glance] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:27.258189 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-bde7a468-fceb-4c9c-9652-44ee225accc8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:27.351488 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7a468-fceb-4c9c-9652-44ee225accc8 service glance] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:27.357599 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b4c2f-4af0-49e9-b903-a70bb54e8e2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f518ae309c4b4f7eacca882b58e58bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:27.358299 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b4c2f-4af0-49e9-b903-a70bb54e8e2d service swift] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:27.358587 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b4c2f-4af0-49e9-b903-a70bb54e8e2d service swift] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:27.358865 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b4c2f-4af0-49e9-b903-a70bb54e8e2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:27.367581 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b4c2f-4af0-49e9-b903-a70bb54e8e2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:27.369180 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b4c2f-4af0-49e9-b903-a70bb54e8e2d service swift] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:27.377607 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1273/2528] 10.222.0.41 () {60 vars in 1384 bytes} [Fri Oct 29 16:47:27 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 16:47:36.619669 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8360d-68cf-4ab9-8a1a-d7f674580837 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:36.620278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8360d-68cf-4ab9-8a1a-d7f674580837 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:36.620278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8360d-68cf-4ab9-8a1a-d7f674580837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:36.638344 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-cfc8360d-68cf-4ab9-8a1a-d7f674580837 None None] MFA Rules not processed for user `b82bc9ff0fd64991b2718f31e215deef`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:36.639558 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-cfc8360d-68cf-4ab9-8a1a-d7f674580837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:36.646601 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1256/2529] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:47:36 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:47:36.895137 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b4c2f-4af0-49e9-b903-a70bb54e8e2d service swift] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:36.896531 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ae2b4c2f-4af0-49e9-b903-a70bb54e8e2d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:36.950362 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b4c2f-4af0-49e9-b903-a70bb54e8e2d service swift] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:36.953853 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5d558-2d51-48ec-8ea8-d9a9af63e72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:36.954508 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5d558-2d51-48ec-8ea8-d9a9af63e72d service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:36.954784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5d558-2d51-48ec-8ea8-d9a9af63e72d service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:36.955053 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5d558-2d51-48ec-8ea8-d9a9af63e72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:36.956742 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-fad5d558-2d51-48ec-8ea8-d9a9af63e72d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:36.966020 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5d558-2d51-48ec-8ea8-d9a9af63e72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:36.967462 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5d558-2d51-48ec-8ea8-d9a9af63e72d service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:36.975785 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1274/2530] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:47:36 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:47:38.447327 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc7173-2d3d-49c3-b653-21830c41eeb7 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:38.447801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc7173-2d3d-49c3-b653-21830c41eeb7 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:38.448147 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc7173-2d3d-49c3-b653-21830c41eeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:38.470339 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-81bc7173-2d3d-49c3-b653-21830c41eeb7 None None] MFA Rules not processed for user `10b4daa146fa4b638d90ea1e9a4878eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:47:38.471601 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-81bc7173-2d3d-49c3-b653-21830c41eeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:38.479325 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1257/2531] 10.222.0.41 () {58 vars in 1009 bytes} [Fri Oct 29 16:47:38 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:47:38.492553 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5d558-2d51-48ec-8ea8-d9a9af63e72d service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:38.505365 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5d558-2d51-48ec-8ea8-d9a9af63e72d service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:38.510373 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c5b3e-235b-4cc2-a3ae-3d14cc17a1e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f518ae309c4b4f7eacca882b58e58bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:38.511013 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c5b3e-235b-4cc2-a3ae-3d14cc17a1e5 service swift] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:38.511409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c5b3e-235b-4cc2-a3ae-3d14cc17a1e5 service swift] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:38.511691 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c5b3e-235b-4cc2-a3ae-3d14cc17a1e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:38.520231 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c5b3e-235b-4cc2-a3ae-3d14cc17a1e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:38.521853 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c5b3e-235b-4cc2-a3ae-3d14cc17a1e5 service swift] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:38.530165 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1275/2532] 10.222.0.41 () {60 vars in 1384 bytes} [Fri Oct 29 16:47:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 29 16:47:53.453414 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc7173-2d3d-49c3-b653-21830c41eeb7 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:47:53.481132 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc7173-2d3d-49c3-b653-21830c41eeb7 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:47:53.484947 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa243ee-b60c-4b9e-a4ce-0e9952b9e454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:47:53.485591 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa243ee-b60c-4b9e-a4ce-0e9952b9e454 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:47:53.485876 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa243ee-b60c-4b9e-a4ce-0e9952b9e454 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:47:53.486186 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa243ee-b60c-4b9e-a4ce-0e9952b9e454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:47:53.488389 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-faa243ee-b60c-4b9e-a4ce-0e9952b9e454 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:47:53.599610 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa243ee-b60c-4b9e-a4ce-0e9952b9e454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:47:53.601064 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa243ee-b60c-4b9e-a4ce-0e9952b9e454 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:47:53.612560 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1258/2533] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:47:53 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:49:40.692930 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c5b3e-235b-4cc2-a3ae-3d14cc17a1e5 service swift] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:49:40.694435 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-7f7c5b3e-235b-4cc2-a3ae-3d14cc17a1e5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:49:40.765515 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c5b3e-235b-4cc2-a3ae-3d14cc17a1e5 service swift] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:49:40.769204 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8dcc2-d745-47fb-938b-c9d98190b926 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:49:40.769835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8dcc2-d745-47fb-938b-c9d98190b926 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:49:40.770781 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8dcc2-d745-47fb-938b-c9d98190b926 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:49:40.771063 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8dcc2-d745-47fb-938b-c9d98190b926 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:49:40.772835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ebd8dcc2-d745-47fb-938b-c9d98190b926 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:49:40.828446 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8dcc2-d745-47fb-938b-c9d98190b926 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:49:40.829882 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8dcc2-d745-47fb-938b-c9d98190b926 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:49:40.839315 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1276/2534] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:49:40 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:50:02.684370 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa243ee-b60c-4b9e-a4ce-0e9952b9e454 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:50:02.702579 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa243ee-b60c-4b9e-a4ce-0e9952b9e454 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:50:02.706217 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe11860-3475-493e-8262-83c8a042d26b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:50:02.707349 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe11860-3475-493e-8262-83c8a042d26b service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:50:02.707649 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe11860-3475-493e-8262-83c8a042d26b service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:50:02.707909 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe11860-3475-493e-8262-83c8a042d26b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:50:02.709652 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-bfe11860-3475-493e-8262-83c8a042d26b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:50:02.719112 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe11860-3475-493e-8262-83c8a042d26b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:50:02.720519 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe11860-3475-493e-8262-83c8a042d26b service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:50:02.728936 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1259/2535] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:50:02 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:51:42.640454 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8dcc2-d745-47fb-938b-c9d98190b926 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:51:42.641943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ebd8dcc2-d745-47fb-938b-c9d98190b926 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:51:42.652589 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8dcc2-d745-47fb-938b-c9d98190b926 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:51:42.656183 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69492109-c68c-42da-9c56-44f9a5204d25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:51:42.656821 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69492109-c68c-42da-9c56-44f9a5204d25 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:51:42.657127 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69492109-c68c-42da-9c56-44f9a5204d25 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:51:42.657397 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69492109-c68c-42da-9c56-44f9a5204d25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:51:42.659126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-69492109-c68c-42da-9c56-44f9a5204d25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:51:42.714925 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69492109-c68c-42da-9c56-44f9a5204d25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:51:42.716603 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69492109-c68c-42da-9c56-44f9a5204d25 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:51:42.725741 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1277/2536] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:51:42 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:51:53.230043 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe11860-3475-493e-8262-83c8a042d26b service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:51:53.239126 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe11860-3475-493e-8262-83c8a042d26b service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:51:53.243391 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c7c29-aa37-4792-8433-6b11bc3e1e54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:51:53.244016 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c7c29-aa37-4792-8433-6b11bc3e1e54 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:51:53.244302 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c7c29-aa37-4792-8433-6b11bc3e1e54 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:51:53.244578 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c7c29-aa37-4792-8433-6b11bc3e1e54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:51:53.246334 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-005c7c29-aa37-4792-8433-6b11bc3e1e54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:51:53.302177 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c7c29-aa37-4792-8433-6b11bc3e1e54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:51:53.304245 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c7c29-aa37-4792-8433-6b11bc3e1e54 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:51:53.313044 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1260/2537] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:51:53 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:52:08.010562 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69492109-c68c-42da-9c56-44f9a5204d25 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:52:08.011932 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-69492109-c68c-42da-9c56-44f9a5204d25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:52:08.078190 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69492109-c68c-42da-9c56-44f9a5204d25 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:52:08.083107 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e6742-7c74-4e2c-b5de-9aaf48c7b9f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:52:08.083748 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e6742-7c74-4e2c-b5de-9aaf48c7b9f2 service placement] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:52:08.084053 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e6742-7c74-4e2c-b5de-9aaf48c7b9f2 service placement] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:52:08.084875 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e6742-7c74-4e2c-b5de-9aaf48c7b9f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:52:08.086649 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-5c7e6742-7c74-4e2c-b5de-9aaf48c7b9f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:52:08.097858 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e6742-7c74-4e2c-b5de-9aaf48c7b9f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:52:08.099450 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e6742-7c74-4e2c-b5de-9aaf48c7b9f2 service placement] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:52:08.109532 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1278/2538] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:52:08 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:52:09.894572 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c7c29-aa37-4792-8433-6b11bc3e1e54 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:52:09.903732 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c7c29-aa37-4792-8433-6b11bc3e1e54 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:52:09.907293 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8281b9b-e516-4d57-9bdd-5367c8e7cdc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:52:09.907940 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8281b9b-e516-4d57-9bdd-5367c8e7cdc9 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:52:09.908216 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8281b9b-e516-4d57-9bdd-5367c8e7cdc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:52:09.908488 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8281b9b-e516-4d57-9bdd-5367c8e7cdc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:52:09.910238 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e8281b9b-e516-4d57-9bdd-5367c8e7cdc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:52:09.965952 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8281b9b-e516-4d57-9bdd-5367c8e7cdc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:52:09.967698 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8281b9b-e516-4d57-9bdd-5367c8e7cdc9 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:52:09.977135 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1261/2539] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:52:09 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:52:25.864787 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e6742-7c74-4e2c-b5de-9aaf48c7b9f2 service placement] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:52:25.873905 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e6742-7c74-4e2c-b5de-9aaf48c7b9f2 service placement] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:52:25.877482 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b66aaa-2974-46e0-8651-de4172139dcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:52:25.878132 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b66aaa-2974-46e0-8651-de4172139dcd service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:52:25.878407 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b66aaa-2974-46e0-8651-de4172139dcd service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:52:25.878675 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b66aaa-2974-46e0-8651-de4172139dcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:52:25.886642 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b66aaa-2974-46e0-8651-de4172139dcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:52:25.888048 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b66aaa-2974-46e0-8651-de4172139dcd service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:52:25.897107 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1279/2540] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:52:25 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:53:15.045705 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8281b9b-e516-4d57-9bdd-5367c8e7cdc9 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:53:15.054216 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8281b9b-e516-4d57-9bdd-5367c8e7cdc9 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:53:15.058447 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26724eb7-8592-497c-ad07-33ee14c442bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:53:15.059084 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26724eb7-8592-497c-ad07-33ee14c442bd service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:53:15.059365 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26724eb7-8592-497c-ad07-33ee14c442bd service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:53:15.059660 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26724eb7-8592-497c-ad07-33ee14c442bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:53:15.061443 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-26724eb7-8592-497c-ad07-33ee14c442bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:53:15.093580 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26724eb7-8592-497c-ad07-33ee14c442bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:53:15.095256 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26724eb7-8592-497c-ad07-33ee14c442bd service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:53:15.115409 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1262/2541] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:53:15 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:54:41.141654 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b66aaa-2974-46e0-8651-de4172139dcd service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:54:41.143111 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-63b66aaa-2974-46e0-8651-de4172139dcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:54:41.160169 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b66aaa-2974-46e0-8651-de4172139dcd service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:54:41.165869 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988f39d-f5ca-4a4c-bf2d-c548edc97eb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:54:41.166564 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988f39d-f5ca-4a4c-bf2d-c548edc97eb3 service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:54:41.166873 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988f39d-f5ca-4a4c-bf2d-c548edc97eb3 service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:54:41.167152 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8988f39d-f5ca-4a4c-bf2d-c548edc97eb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:54:41.175223 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988f39d-f5ca-4a4c-bf2d-c548edc97eb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:54:41.176784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8988f39d-f5ca-4a4c-bf2d-c548edc97eb3 service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:54:41.202861 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1280/2542] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:54:41 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:55:05.665575 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26724eb7-8592-497c-ad07-33ee14c442bd service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:55:05.674792 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26724eb7-8592-497c-ad07-33ee14c442bd service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:55:05.678950 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b195872-e0ca-4818-a170-4040169f5940 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:55:05.679625 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b195872-e0ca-4818-a170-4040169f5940 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:55:05.679906 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b195872-e0ca-4818-a170-4040169f5940 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:55:05.680182 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b195872-e0ca-4818-a170-4040169f5940 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:55:05.687383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b195872-e0ca-4818-a170-4040169f5940 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:55:05.688821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b195872-e0ca-4818-a170-4040169f5940 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:55:05.697189 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1263/2543] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:55:05 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:55:30.640410 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988f39d-f5ca-4a4c-bf2d-c548edc97eb3 service nova] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:55:30.652593 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8988f39d-f5ca-4a4c-bf2d-c548edc97eb3 service nova] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:55:30.658598 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744e32e-1541-45c9-b7cf-ed621e84fe06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:55:30.659412 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744e32e-1541-45c9-b7cf-ed621e84fe06 service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:55:30.659816 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744e32e-1541-45c9-b7cf-ed621e84fe06 service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:55:30.660004 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744e32e-1541-45c9-b7cf-ed621e84fe06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:55:30.663148 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c744e32e-1541-45c9-b7cf-ed621e84fe06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:55:30.676107 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744e32e-1541-45c9-b7cf-ed621e84fe06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:55:30.678268 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744e32e-1541-45c9-b7cf-ed621e84fe06 service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:55:30.693671 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1281/2544] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:55:30 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:55:31.001061 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b195872-e0ca-4818-a170-4040169f5940 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:55:31.009801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b195872-e0ca-4818-a170-4040169f5940 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:55:31.013379 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b243007-5157-4715-8941-2d04055555ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:55:31.014026 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243007-5157-4715-8941-2d04055555ec service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:55:31.014461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243007-5157-4715-8941-2d04055555ec service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:55:31.014735 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243007-5157-4715-8941-2d04055555ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:55:31.026662 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b243007-5157-4715-8941-2d04055555ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:55:31.028203 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b243007-5157-4715-8941-2d04055555ec service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:55:31.041970 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1264/2545] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:55:30 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:55:32.516200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744e32e-1541-45c9-b7cf-ed621e84fe06 service nova] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:55:32.525242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744e32e-1541-45c9-b7cf-ed621e84fe06 service nova] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:55:32.528828 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaffae4-b272-41cd-87cf-f99745dec962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:55:32.529466 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaffae4-b272-41cd-87cf-f99745dec962 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:55:32.529750 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaffae4-b272-41cd-87cf-f99745dec962 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:55:32.530068 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaffae4-b272-41cd-87cf-f99745dec962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:55:32.531837 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-1aaffae4-b272-41cd-87cf-f99745dec962 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:55:32.592318 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaffae4-b272-41cd-87cf-f99745dec962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:55:32.593975 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aaffae4-b272-41cd-87cf-f99745dec962 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:55:32.603638 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1282/2546] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:55:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:55:33.092212 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b243007-5157-4715-8941-2d04055555ec service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:55:33.094270 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-9b243007-5157-4715-8941-2d04055555ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:55:33.111263 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b243007-5157-4715-8941-2d04055555ec service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:55:33.115738 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb35068b-375d-4950-b479-c9bf84a59f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:55:33.116584 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35068b-375d-4950-b479-c9bf84a59f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:55:33.116867 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35068b-375d-4950-b479-c9bf84a59f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:55:33.117139 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb35068b-375d-4950-b479-c9bf84a59f03 admin admin] PATH_INFO: `/v3/users/b988f9d7fba841ff9a4af954f862096a` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:55:33.118348 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35068b-375d-4950-b479-c9bf84a59f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b988f9d7fba841ff9a4af954f862096a)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:55:33.120233 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb35068b-375d-4950-b479-c9bf84a59f03 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:55:33.165214 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bb35068b-375d-4950-b479-c9bf84a59f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b988f9d7fba841ff9a4af954f862096a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:55:33.171416 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bb35068b-375d-4950-b479-c9bf84a59f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b988f9d7fba841ff9a4af954f862096a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:55:33.178227 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bb35068b-375d-4950-b479-c9bf84a59f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b988f9d7fba841ff9a4af954f862096a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:55:33.178888 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bb35068b-375d-4950-b479-c9bf84a59f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b988f9d7fba841ff9a4af954f862096a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:55:33.189912 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bb35068b-375d-4950-b479-c9bf84a59f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b988f9d7fba841ff9a4af954f862096a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:55:33.195631 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1265/2547] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 16:55:33 2021] DELETE /identity/v3/users/b988f9d7fba841ff9a4af954f862096a => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:55:33.363875 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaffae4-b272-41cd-87cf-f99745dec962 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:55:33.380449 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaffae4-b272-41cd-87cf-f99745dec962 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:55:33.435155 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40214a7d-6f46-47b7-bd30-859b9ef25919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:55:33.436011 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40214a7d-6f46-47b7-bd30-859b9ef25919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:55:33.436411 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40214a7d-6f46-47b7-bd30-859b9ef25919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:55:33.436692 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40214a7d-6f46-47b7-bd30-859b9ef25919 admin admin] PATH_INFO: `/v3/projects/1c800d9b8bd64d0b949b9ddd6031a6d2` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:55:33.437875 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40214a7d-6f46-47b7-bd30-859b9ef25919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c800d9b8bd64d0b949b9ddd6031a6d2)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:55:33.439812 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40214a7d-6f46-47b7-bd30-859b9ef25919 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:55:33.482836 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-40214a7d-6f46-47b7-bd30-859b9ef25919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c800d9b8bd64d0b949b9ddd6031a6d2', 'request_id': 'req-40214a7d-6f46-47b7-bd30-859b9ef25919'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:55:33.487887 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-40214a7d-6f46-47b7-bd30-859b9ef25919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c800d9b8bd64d0b949b9ddd6031a6d2', 'request_id': 'req-40214a7d-6f46-47b7-bd30-859b9ef25919'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:55:33.495781 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-40214a7d-6f46-47b7-bd30-859b9ef25919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c800d9b8bd64d0b949b9ddd6031a6d2', 'request_id': 'req-40214a7d-6f46-47b7-bd30-859b9ef25919'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:55:33.506265 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-40214a7d-6f46-47b7-bd30-859b9ef25919 admin admin] The token cache is being invalidate because project 1c800d9b8bd64d0b949b9ddd6031a6d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 16:55:33.506526 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-40214a7d-6f46-47b7-bd30-859b9ef25919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:55:33.507140 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-40214a7d-6f46-47b7-bd30-859b9ef25919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 16:55:33.508639 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1283/2548] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 16:55:33 2021] DELETE /identity/v3/projects/1c800d9b8bd64d0b949b9ddd6031a6d2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 16:55:33.515825 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1273b6-058d-48cc-8588-203b2f9a1884 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:55:33.516110 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1273b6-058d-48cc-8588-203b2f9a1884 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:55:33.516381 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1273b6-058d-48cc-8588-203b2f9a1884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:55:33.533270 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-4a1273b6-058d-48cc-8588-203b2f9a1884 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:55:33.534471 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-4a1273b6-058d-48cc-8588-203b2f9a1884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:55:33.591951 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1266/2549] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:55:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:55:33.599535 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96a9fd-9aa2-41b1-bf26-a8e535a6731a None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:55:33.600000 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96a9fd-9aa2-41b1-bf26-a8e535a6731a None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:55:33.600106 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96a9fd-9aa2-41b1-bf26-a8e535a6731a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:55:33.619049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-6c96a9fd-9aa2-41b1-bf26-a8e535a6731a None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:55:33.620183 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-6c96a9fd-9aa2-41b1-bf26-a8e535a6731a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:55:33.627960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1284/2550] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:55:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:55:33.631988 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1273b6-058d-48cc-8588-203b2f9a1884 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:55:33.641275 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1273b6-058d-48cc-8588-203b2f9a1884 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:55:33.646135 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87550df6-bd3e-4d39-88d3-a45a7136a710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:55:33.646771 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87550df6-bd3e-4d39-88d3-a45a7136a710 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:55:33.647049 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87550df6-bd3e-4d39-88d3-a45a7136a710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:55:33.647444 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87550df6-bd3e-4d39-88d3-a45a7136a710 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:55:33.648210 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87550df6-bd3e-4d39-88d3-a45a7136a710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 16:55:33.648509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87550df6-bd3e-4d39-88d3-a45a7136a710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:55:33.650112 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87550df6-bd3e-4d39-88d3-a45a7136a710 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:55:33.661767 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1267/2551] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 16:55:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 16:55:33.666685 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96a9fd-9aa2-41b1-bf26-a8e535a6731a None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:55:33.676925 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96a9fd-9aa2-41b1-bf26-a8e535a6731a None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:55:33.682171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fa456-c379-46b4-8ffb-b637c2c2c25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:55:33.682864 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fa456-c379-46b4-8ffb-b637c2c2c25b admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:55:33.683145 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fa456-c379-46b4-8ffb-b637c2c2c25b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:55:33.683419 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fa456-c379-46b4-8ffb-b637c2c2c25b admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:55:33.684136 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fa456-c379-46b4-8ffb-b637c2c2c25b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:55:33.686060 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fa456-c379-46b4-8ffb-b637c2c2c25b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:55:33.711632 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1285/2552] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 16:55:33 2021] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 16:55:33.715668 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87550df6-bd3e-4d39-88d3-a45a7136a710 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:55:33.726216 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87550df6-bd3e-4d39-88d3-a45a7136a710 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:55:33.781628 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90398dd-fe44-48d6-b12a-08b4c3fa00a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:55:33.782337 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90398dd-fe44-48d6-b12a-08b4c3fa00a3 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:55:33.782626 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90398dd-fe44-48d6-b12a-08b4c3fa00a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:55:33.782904 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90398dd-fe44-48d6-b12a-08b4c3fa00a3 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:55:33.783621 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90398dd-fe44-48d6-b12a-08b4c3fa00a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:55:33.785528 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90398dd-fe44-48d6-b12a-08b4c3fa00a3 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:55:33.805914 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1268/2553] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 16:55:33 2021] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 16:55:33.810366 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fa456-c379-46b4-8ffb-b637c2c2c25b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:55:33.820514 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fa456-c379-46b4-8ffb-b637c2c2c25b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:55:33.825270 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf82738-06a6-4a30-9f8a-3c631d19834a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:55:33.825942 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf82738-06a6-4a30-9f8a-3c631d19834a admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:55:33.826232 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf82738-06a6-4a30-9f8a-3c631d19834a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:55:33.826505 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf82738-06a6-4a30-9f8a-3c631d19834a admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:55:33.827278 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf82738-06a6-4a30-9f8a-3c631d19834a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:55:33.828865 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf82738-06a6-4a30-9f8a-3c631d19834a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:55:33.840633 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1286/2554] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:55:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:55:33.846235 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90398dd-fe44-48d6-b12a-08b4c3fa00a3 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:55:33.856643 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90398dd-fe44-48d6-b12a-08b4c3fa00a3 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:55:33.861409 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162138c-74f2-4dd1-8b82-13cf3ecb55b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:55:33.862117 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162138c-74f2-4dd1-8b82-13cf3ecb55b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:55:33.862401 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162138c-74f2-4dd1-8b82-13cf3ecb55b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:55:33.862685 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162138c-74f2-4dd1-8b82-13cf3ecb55b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:55:33.863423 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162138c-74f2-4dd1-8b82-13cf3ecb55b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:55:33.865003 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162138c-74f2-4dd1-8b82-13cf3ecb55b0 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:55:33.877780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1269/2555] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 16:55:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 16:55:33.879126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf82738-06a6-4a30-9f8a-3c631d19834a admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:55:33.888974 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf82738-06a6-4a30-9f8a-3c631d19834a admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:55:33.893511 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514f924-27cf-4a05-881e-afd411cef978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:55:33.894440 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514f924-27cf-4a05-881e-afd411cef978 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:55:33.894714 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514f924-27cf-4a05-881e-afd411cef978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:55:33.894978 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514f924-27cf-4a05-881e-afd411cef978 admin admin] PATH_INFO: `/v3/projects/62ff1389dc744db48b4db05f2c82eb63/users/c4fc0b8bcf464175bb261165527bb79a/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:55:33.910558 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514f924-27cf-4a05-881e-afd411cef978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ff1389dc744db48b4db05f2c82eb63, user_id=c4fc0b8bcf464175bb261165527bb79a, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:55:33.914339 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514f924-27cf-4a05-881e-afd411cef978 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:55:33.936315 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1287/2556] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 16:55:33 2021] PUT /identity/v3/projects/62ff1389dc744db48b4db05f2c82eb63/users/c4fc0b8bcf464175bb261165527bb79a/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 16:55:33.946775 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6bfb4-f704-4e24-ad64-cb70237a18da None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:55:33.947246 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6bfb4-f704-4e24-ad64-cb70237a18da None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:55:33.947532 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6bfb4-f704-4e24-ad64-cb70237a18da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:55:33.974268 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-69e6bfb4-f704-4e24-ad64-cb70237a18da None None] MFA Rules not processed for user `c4fc0b8bcf464175bb261165527bb79a`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 16:55:33.976079 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-69e6bfb4-f704-4e24-ad64-cb70237a18da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:55:34.039196 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1270/2557] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 16:55:33 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 16:55:34.051705 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514f924-27cf-4a05-881e-afd411cef978 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:55:34.053464 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e514f924-27cf-4a05-881e-afd411cef978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:55:34.109398 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514f924-27cf-4a05-881e-afd411cef978 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:55:34.113009 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bb874-0722-4c39-bbfa-680c1dda02a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27a0c9ae2bf40caa92e9dbceff8d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:55:34.113645 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bb874-0722-4c39-bbfa-680c1dda02a9 service glance] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:55:34.113937 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bb874-0722-4c39-bbfa-680c1dda02a9 service glance] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:55:34.114239 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bb874-0722-4c39-bbfa-680c1dda02a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:55:34.122381 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bb874-0722-4c39-bbfa-680c1dda02a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:55:34.123752 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bb874-0722-4c39-bbfa-680c1dda02a9 service glance] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:55:34.132526 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1288/2558] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:55:34 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 16:56:42.099096 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6bfb4-f704-4e24-ad64-cb70237a18da None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:56:42.100543 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-69e6bfb4-f704-4e24-ad64-cb70237a18da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:56:42.166080 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6bfb4-f704-4e24-ad64-cb70237a18da None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:56:42.169701 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9abe3-ccf8-42d5-b8f1-7ac503671686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:56:42.170380 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9abe3-ccf8-42d5-b8f1-7ac503671686 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:56:42.170663 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9abe3-ccf8-42d5-b8f1-7ac503671686 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:56:42.170940 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9abe3-ccf8-42d5-b8f1-7ac503671686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:56:42.172686 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-70e9abe3-ccf8-42d5-b8f1-7ac503671686 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:56:42.249468 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9abe3-ccf8-42d5-b8f1-7ac503671686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:56:42.251005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9abe3-ccf8-42d5-b8f1-7ac503671686 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:56:42.268868 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1271/2559] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:56:42 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:57:10.027470 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bb874-0722-4c39-bbfa-680c1dda02a9 service glance] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:57:10.036578 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bb874-0722-4c39-bbfa-680c1dda02a9 service glance] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:57:10.040164 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342b26d-11aa-4430-a2c7-65b92ea27c94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:57:10.040800 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342b26d-11aa-4430-a2c7-65b92ea27c94 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:57:10.041083 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342b26d-11aa-4430-a2c7-65b92ea27c94 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:57:10.041360 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5342b26d-11aa-4430-a2c7-65b92ea27c94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:57:10.043145 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-5342b26d-11aa-4430-a2c7-65b92ea27c94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:57:10.138604 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342b26d-11aa-4430-a2c7-65b92ea27c94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:57:10.140030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5342b26d-11aa-4430-a2c7-65b92ea27c94 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:57:10.157716 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1289/2560] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:57:10 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:57:13.964791 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9abe3-ccf8-42d5-b8f1-7ac503671686 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:57:13.967071 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-70e9abe3-ccf8-42d5-b8f1-7ac503671686 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:57:14.083311 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9abe3-ccf8-42d5-b8f1-7ac503671686 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:57:14.090043 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f42260-a3c3-4100-bcdd-fbe48e8e6e95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:57:14.091381 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f42260-a3c3-4100-bcdd-fbe48e8e6e95 service placement] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:57:14.091679 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f42260-a3c3-4100-bcdd-fbe48e8e6e95 service placement] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:57:14.092342 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f42260-a3c3-4100-bcdd-fbe48e8e6e95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:57:14.094163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-30f42260-a3c3-4100-bcdd-fbe48e8e6e95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:57:14.106159 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f42260-a3c3-4100-bcdd-fbe48e8e6e95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:57:14.108451 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f42260-a3c3-4100-bcdd-fbe48e8e6e95 service placement] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:57:14.118559 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1272/2561] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:57:13 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:57:26.596649 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342b26d-11aa-4430-a2c7-65b92ea27c94 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:57:26.605187 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5342b26d-11aa-4430-a2c7-65b92ea27c94 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:57:26.609670 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1608d8-0e93-447b-9def-c1f11d4699e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:57:26.610364 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1608d8-0e93-447b-9def-c1f11d4699e6 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:57:26.610652 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1608d8-0e93-447b-9def-c1f11d4699e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:57:26.610927 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1608d8-0e93-447b-9def-c1f11d4699e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:57:26.612758 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-2e1608d8-0e93-447b-9def-c1f11d4699e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:57:26.692885 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1608d8-0e93-447b-9def-c1f11d4699e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:57:26.694357 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1608d8-0e93-447b-9def-c1f11d4699e6 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:57:26.712305 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1290/2562] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:57:26 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:59:15.927579 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f42260-a3c3-4100-bcdd-fbe48e8e6e95 service placement] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:59:15.929039 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-30f42260-a3c3-4100-bcdd-fbe48e8e6e95 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:59:16.019415 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f42260-a3c3-4100-bcdd-fbe48e8e6e95 service placement] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:59:16.022955 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bdcc9-7d51-44fe-ba51-d6af5806a7e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:59:16.023580 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bdcc9-7d51-44fe-ba51-d6af5806a7e9 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:59:16.023857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bdcc9-7d51-44fe-ba51-d6af5806a7e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:59:16.024128 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bdcc9-7d51-44fe-ba51-d6af5806a7e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:59:16.025854 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a64bdcc9-7d51-44fe-ba51-d6af5806a7e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:59:16.092122 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bdcc9-7d51-44fe-ba51-d6af5806a7e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:59:16.093540 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bdcc9-7d51-44fe-ba51-d6af5806a7e9 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:59:16.104486 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1273/2563] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:59:15 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 16:59:41.460370 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1608d8-0e93-447b-9def-c1f11d4699e6 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 16:59:41.461814 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-2e1608d8-0e93-447b-9def-c1f11d4699e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:59:41.491009 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1608d8-0e93-447b-9def-c1f11d4699e6 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 16:59:41.494655 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beec905-7db4-4735-8f8f-ab2a7b6ff920 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 16:59:41.495289 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beec905-7db4-4735-8f8f-ab2a7b6ff920 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 16:59:41.495570 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beec905-7db4-4735-8f8f-ab2a7b6ff920 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 16:59:41.495844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beec905-7db4-4735-8f8f-ab2a7b6ff920 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 16:59:41.497565 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4beec905-7db4-4735-8f8f-ab2a7b6ff920 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 16:59:41.564862 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beec905-7db4-4735-8f8f-ab2a7b6ff920 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 16:59:41.566325 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beec905-7db4-4735-8f8f-ab2a7b6ff920 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 16:59:41.575227 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1291/2564] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 16:59:41 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:00:05.288474 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109336e-04fb-434e-8e09-96c06612715b None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:05.288995 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109336e-04fb-434e-8e09-96c06612715b None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:05.289471 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6109336e-04fb-434e-8e09-96c06612715b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:05.345848 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-6109336e-04fb-434e-8e09-96c06612715b None None] MFA Rules not processed for user `10b4daa146fa4b638d90ea1e9a4878eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:00:05.347072 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-6109336e-04fb-434e-8e09-96c06612715b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:00:05.416984 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1274/2565] 10.222.0.41 () {58 vars in 967 bytes} [Fri Oct 29 17:00:05 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:00:05.460296 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beec905-7db4-4735-8f8f-ab2a7b6ff920 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:05.461691 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4beec905-7db4-4735-8f8f-ab2a7b6ff920 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:00:05.555884 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beec905-7db4-4735-8f8f-ab2a7b6ff920 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:05.561255 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ada583-0a03-4f98-b093-3e30e9217a45 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f518ae309c4b4f7eacca882b58e58bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:05.561890 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ada583-0a03-4f98-b093-3e30e9217a45 service swift] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:05.562209 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ada583-0a03-4f98-b093-3e30e9217a45 service swift] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:05.562481 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ada583-0a03-4f98-b093-3e30e9217a45 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:05.570363 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ada583-0a03-4f98-b093-3e30e9217a45 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:05.571933 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ada583-0a03-4f98-b093-3e30e9217a45 service swift] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:05.580270 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1292/2566] 10.222.0.41 () {60 vars in 1384 bytes} [Fri Oct 29 17:00:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 29 17:00:06.040358 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109336e-04fb-434e-8e09-96c06612715b None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:06.050534 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6109336e-04fb-434e-8e09-96c06612715b None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:06.054281 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fcc77-ddfd-4b3a-bfa3-427e762f9227 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:06.054916 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fcc77-ddfd-4b3a-bfa3-427e762f9227 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:06.055206 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fcc77-ddfd-4b3a-bfa3-427e762f9227 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:06.055482 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fcc77-ddfd-4b3a-bfa3-427e762f9227 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:06.057296 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1d2fcc77-ddfd-4b3a-bfa3-427e762f9227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:00:06.140796 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2fcc77-ddfd-4b3a-bfa3-427e762f9227 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:06.142283 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2fcc77-ddfd-4b3a-bfa3-427e762f9227 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:06.161427 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1275/2567] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:00:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:00:10.652628 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ada583-0a03-4f98-b093-3e30e9217a45 service swift] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:10.662890 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ada583-0a03-4f98-b093-3e30e9217a45 service swift] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:10.666809 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764203c2-50ff-41c3-9f17-772484b7d219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:10.667570 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764203c2-50ff-41c3-9f17-772484b7d219 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:10.668161 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764203c2-50ff-41c3-9f17-772484b7d219 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:10.668449 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764203c2-50ff-41c3-9f17-772484b7d219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:10.672006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-764203c2-50ff-41c3-9f17-772484b7d219 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:00:10.698115 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764203c2-50ff-41c3-9f17-772484b7d219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:10.700324 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764203c2-50ff-41c3-9f17-772484b7d219 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:10.723282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1293/2568] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:00:10 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:00:12.668780 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fcc77-ddfd-4b3a-bfa3-427e762f9227 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:12.670392 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1d2fcc77-ddfd-4b3a-bfa3-427e762f9227 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:00:12.682188 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fcc77-ddfd-4b3a-bfa3-427e762f9227 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:12.686887 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d60bdd-cee8-48b8-abab-526e3ff2bee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:12.687785 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d60bdd-cee8-48b8-abab-526e3ff2bee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:12.688048 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d60bdd-cee8-48b8-abab-526e3ff2bee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:12.688348 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d60bdd-cee8-48b8-abab-526e3ff2bee7 admin admin] PATH_INFO: `/v3/users/b82bc9ff0fd64991b2718f31e215deef` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:12.689520 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d60bdd-cee8-48b8-abab-526e3ff2bee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b82bc9ff0fd64991b2718f31e215deef)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:12.691492 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d60bdd-cee8-48b8-abab-526e3ff2bee7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:12.736656 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a9d60bdd-cee8-48b8-abab-526e3ff2bee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b82bc9ff0fd64991b2718f31e215deef'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:12.743271 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a9d60bdd-cee8-48b8-abab-526e3ff2bee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b82bc9ff0fd64991b2718f31e215deef'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:12.750241 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a9d60bdd-cee8-48b8-abab-526e3ff2bee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b82bc9ff0fd64991b2718f31e215deef'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:12.750922 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a9d60bdd-cee8-48b8-abab-526e3ff2bee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b82bc9ff0fd64991b2718f31e215deef'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:12.762441 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a9d60bdd-cee8-48b8-abab-526e3ff2bee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b82bc9ff0fd64991b2718f31e215deef'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:12.769407 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1276/2569] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:00:12 2021] DELETE /identity/v3/users/b82bc9ff0fd64991b2718f31e215deef => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:00:12.938231 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764203c2-50ff-41c3-9f17-772484b7d219 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:12.950118 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764203c2-50ff-41c3-9f17-772484b7d219 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:13.005730 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989a1c1-f5c7-42ee-bb5f-72f4500961e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:13.006624 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a1c1-f5c7-42ee-bb5f-72f4500961e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:13.006906 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a1c1-f5c7-42ee-bb5f-72f4500961e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:13.007179 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989a1c1-f5c7-42ee-bb5f-72f4500961e7 admin admin] PATH_INFO: `/v3/projects/fe8e3de0e96049638fab9d116d4de1b4` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:13.008345 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989a1c1-f5c7-42ee-bb5f-72f4500961e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe8e3de0e96049638fab9d116d4de1b4)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:13.010557 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e989a1c1-f5c7-42ee-bb5f-72f4500961e7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:13.054115 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-e989a1c1-f5c7-42ee-bb5f-72f4500961e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe8e3de0e96049638fab9d116d4de1b4', 'request_id': 'req-e989a1c1-f5c7-42ee-bb5f-72f4500961e7'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:13.059381 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-e989a1c1-f5c7-42ee-bb5f-72f4500961e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe8e3de0e96049638fab9d116d4de1b4', 'request_id': 'req-e989a1c1-f5c7-42ee-bb5f-72f4500961e7'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:13.066635 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-e989a1c1-f5c7-42ee-bb5f-72f4500961e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe8e3de0e96049638fab9d116d4de1b4', 'request_id': 'req-e989a1c1-f5c7-42ee-bb5f-72f4500961e7'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:13.077718 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-e989a1c1-f5c7-42ee-bb5f-72f4500961e7 admin admin] The token cache is being invalidate because project fe8e3de0e96049638fab9d116d4de1b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:00:13.078031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-e989a1c1-f5c7-42ee-bb5f-72f4500961e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:13.078665 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-e989a1c1-f5c7-42ee-bb5f-72f4500961e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:13.080268 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1294/2570] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:00:12 2021] DELETE /identity/v3/projects/fe8e3de0e96049638fab9d116d4de1b4 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:00:13.084281 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d60bdd-cee8-48b8-abab-526e3ff2bee7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:13.085680 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a9d60bdd-cee8-48b8-abab-526e3ff2bee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:00:13.098784 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d60bdd-cee8-48b8-abab-526e3ff2bee7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:13.155658 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9dfb2a-0be4-4f1c-80c8-ee336b3100c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:13.156505 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9dfb2a-0be4-4f1c-80c8-ee336b3100c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:13.156714 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9dfb2a-0be4-4f1c-80c8-ee336b3100c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:13.157001 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9dfb2a-0be4-4f1c-80c8-ee336b3100c1 admin admin] PATH_INFO: `/v3/users/f8754107b86942ba8ddd71076c268c30` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:13.170078 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9dfb2a-0be4-4f1c-80c8-ee336b3100c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8754107b86942ba8ddd71076c268c30)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:13.172038 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9dfb2a-0be4-4f1c-80c8-ee336b3100c1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:13.217378 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bc9dfb2a-0be4-4f1c-80c8-ee336b3100c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8754107b86942ba8ddd71076c268c30'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:13.224917 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bc9dfb2a-0be4-4f1c-80c8-ee336b3100c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8754107b86942ba8ddd71076c268c30'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:13.231598 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bc9dfb2a-0be4-4f1c-80c8-ee336b3100c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8754107b86942ba8ddd71076c268c30'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:13.232224 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bc9dfb2a-0be4-4f1c-80c8-ee336b3100c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8754107b86942ba8ddd71076c268c30'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:13.244863 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-bc9dfb2a-0be4-4f1c-80c8-ee336b3100c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8754107b86942ba8ddd71076c268c30'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:13.251444 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1277/2571] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:00:13 2021] DELETE /identity/v3/users/f8754107b86942ba8ddd71076c268c30 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:00:13.432207 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989a1c1-f5c7-42ee-bb5f-72f4500961e7 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:13.433840 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e989a1c1-f5c7-42ee-bb5f-72f4500961e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:00:13.451994 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e989a1c1-f5c7-42ee-bb5f-72f4500961e7 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:13.512367 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef53617-81db-4a94-961d-606cd9448331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:13.513226 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef53617-81db-4a94-961d-606cd9448331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:13.513511 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef53617-81db-4a94-961d-606cd9448331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:13.513821 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef53617-81db-4a94-961d-606cd9448331 admin admin] PATH_INFO: `/v3/projects/4affcf541cc144d7be507c9cc69088b8` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:13.524854 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef53617-81db-4a94-961d-606cd9448331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4affcf541cc144d7be507c9cc69088b8)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:13.526807 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef53617-81db-4a94-961d-606cd9448331 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:13.569956 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-2ef53617-81db-4a94-961d-606cd9448331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4affcf541cc144d7be507c9cc69088b8', 'request_id': 'req-2ef53617-81db-4a94-961d-606cd9448331'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:13.575094 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-2ef53617-81db-4a94-961d-606cd9448331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4affcf541cc144d7be507c9cc69088b8', 'request_id': 'req-2ef53617-81db-4a94-961d-606cd9448331'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:13.583027 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-2ef53617-81db-4a94-961d-606cd9448331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4affcf541cc144d7be507c9cc69088b8', 'request_id': 'req-2ef53617-81db-4a94-961d-606cd9448331'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:13.594334 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-2ef53617-81db-4a94-961d-606cd9448331 admin admin] The token cache is being invalidate because project 4affcf541cc144d7be507c9cc69088b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:00:13.594621 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-2ef53617-81db-4a94-961d-606cd9448331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:13.595243 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-2ef53617-81db-4a94-961d-606cd9448331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:00:13.597142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1295/2572] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:00:13 2021] DELETE /identity/v3/projects/4affcf541cc144d7be507c9cc69088b8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:00:13.602991 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41ac94-6534-49f6-a5af-9707e6d703ff None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:13.603304 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41ac94-6534-49f6-a5af-9707e6d703ff None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:13.603579 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41ac94-6534-49f6-a5af-9707e6d703ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:13.659675 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-cf41ac94-6534-49f6-a5af-9707e6d703ff None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:00:13.660881 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-cf41ac94-6534-49f6-a5af-9707e6d703ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:00:13.719047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1278/2573] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:00:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:00:13.727376 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812fa16-224d-4eee-9c13-4095b271cbcc None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:13.727713 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812fa16-224d-4eee-9c13-4095b271cbcc None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:13.727993 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812fa16-224d-4eee-9c13-4095b271cbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:13.745641 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-4812fa16-224d-4eee-9c13-4095b271cbcc None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:00:13.746864 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4812fa16-224d-4eee-9c13-4095b271cbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:00:13.754612 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1296/2574] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:00:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:00:13.758582 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41ac94-6534-49f6-a5af-9707e6d703ff None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:13.768119 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41ac94-6534-49f6-a5af-9707e6d703ff None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:13.772757 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802d57f-be6e-444f-a400-e49cacebc2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:13.773447 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802d57f-be6e-444f-a400-e49cacebc2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:13.773732 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802d57f-be6e-444f-a400-e49cacebc2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:13.774042 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2802d57f-be6e-444f-a400-e49cacebc2c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:13.774784 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802d57f-be6e-444f-a400-e49cacebc2c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 17:00:13.775093 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802d57f-be6e-444f-a400-e49cacebc2c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:13.776694 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2802d57f-be6e-444f-a400-e49cacebc2c0 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:13.788777 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1279/2575] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 17:00:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 17:00:13.793049 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812fa16-224d-4eee-9c13-4095b271cbcc None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:13.802616 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812fa16-224d-4eee-9c13-4095b271cbcc None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:13.807266 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f48371-c3d6-40d7-896f-a8f2073e7bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:13.807903 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f48371-c3d6-40d7-896f-a8f2073e7bb4 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:13.808184 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f48371-c3d6-40d7-896f-a8f2073e7bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:13.808460 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f48371-c3d6-40d7-896f-a8f2073e7bb4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:13.809162 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f48371-c3d6-40d7-896f-a8f2073e7bb4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:13.811102 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f48371-c3d6-40d7-896f-a8f2073e7bb4 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:13.844479 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1297/2576] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:00:13 2021] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:00:13.848676 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802d57f-be6e-444f-a400-e49cacebc2c0 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:13.859028 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2802d57f-be6e-444f-a400-e49cacebc2c0 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:13.911940 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12c093-9a0f-4adf-b885-4719ac38a8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:13.912597 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12c093-9a0f-4adf-b885-4719ac38a8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:13.912883 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12c093-9a0f-4adf-b885-4719ac38a8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:13.913163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf12c093-9a0f-4adf-b885-4719ac38a8d3 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:13.913954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12c093-9a0f-4adf-b885-4719ac38a8d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:13.916060 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf12c093-9a0f-4adf-b885-4719ac38a8d3 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:13.935408 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1280/2577] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:00:13 2021] POST /identity/v3/users => generated 290 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:00:13.939383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f48371-c3d6-40d7-896f-a8f2073e7bb4 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:13.949252 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f48371-c3d6-40d7-896f-a8f2073e7bb4 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:13.953719 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a949e4-485c-4446-a340-d3e861369259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:13.954409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a949e4-485c-4446-a340-d3e861369259 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:13.954687 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a949e4-485c-4446-a340-d3e861369259 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:13.954960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a949e4-485c-4446-a340-d3e861369259 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:13.955682 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a949e4-485c-4446-a340-d3e861369259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:13.957259 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a949e4-485c-4446-a340-d3e861369259 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:13.966789 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1298/2578] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:00:13 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:00:13.971448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12c093-9a0f-4adf-b885-4719ac38a8d3 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:13.981141 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf12c093-9a0f-4adf-b885-4719ac38a8d3 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:13.986612 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ea6dc-dd42-4683-b9bd-a1bcfcb3d1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:13.987255 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ea6dc-dd42-4683-b9bd-a1bcfcb3d1e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:13.987536 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ea6dc-dd42-4683-b9bd-a1bcfcb3d1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:13.987814 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ea6dc-dd42-4683-b9bd-a1bcfcb3d1e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:13.988544 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ea6dc-dd42-4683-b9bd-a1bcfcb3d1e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:13.990156 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ea6dc-dd42-4683-b9bd-a1bcfcb3d1e5 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:13.999785 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1281/2579] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:00:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 17:00:14.003696 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a949e4-485c-4446-a340-d3e861369259 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:14.014374 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a949e4-485c-4446-a340-d3e861369259 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:14.018898 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a103520-2321-48b8-83f8-7b144d55334f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:14.019754 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a103520-2321-48b8-83f8-7b144d55334f admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:14.020034 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a103520-2321-48b8-83f8-7b144d55334f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:14.020304 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a103520-2321-48b8-83f8-7b144d55334f admin admin] PATH_INFO: `/v3/projects/3e527ec7466240de936dcb59eb9328a6/users/341008d14e7542dfb594eea1cf304ba4/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:14.035817 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a103520-2321-48b8-83f8-7b144d55334f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e527ec7466240de936dcb59eb9328a6, user_id=341008d14e7542dfb594eea1cf304ba4, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:14.038451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a103520-2321-48b8-83f8-7b144d55334f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:14.050614 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1299/2580] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:00:14 2021] PUT /identity/v3/projects/3e527ec7466240de936dcb59eb9328a6/users/341008d14e7542dfb594eea1cf304ba4/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:00:14.055491 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661734a-018a-4633-8fe2-2d41a2d7a95a None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:14.055804 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661734a-018a-4633-8fe2-2d41a2d7a95a None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:14.056087 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661734a-018a-4633-8fe2-2d41a2d7a95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:14.073406 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-7661734a-018a-4633-8fe2-2d41a2d7a95a None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:00:14.074627 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7661734a-018a-4633-8fe2-2d41a2d7a95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:00:14.131149 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1282/2581] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:00:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:00:14.141609 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a103520-2321-48b8-83f8-7b144d55334f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:14.143311 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-3a103520-2321-48b8-83f8-7b144d55334f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:00:14.198863 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a103520-2321-48b8-83f8-7b144d55334f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:14.203017 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4c455-2957-41ff-905f-1b0781e99c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:14.203672 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4c455-2957-41ff-905f-1b0781e99c7a service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:14.204018 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4c455-2957-41ff-905f-1b0781e99c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:14.204228 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d4c455-2957-41ff-905f-1b0781e99c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:14.213658 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4c455-2957-41ff-905f-1b0781e99c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:14.215164 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d4c455-2957-41ff-905f-1b0781e99c7a service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:14.225493 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1300/2582] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:00:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:00:18.119150 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b950a-aadb-48e2-837e-9ca04a4b9e4e None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:18.119669 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b950a-aadb-48e2-837e-9ca04a4b9e4e None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:18.119786 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828b950a-aadb-48e2-837e-9ca04a4b9e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:18.150923 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-828b950a-aadb-48e2-837e-9ca04a4b9e4e None None] MFA Rules not processed for user `341008d14e7542dfb594eea1cf304ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:00:18.152091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-828b950a-aadb-48e2-837e-9ca04a4b9e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:00:18.251822 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1283/2583] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:00:18 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 17:00:18.256272 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4c455-2957-41ff-905f-1b0781e99c7a service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:18.267109 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d4c455-2957-41ff-905f-1b0781e99c7a service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:18.272296 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853fdf6-37df-4568-8bbe-6781ebf227d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:18.272963 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853fdf6-37df-4568-8bbe-6781ebf227d0 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:18.273242 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853fdf6-37df-4568-8bbe-6781ebf227d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:18.273518 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853fdf6-37df-4568-8bbe-6781ebf227d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:18.274265 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853fdf6-37df-4568-8bbe-6781ebf227d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:18.276158 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4853fdf6-37df-4568-8bbe-6781ebf227d0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:18.309082 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1301/2584] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:00:18 2021] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:00:18.313738 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b950a-aadb-48e2-837e-9ca04a4b9e4e None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:18.327103 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828b950a-aadb-48e2-837e-9ca04a4b9e4e None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:18.383887 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac73dc-363b-4a95-be0c-44226a6e1a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:18.384664 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac73dc-363b-4a95-be0c-44226a6e1a8c admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:18.384825 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac73dc-363b-4a95-be0c-44226a6e1a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:18.385099 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ac73dc-363b-4a95-be0c-44226a6e1a8c admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:18.385809 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac73dc-363b-4a95-be0c-44226a6e1a8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:18.387765 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ac73dc-363b-4a95-be0c-44226a6e1a8c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:18.408382 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1284/2585] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:00:18 2021] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:00:18.412296 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853fdf6-37df-4568-8bbe-6781ebf227d0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:18.422651 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4853fdf6-37df-4568-8bbe-6781ebf227d0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:18.428281 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd22f95-8058-47a1-817a-1bd21f9595b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:18.429040 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd22f95-8058-47a1-817a-1bd21f9595b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:18.429388 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd22f95-8058-47a1-817a-1bd21f9595b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:18.429729 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd22f95-8058-47a1-817a-1bd21f9595b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:18.430579 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd22f95-8058-47a1-817a-1bd21f9595b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:18.432250 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd22f95-8058-47a1-817a-1bd21f9595b0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:18.445331 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1302/2586] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:00:18 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:00:18.450552 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac73dc-363b-4a95-be0c-44226a6e1a8c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:18.461652 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ac73dc-363b-4a95-be0c-44226a6e1a8c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:18.467422 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8581240-0bca-4f7d-9cf2-c0a6b2904ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:18.468381 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8581240-0bca-4f7d-9cf2-c0a6b2904ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:18.468733 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8581240-0bca-4f7d-9cf2-c0a6b2904ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:18.469213 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8581240-0bca-4f7d-9cf2-c0a6b2904ba2 admin admin] PATH_INFO: `/v3/projects/e8297dadeca64ed098a4379ea1d556c2/users/838f1bda40b546dc8cf970f229481ac7/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:18.487609 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8581240-0bca-4f7d-9cf2-c0a6b2904ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8297dadeca64ed098a4379ea1d556c2, user_id=838f1bda40b546dc8cf970f229481ac7, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:18.490369 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8581240-0bca-4f7d-9cf2-c0a6b2904ba2 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:18.504344 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1285/2587] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:00:18 2021] PUT /identity/v3/projects/e8297dadeca64ed098a4379ea1d556c2/users/838f1bda40b546dc8cf970f229481ac7/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:00:18.508457 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd22f95-8058-47a1-817a-1bd21f9595b0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:18.518157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd22f95-8058-47a1-817a-1bd21f9595b0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:18.571001 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d86ca95-c46e-4600-a9a9-397f387bf955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:18.571660 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86ca95-c46e-4600-a9a9-397f387bf955 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:18.571942 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86ca95-c46e-4600-a9a9-397f387bf955 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:18.572222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d86ca95-c46e-4600-a9a9-397f387bf955 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:18.572943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86ca95-c46e-4600-a9a9-397f387bf955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:18.574569 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d86ca95-c46e-4600-a9a9-397f387bf955 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:18.584171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1303/2588] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:00:18 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:00:18.588346 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8581240-0bca-4f7d-9cf2-c0a6b2904ba2 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:18.599341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8581240-0bca-4f7d-9cf2-c0a6b2904ba2 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:18.604219 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c67a3f-4e70-4737-ab14-974bcbe8ac15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:18.605095 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c67a3f-4e70-4737-ab14-974bcbe8ac15 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:18.605381 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c67a3f-4e70-4737-ab14-974bcbe8ac15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:18.605660 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c67a3f-4e70-4737-ab14-974bcbe8ac15 admin admin] PATH_INFO: `/v3/projects/e8297dadeca64ed098a4379ea1d556c2/users/838f1bda40b546dc8cf970f229481ac7/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:18.608193 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c67a3f-4e70-4737-ab14-974bcbe8ac15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8297dadeca64ed098a4379ea1d556c2, user_id=838f1bda40b546dc8cf970f229481ac7, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:18.610886 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c67a3f-4e70-4737-ab14-974bcbe8ac15 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:18.620971 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1286/2589] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:00:18 2021] PUT /identity/v3/projects/e8297dadeca64ed098a4379ea1d556c2/users/838f1bda40b546dc8cf970f229481ac7/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:00:23.794507 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5ccef-1f2a-4521-8b08-d432ac07d8b3 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:23.796142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5ccef-1f2a-4521-8b08-d432ac07d8b3 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:23.796371 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5ccef-1f2a-4521-8b08-d432ac07d8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:23.831471 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-4ad5ccef-1f2a-4521-8b08-d432ac07d8b3 None None] MFA Rules not processed for user `838f1bda40b546dc8cf970f229481ac7`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:00:23.832913 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4ad5ccef-1f2a-4521-8b08-d432ac07d8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:00:23.923207 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1304/2590] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:00:23 2021] POST /identity/v3/auth/tokens => generated 3466 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:00:23.936582 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c67a3f-4e70-4737-ab14-974bcbe8ac15 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:23.938562 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-b2c67a3f-4e70-4737-ab14-974bcbe8ac15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:00:24.019334 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c67a3f-4e70-4737-ab14-974bcbe8ac15 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:24.026084 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea43b9-235a-4550-8819-ef621bb81b2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:24.027097 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea43b9-235a-4550-8819-ef621bb81b2e service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:24.027539 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea43b9-235a-4550-8819-ef621bb81b2e service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:24.027957 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea43b9-235a-4550-8819-ef621bb81b2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:24.108246 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea43b9-235a-4550-8819-ef621bb81b2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:24.109858 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea43b9-235a-4550-8819-ef621bb81b2e service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:24.119983 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1287/2591] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:00:23 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:00:31.738249 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5ccef-1f2a-4521-8b08-d432ac07d8b3 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:31.739648 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4ad5ccef-1f2a-4521-8b08-d432ac07d8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:00:31.795886 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad5ccef-1f2a-4521-8b08-d432ac07d8b3 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:31.799481 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680a427-fea6-46c7-ba84-8b19daafb710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:31.800128 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680a427-fea6-46c7-ba84-8b19daafb710 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:31.800408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680a427-fea6-46c7-ba84-8b19daafb710 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:31.800680 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680a427-fea6-46c7-ba84-8b19daafb710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:31.802499 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-2680a427-fea6-46c7-ba84-8b19daafb710 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:00:31.815862 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680a427-fea6-46c7-ba84-8b19daafb710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:31.817266 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680a427-fea6-46c7-ba84-8b19daafb710 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:31.828320 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1305/2592] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:00:31 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:00:33.472876 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea43b9-235a-4550-8819-ef621bb81b2e service nova] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:00:33.474397 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-bbea43b9-235a-4550-8819-ef621bb81b2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:00:33.532860 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea43b9-235a-4550-8819-ef621bb81b2e service nova] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:00:33.536512 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec22c0-6776-40f5-903b-dddd65c4e68f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:00:33.537153 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec22c0-6776-40f5-903b-dddd65c4e68f service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:00:33.537435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec22c0-6776-40f5-903b-dddd65c4e68f service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:00:33.537713 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec22c0-6776-40f5-903b-dddd65c4e68f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:00:33.539729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7fec22c0-6776-40f5-903b-dddd65c4e68f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:00:33.597910 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec22c0-6776-40f5-903b-dddd65c4e68f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:00:33.599371 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec22c0-6776-40f5-903b-dddd65c4e68f service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:00:33.609914 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1288/2593] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:00:33 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:01:42.200753 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680a427-fea6-46c7-ba84-8b19daafb710 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:01:42.213492 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680a427-fea6-46c7-ba84-8b19daafb710 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:01:42.218812 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0654339-a32a-4f2d-b1d7-bd9212e9d53f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:01:42.219437 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0654339-a32a-4f2d-b1d7-bd9212e9d53f service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:01:42.219714 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0654339-a32a-4f2d-b1d7-bd9212e9d53f service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:01:42.219986 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0654339-a32a-4f2d-b1d7-bd9212e9d53f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:01:42.222247 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e0654339-a32a-4f2d-b1d7-bd9212e9d53f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:01:42.277697 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0654339-a32a-4f2d-b1d7-bd9212e9d53f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:01:42.279323 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0654339-a32a-4f2d-b1d7-bd9212e9d53f service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:01:42.288830 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1306/2594] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:01:42 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:02:11.159661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec22c0-6776-40f5-903b-dddd65c4e68f service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:02:11.170214 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec22c0-6776-40f5-903b-dddd65c4e68f service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:02:11.173898 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413583f-d578-4d6f-9243-1bb13019bca7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:02:11.174572 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413583f-d578-4d6f-9243-1bb13019bca7 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:02:11.174854 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413583f-d578-4d6f-9243-1bb13019bca7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:02:11.175131 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413583f-d578-4d6f-9243-1bb13019bca7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:02:11.176907 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3413583f-d578-4d6f-9243-1bb13019bca7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:02:11.237601 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413583f-d578-4d6f-9243-1bb13019bca7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:02:11.239113 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413583f-d578-4d6f-9243-1bb13019bca7 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:02:11.247979 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1289/2595] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:02:11 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:02:18.895642 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0654339-a32a-4f2d-b1d7-bd9212e9d53f service nova] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:02:18.897031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e0654339-a32a-4f2d-b1d7-bd9212e9d53f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:02:18.961157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0654339-a32a-4f2d-b1d7-bd9212e9d53f service nova] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:02:18.966095 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e2a02-65cf-486c-9eab-9ed7f418705c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:02:18.966731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e2a02-65cf-486c-9eab-9ed7f418705c service placement] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:02:18.967006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e2a02-65cf-486c-9eab-9ed7f418705c service placement] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:02:18.967276 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e2a02-65cf-486c-9eab-9ed7f418705c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:02:18.968990 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-411e2a02-65cf-486c-9eab-9ed7f418705c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:02:18.980469 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e2a02-65cf-486c-9eab-9ed7f418705c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:02:18.982062 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e2a02-65cf-486c-9eab-9ed7f418705c service placement] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:02:18.992151 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1307/2596] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:02:18 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:04:17.433303 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd89af-127d-4c91-94ef-6918ff2d6036 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:04:17.433863 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd89af-127d-4c91-94ef-6918ff2d6036 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:04:17.433863 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fd89af-127d-4c91-94ef-6918ff2d6036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:04:17.469465 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-42fd89af-127d-4c91-94ef-6918ff2d6036 None None] MFA Rules not processed for user `3bb8aa43328d4be08455441d0ffa4e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:04:17.470707 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-42fd89af-127d-4c91-94ef-6918ff2d6036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:04:17.477280 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1290/2597] 10.222.0.41 () {58 vars in 1061 bytes} [Fri Oct 29 17:04:17 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:04:17.483458 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e2a02-65cf-486c-9eab-9ed7f418705c service placement] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:04:17.492182 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e2a02-65cf-486c-9eab-9ed7f418705c service placement] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:04:17.495730 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613315c-37c3-4b31-b5b2-37efa2f80e3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:04:17.496358 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613315c-37c3-4b31-b5b2-37efa2f80e3e service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:04:17.496641 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613315c-37c3-4b31-b5b2-37efa2f80e3e service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:04:17.496918 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4613315c-37c3-4b31-b5b2-37efa2f80e3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:04:17.498661 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4613315c-37c3-4b31-b5b2-37efa2f80e3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:04:17.530929 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613315c-37c3-4b31-b5b2-37efa2f80e3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:04:17.532366 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4613315c-37c3-4b31-b5b2-37efa2f80e3e service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:04:17.552394 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1308/2598] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:04:17 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:04:42.036524 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd89af-127d-4c91-94ef-6918ff2d6036 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:04:42.037967 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-42fd89af-127d-4c91-94ef-6918ff2d6036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:04:42.049703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fd89af-127d-4c91-94ef-6918ff2d6036 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:04:42.053301 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35a310-51b4-40c0-9943-c0dc0aa576a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:04:42.053938 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35a310-51b4-40c0-9943-c0dc0aa576a7 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:04:42.054245 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35a310-51b4-40c0-9943-c0dc0aa576a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:04:42.054521 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35a310-51b4-40c0-9943-c0dc0aa576a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:04:42.056236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8f35a310-51b4-40c0-9943-c0dc0aa576a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:04:42.121225 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35a310-51b4-40c0-9943-c0dc0aa576a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:04:42.122682 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35a310-51b4-40c0-9943-c0dc0aa576a7 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:04:42.140813 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1291/2599] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:04:42 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:05:15.646525 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613315c-37c3-4b31-b5b2-37efa2f80e3e service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:05:15.654864 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4613315c-37c3-4b31-b5b2-37efa2f80e3e service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:05:15.658522 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45424b5-3852-41c1-95ff-d3f452f0bb7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:05:15.659156 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45424b5-3852-41c1-95ff-d3f452f0bb7c service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:05:15.659440 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45424b5-3852-41c1-95ff-d3f452f0bb7c service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:05:15.659721 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45424b5-3852-41c1-95ff-d3f452f0bb7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:05:15.661451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a45424b5-3852-41c1-95ff-d3f452f0bb7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:05:15.671165 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45424b5-3852-41c1-95ff-d3f452f0bb7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:05:15.672589 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45424b5-3852-41c1-95ff-d3f452f0bb7c service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:05:15.680286 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1309/2600] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:05:15 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:05:18.986795 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35a310-51b4-40c0-9943-c0dc0aa576a7 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:05:18.989000 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8f35a310-51b4-40c0-9943-c0dc0aa576a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:05:19.011636 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35a310-51b4-40c0-9943-c0dc0aa576a7 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:05:19.018454 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4c9fc-3108-492f-ae95-50949e3d6805 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:05:19.019444 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4c9fc-3108-492f-ae95-50949e3d6805 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:05:19.019800 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4c9fc-3108-492f-ae95-50949e3d6805 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:05:19.019999 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4c9fc-3108-492f-ae95-50949e3d6805 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:05:19.022460 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-c8f4c9fc-3108-492f-ae95-50949e3d6805 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:05:19.038292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4c9fc-3108-492f-ae95-50949e3d6805 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:05:19.040703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4c9fc-3108-492f-ae95-50949e3d6805 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:05:19.054890 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1292/2601] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:05:18 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:05:32.989771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43599677-5b91-4d27-b9d3-1abc76fabca5 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:05:32.990246 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43599677-5b91-4d27-b9d3-1abc76fabca5 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:05:32.990345 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43599677-5b91-4d27-b9d3-1abc76fabca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:05:33.007658 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-43599677-5b91-4d27-b9d3-1abc76fabca5 None None] MFA Rules not processed for user `3bb8aa43328d4be08455441d0ffa4e8a`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:05:33.008829 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-43599677-5b91-4d27-b9d3-1abc76fabca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:05:33.015708 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1310/2602] 10.222.0.41 () {58 vars in 1061 bytes} [Fri Oct 29 17:05:32 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:05:33.021686 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4c9fc-3108-492f-ae95-50949e3d6805 service nova] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:05:33.031357 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4c9fc-3108-492f-ae95-50949e3d6805 service nova] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:05:33.034853 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5a6cb-66d7-4ccd-b2b1-cbda1c5cccb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:05:33.035495 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5a6cb-66d7-4ccd-b2b1-cbda1c5cccb6 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:05:33.035771 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5a6cb-66d7-4ccd-b2b1-cbda1c5cccb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:05:33.036042 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed5a6cb-66d7-4ccd-b2b1-cbda1c5cccb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:05:33.045896 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5a6cb-66d7-4ccd-b2b1-cbda1c5cccb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:05:33.047321 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed5a6cb-66d7-4ccd-b2b1-cbda1c5cccb6 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:05:33.057708 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1293/2603] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:05:33 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 17:06:03.872256 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59990bd9-49cc-47ba-91f1-040ebd2134fb None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:06:03.872675 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59990bd9-49cc-47ba-91f1-040ebd2134fb None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:06:03.872823 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59990bd9-49cc-47ba-91f1-040ebd2134fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:06:03.908118 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-59990bd9-49cc-47ba-91f1-040ebd2134fb None None] MFA Rules not processed for user `9652ec3b44ee410dba2491c8f9795e20`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:06:03.909310 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-59990bd9-49cc-47ba-91f1-040ebd2134fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:06:03.915779 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1311/2604] 10.222.0.41 () {58 vars in 1059 bytes} [Fri Oct 29 17:06:03 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:06:03.922726 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5a6cb-66d7-4ccd-b2b1-cbda1c5cccb6 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:06:03.931650 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed5a6cb-66d7-4ccd-b2b1-cbda1c5cccb6 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:06:03.935281 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e9f10-a309-4841-8be8-6c0376d39c8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:06:03.935902 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e9f10-a309-4841-8be8-6c0376d39c8b service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:06:03.936185 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e9f10-a309-4841-8be8-6c0376d39c8b service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:06:03.936463 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e9f10-a309-4841-8be8-6c0376d39c8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:06:03.944681 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e9f10-a309-4841-8be8-6c0376d39c8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:06:03.946150 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e9f10-a309-4841-8be8-6c0376d39c8b service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:06:03.955169 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1294/2605] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:06:03 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:06:04.060736 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59990bd9-49cc-47ba-91f1-040ebd2134fb None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:06:04.068571 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59990bd9-49cc-47ba-91f1-040ebd2134fb None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:06:04.072226 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11345cae-c5bc-4b04-854c-73dc773568aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:06:04.072861 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11345cae-c5bc-4b04-854c-73dc773568aa service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:06:04.073140 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11345cae-c5bc-4b04-854c-73dc773568aa service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:06:04.073410 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11345cae-c5bc-4b04-854c-73dc773568aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:06:04.082168 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11345cae-c5bc-4b04-854c-73dc773568aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:06:04.083656 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11345cae-c5bc-4b04-854c-73dc773568aa service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:06:04.110849 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1312/2606] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:06:04 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:07:19.097654 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e9f10-a309-4841-8be8-6c0376d39c8b service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:07:19.107467 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e9f10-a309-4841-8be8-6c0376d39c8b service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:07:19.111334 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15262d-8c1b-4227-82a4-e2fd3d0e0902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:07:19.111992 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15262d-8c1b-4227-82a4-e2fd3d0e0902 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:07:19.112278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15262d-8c1b-4227-82a4-e2fd3d0e0902 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:07:19.112577 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d15262d-8c1b-4227-82a4-e2fd3d0e0902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:07:19.136753 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15262d-8c1b-4227-82a4-e2fd3d0e0902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:07:19.138358 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d15262d-8c1b-4227-82a4-e2fd3d0e0902 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:07:19.165375 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1295/2607] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:07:19 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:07:19.207581 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11345cae-c5bc-4b04-854c-73dc773568aa service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:07:19.215950 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11345cae-c5bc-4b04-854c-73dc773568aa service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:07:19.219567 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f2082-ba06-4d41-9be8-8679ed68ec90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:07:19.220197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2082-ba06-4d41-9be8-8679ed68ec90 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:07:19.220478 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2082-ba06-4d41-9be8-8679ed68ec90 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:07:19.220753 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f2082-ba06-4d41-9be8-8679ed68ec90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:07:19.228766 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f2082-ba06-4d41-9be8-8679ed68ec90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:07:19.230479 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f2082-ba06-4d41-9be8-8679ed68ec90 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:07:19.258404 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1313/2608] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:07:19 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:07:23.927390 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15262d-8c1b-4227-82a4-e2fd3d0e0902 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:07:23.928774 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-4d15262d-8c1b-4227-82a4-e2fd3d0e0902 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:07:23.970947 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d15262d-8c1b-4227-82a4-e2fd3d0e0902 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:07:23.975969 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b0f85-389d-4cfd-8c6e-5c1aa7d734f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:07:23.976594 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b0f85-389d-4cfd-8c6e-5c1aa7d734f5 service placement] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:07:23.976876 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b0f85-389d-4cfd-8c6e-5c1aa7d734f5 service placement] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:07:23.977150 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b0f85-389d-4cfd-8c6e-5c1aa7d734f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:07:23.985757 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b0f85-389d-4cfd-8c6e-5c1aa7d734f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:07:23.987343 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b0f85-389d-4cfd-8c6e-5c1aa7d734f5 service placement] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:07:23.997770 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1296/2609] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:07:23 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:08:04.417206 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f2082-ba06-4d41-9be8-8679ed68ec90 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:08:04.418751 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-6e0f2082-ba06-4d41-9be8-8679ed68ec90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:08:04.480531 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f2082-ba06-4d41-9be8-8679ed68ec90 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:08:04.485022 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd04f6e-8a42-4176-b5d0-4ed0bde212b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:08:04.485880 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd04f6e-8a42-4176-b5d0-4ed0bde212b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:04.486207 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd04f6e-8a42-4176-b5d0-4ed0bde212b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:04.486482 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd04f6e-8a42-4176-b5d0-4ed0bde212b0 admin admin] PATH_INFO: `/v3/users/c4fc0b8bcf464175bb261165527bb79a` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:04.499451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd04f6e-8a42-4176-b5d0-4ed0bde212b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4fc0b8bcf464175bb261165527bb79a)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:08:04.501375 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd04f6e-8a42-4176-b5d0-4ed0bde212b0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:08:04.545489 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cfd04f6e-8a42-4176-b5d0-4ed0bde212b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4fc0b8bcf464175bb261165527bb79a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:08:04.546149 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cfd04f6e-8a42-4176-b5d0-4ed0bde212b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4fc0b8bcf464175bb261165527bb79a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:08:04.558292 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cfd04f6e-8a42-4176-b5d0-4ed0bde212b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4fc0b8bcf464175bb261165527bb79a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:08:04.558915 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cfd04f6e-8a42-4176-b5d0-4ed0bde212b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4fc0b8bcf464175bb261165527bb79a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:08:04.565700 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cfd04f6e-8a42-4176-b5d0-4ed0bde212b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4fc0b8bcf464175bb261165527bb79a'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:08:04.577972 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1314/2610] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:08:04 2021] DELETE /identity/v3/users/c4fc0b8bcf464175bb261165527bb79a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:08:04.582418 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e29b7-8f50-474a-8c4a-13904d088ddd None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:04.582890 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e29b7-8f50-474a-8c4a-13904d088ddd None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:04.583033 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3e29b7-8f50-474a-8c4a-13904d088ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:04.599456 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-fb3e29b7-8f50-474a-8c4a-13904d088ddd None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:08:04.600652 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-fb3e29b7-8f50-474a-8c4a-13904d088ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:08:04.656862 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1297/2611] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:08:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:08:04.667141 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd04f6e-8a42-4176-b5d0-4ed0bde212b0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:08:04.668518 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-cfd04f6e-8a42-4176-b5d0-4ed0bde212b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:08:04.722233 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd04f6e-8a42-4176-b5d0-4ed0bde212b0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:08:04.726295 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063c6eb-4dea-4cc7-a3f8-619dfc4c6d9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:08:04.726926 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063c6eb-4dea-4cc7-a3f8-619dfc4c6d9b service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:04.727203 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063c6eb-4dea-4cc7-a3f8-619dfc4c6d9b service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:04.727470 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063c6eb-4dea-4cc7-a3f8-619dfc4c6d9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:04.736795 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063c6eb-4dea-4cc7-a3f8-619dfc4c6d9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:08:04.738250 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063c6eb-4dea-4cc7-a3f8-619dfc4c6d9b service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:08:04.748316 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1315/2612] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:08:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:08:05.029465 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e29b7-8f50-474a-8c4a-13904d088ddd None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:08:05.030872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-fb3e29b7-8f50-474a-8c4a-13904d088ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:08:05.058422 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3e29b7-8f50-474a-8c4a-13904d088ddd None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:08:05.063880 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e791dc43-c583-41b8-8d00-da8c22db2477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:08:05.064755 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791dc43-c583-41b8-8d00-da8c22db2477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:05.065046 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791dc43-c583-41b8-8d00-da8c22db2477 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:05.065328 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e791dc43-c583-41b8-8d00-da8c22db2477 admin admin] PATH_INFO: `/v3/projects/62ff1389dc744db48b4db05f2c82eb63` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:05.066644 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791dc43-c583-41b8-8d00-da8c22db2477 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62ff1389dc744db48b4db05f2c82eb63)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:08:05.068941 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e791dc43-c583-41b8-8d00-da8c22db2477 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:08:05.131524 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-e791dc43-c583-41b8-8d00-da8c22db2477 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62ff1389dc744db48b4db05f2c82eb63', 'request_id': 'req-e791dc43-c583-41b8-8d00-da8c22db2477'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:08:05.133418 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-e791dc43-c583-41b8-8d00-da8c22db2477 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62ff1389dc744db48b4db05f2c82eb63', 'request_id': 'req-e791dc43-c583-41b8-8d00-da8c22db2477'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:08:05.140741 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-e791dc43-c583-41b8-8d00-da8c22db2477 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62ff1389dc744db48b4db05f2c82eb63', 'request_id': 'req-e791dc43-c583-41b8-8d00-da8c22db2477'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:08:05.154410 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-e791dc43-c583-41b8-8d00-da8c22db2477 admin admin] The token cache is being invalidate because project 62ff1389dc744db48b4db05f2c82eb63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:08:05.154600 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-e791dc43-c583-41b8-8d00-da8c22db2477 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:08:05.155275 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-e791dc43-c583-41b8-8d00-da8c22db2477 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:08:05.156907 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1298/2613] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:08:05 2021] DELETE /identity/v3/projects/62ff1389dc744db48b4db05f2c82eb63 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:08:05.163985 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143d25a-d43c-4462-9a54-15d6c7de79de None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:05.164271 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143d25a-d43c-4462-9a54-15d6c7de79de None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:05.164601 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143d25a-d43c-4462-9a54-15d6c7de79de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:05.198078 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-2143d25a-d43c-4462-9a54-15d6c7de79de None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:08:05.199719 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-2143d25a-d43c-4462-9a54-15d6c7de79de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:08:05.275708 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1316/2614] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:08:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 17:08:05.276738 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414c4fb-61c2-4abe-8af4-88867af49f17 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:05.277057 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414c4fb-61c2-4abe-8af4-88867af49f17 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:05.277341 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f414c4fb-61c2-4abe-8af4-88867af49f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:05.310133 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-f414c4fb-61c2-4abe-8af4-88867af49f17 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:08:05.311363 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-f414c4fb-61c2-4abe-8af4-88867af49f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:08:05.319631 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1299/2615] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:08:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:08:05.323855 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143d25a-d43c-4462-9a54-15d6c7de79de None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:08:05.342262 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143d25a-d43c-4462-9a54-15d6c7de79de None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:08:05.347376 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e79dae-85bb-4747-b885-acf1d14d8dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:08:05.348531 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e79dae-85bb-4747-b885-acf1d14d8dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:05.348674 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e79dae-85bb-4747-b885-acf1d14d8dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:05.348987 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e79dae-85bb-4747-b885-acf1d14d8dd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:05.349796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e79dae-85bb-4747-b885-acf1d14d8dd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 17:08:05.350239 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e79dae-85bb-4747-b885-acf1d14d8dd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:08:05.352717 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e79dae-85bb-4747-b885-acf1d14d8dd0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:08:05.364868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1317/2616] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 17:08:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 17:08:05.369091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414c4fb-61c2-4abe-8af4-88867af49f17 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:08:05.378293 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f414c4fb-61c2-4abe-8af4-88867af49f17 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:08:05.383521 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f013a-bd65-4bb7-bb2d-6bcc6bc7d4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:08:05.384196 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f013a-bd65-4bb7-bb2d-6bcc6bc7d4fe admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:05.384481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f013a-bd65-4bb7-bb2d-6bcc6bc7d4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:05.384759 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52f013a-bd65-4bb7-bb2d-6bcc6bc7d4fe admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:05.385508 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f013a-bd65-4bb7-bb2d-6bcc6bc7d4fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:08:05.387469 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52f013a-bd65-4bb7-bb2d-6bcc6bc7d4fe admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:08:05.412292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1300/2617] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:08:05 2021] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:08:05.416320 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e79dae-85bb-4747-b885-acf1d14d8dd0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:08:05.425871 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e79dae-85bb-4747-b885-acf1d14d8dd0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:08:05.480855 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e73c53-a4f1-4034-881f-1aee7860cf83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:08:05.481529 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e73c53-a4f1-4034-881f-1aee7860cf83 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:05.481814 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e73c53-a4f1-4034-881f-1aee7860cf83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:05.482130 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e73c53-a4f1-4034-881f-1aee7860cf83 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:05.482896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e73c53-a4f1-4034-881f-1aee7860cf83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:08:05.484754 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e73c53-a4f1-4034-881f-1aee7860cf83 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:08:05.504673 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1318/2618] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:08:05 2021] POST /identity/v3/users => generated 285 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:08:05.509204 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f013a-bd65-4bb7-bb2d-6bcc6bc7d4fe admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:08:05.519293 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52f013a-bd65-4bb7-bb2d-6bcc6bc7d4fe admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:08:05.524518 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8200969-b9bf-4d8b-9c66-813ed0567b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:08:05.525166 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8200969-b9bf-4d8b-9c66-813ed0567b52 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:05.525450 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8200969-b9bf-4d8b-9c66-813ed0567b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:05.525753 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8200969-b9bf-4d8b-9c66-813ed0567b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:05.526525 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8200969-b9bf-4d8b-9c66-813ed0567b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:08:05.528107 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8200969-b9bf-4d8b-9c66-813ed0567b52 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:08:05.538664 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1301/2619] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:08:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:08:05.542399 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e73c53-a4f1-4034-881f-1aee7860cf83 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:08:05.552142 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e73c53-a4f1-4034-881f-1aee7860cf83 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:08:05.557384 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b8a41-852d-4d21-b934-6cd86b4696ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:08:05.558064 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b8a41-852d-4d21-b934-6cd86b4696ac admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:05.558358 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b8a41-852d-4d21-b934-6cd86b4696ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:05.558660 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b8a41-852d-4d21-b934-6cd86b4696ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:05.559390 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b8a41-852d-4d21-b934-6cd86b4696ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:08:05.560976 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b8a41-852d-4d21-b934-6cd86b4696ac admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:08:05.570488 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1319/2620] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:08:05 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 17:08:05.574401 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8200969-b9bf-4d8b-9c66-813ed0567b52 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:08:05.584166 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8200969-b9bf-4d8b-9c66-813ed0567b52 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:08:05.588834 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684c30f-45e9-4cfc-81b9-52154016ad49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:08:05.589692 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684c30f-45e9-4cfc-81b9-52154016ad49 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:05.590011 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684c30f-45e9-4cfc-81b9-52154016ad49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:05.590291 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684c30f-45e9-4cfc-81b9-52154016ad49 admin admin] PATH_INFO: `/v3/projects/4f05eceedaf647bda6d8b8b071be0b44/users/83027dbcdd12482f8a7badb12989cb0a/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:05.605641 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684c30f-45e9-4cfc-81b9-52154016ad49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f05eceedaf647bda6d8b8b071be0b44, user_id=83027dbcdd12482f8a7badb12989cb0a, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:08:05.608317 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684c30f-45e9-4cfc-81b9-52154016ad49 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:08:05.621840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1302/2621] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:08:05 2021] PUT /identity/v3/projects/4f05eceedaf647bda6d8b8b071be0b44/users/83027dbcdd12482f8a7badb12989cb0a/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 17:08:05.626812 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3e442-13e6-4fb7-bfbe-03f00f84c0eb None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:05.627111 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3e442-13e6-4fb7-bfbe-03f00f84c0eb None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:05.627392 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac3e442-13e6-4fb7-bfbe-03f00f84c0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:05.644451 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-3ac3e442-13e6-4fb7-bfbe-03f00f84c0eb None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:08:05.645644 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-3ac3e442-13e6-4fb7-bfbe-03f00f84c0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:08:05.700403 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1320/2622] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:08:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:08:05.710038 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684c30f-45e9-4cfc-81b9-52154016ad49 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:08:05.711805 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d684c30f-45e9-4cfc-81b9-52154016ad49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:08:05.766800 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684c30f-45e9-4cfc-81b9-52154016ad49 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:08:05.770489 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440fec5-2bd5-467b-b41d-ce7169c88758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:08:05.771134 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440fec5-2bd5-467b-b41d-ce7169c88758 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:05.771421 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440fec5-2bd5-467b-b41d-ce7169c88758 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:05.771700 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2440fec5-2bd5-467b-b41d-ce7169c88758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:05.781474 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440fec5-2bd5-467b-b41d-ce7169c88758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:08:05.782936 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2440fec5-2bd5-467b-b41d-ce7169c88758 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:08:05.792827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1303/2623] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:08:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:08:09.480477 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0044f-8821-4ef8-8673-3e23d1a4c98e None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:09.480963 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0044f-8821-4ef8-8673-3e23d1a4c98e None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:09.481274 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0044f-8821-4ef8-8673-3e23d1a4c98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:09.551594 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-22c0044f-8821-4ef8-8673-3e23d1a4c98e None None] MFA Rules not processed for user `83027dbcdd12482f8a7badb12989cb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:08:09.552906 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-22c0044f-8821-4ef8-8673-3e23d1a4c98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:08:09.640684 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1321/2624] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:08:09 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 17:08:09.645158 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440fec5-2bd5-467b-b41d-ce7169c88758 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:08:09.658799 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2440fec5-2bd5-467b-b41d-ce7169c88758 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:08:09.667596 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf273200-9206-424f-bc0a-287209dda6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:08:09.668628 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf273200-9206-424f-bc0a-287209dda6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:09.669001 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf273200-9206-424f-bc0a-287209dda6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:09.669369 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf273200-9206-424f-bc0a-287209dda6d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:09.671388 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf273200-9206-424f-bc0a-287209dda6d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:08:09.673551 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf273200-9206-424f-bc0a-287209dda6d1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:08:09.708739 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1304/2625] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:08:09 2021] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:08:09.713244 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0044f-8821-4ef8-8673-3e23d1a4c98e None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:08:09.724372 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0044f-8821-4ef8-8673-3e23d1a4c98e None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:08:09.795704 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966177d-2731-4ad6-b93e-3d7425717232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:08:09.796727 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966177d-2731-4ad6-b93e-3d7425717232 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:09.797099 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966177d-2731-4ad6-b93e-3d7425717232 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:09.797478 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6966177d-2731-4ad6-b93e-3d7425717232 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:09.798343 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966177d-2731-4ad6-b93e-3d7425717232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:08:09.800429 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6966177d-2731-4ad6-b93e-3d7425717232 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:08:09.824514 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1322/2626] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:08:09 2021] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:08:09.829059 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf273200-9206-424f-bc0a-287209dda6d1 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:08:09.841062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf273200-9206-424f-bc0a-287209dda6d1 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:08:09.847530 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4925192-a20b-48e6-a6cb-7012102dea74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:08:09.848211 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4925192-a20b-48e6-a6cb-7012102dea74 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:09.848490 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4925192-a20b-48e6-a6cb-7012102dea74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:09.848761 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4925192-a20b-48e6-a6cb-7012102dea74 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:09.849511 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4925192-a20b-48e6-a6cb-7012102dea74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:08:09.851354 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4925192-a20b-48e6-a6cb-7012102dea74 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:08:09.862678 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1305/2627] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:08:09 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:08:09.867476 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966177d-2731-4ad6-b93e-3d7425717232 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:08:09.879045 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6966177d-2731-4ad6-b93e-3d7425717232 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:08:09.885021 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec157c0-1ef8-498f-adaa-ba19ffc02614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:08:09.886117 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec157c0-1ef8-498f-adaa-ba19ffc02614 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:09.886508 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec157c0-1ef8-498f-adaa-ba19ffc02614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:09.886884 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec157c0-1ef8-498f-adaa-ba19ffc02614 admin admin] PATH_INFO: `/v3/projects/d06eb05efc8a41d988800153f00dba66/users/f9aba75ef13643cb92ed415d0267f9fd/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:09.904581 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec157c0-1ef8-498f-adaa-ba19ffc02614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06eb05efc8a41d988800153f00dba66, user_id=f9aba75ef13643cb92ed415d0267f9fd, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:08:09.907918 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec157c0-1ef8-498f-adaa-ba19ffc02614 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:08:09.923656 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1323/2628] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:08:09 2021] PUT /identity/v3/projects/d06eb05efc8a41d988800153f00dba66/users/f9aba75ef13643cb92ed415d0267f9fd/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 17:08:09.928066 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4925192-a20b-48e6-a6cb-7012102dea74 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:08:09.940793 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4925192-a20b-48e6-a6cb-7012102dea74 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:08:09.998153 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346cf34c-b3b3-4c75-92a4-616965781042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:08:09.998928 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cf34c-b3b3-4c75-92a4-616965781042 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:09.999290 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cf34c-b3b3-4c75-92a4-616965781042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:09.999643 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cf34c-b3b3-4c75-92a4-616965781042 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:10.000470 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346cf34c-b3b3-4c75-92a4-616965781042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:08:10.002193 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346cf34c-b3b3-4c75-92a4-616965781042 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:08:10.012429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1306/2629] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:08:09 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:08:10.016702 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec157c0-1ef8-498f-adaa-ba19ffc02614 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:08:10.027535 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec157c0-1ef8-498f-adaa-ba19ffc02614 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:08:10.032442 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6b346-e4cf-4bac-be9d-57566a5ac0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:08:10.033382 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6b346-e4cf-4bac-be9d-57566a5ac0da admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:10.033670 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6b346-e4cf-4bac-be9d-57566a5ac0da admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:10.034065 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6b346-e4cf-4bac-be9d-57566a5ac0da admin admin] PATH_INFO: `/v3/projects/d06eb05efc8a41d988800153f00dba66/users/f9aba75ef13643cb92ed415d0267f9fd/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:10.035997 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6b346-e4cf-4bac-be9d-57566a5ac0da admin admin] RBAC: Authorizing `identity:create_grant(project_id=d06eb05efc8a41d988800153f00dba66, user_id=f9aba75ef13643cb92ed415d0267f9fd, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:08:10.039293 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6b346-e4cf-4bac-be9d-57566a5ac0da admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:08:10.050495 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1324/2630] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:08:10 2021] PUT /identity/v3/projects/d06eb05efc8a41d988800153f00dba66/users/f9aba75ef13643cb92ed415d0267f9fd/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:08:14.818458 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbf937-ad0a-4d0c-b0ae-eb3eaabafac4 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:14.819543 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbf937-ad0a-4d0c-b0ae-eb3eaabafac4 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:14.819651 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabbf937-ad0a-4d0c-b0ae-eb3eaabafac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:14.847948 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-cabbf937-ad0a-4d0c-b0ae-eb3eaabafac4 None None] MFA Rules not processed for user `f9aba75ef13643cb92ed415d0267f9fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:08:14.849171 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-cabbf937-ad0a-4d0c-b0ae-eb3eaabafac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:08:14.922981 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1307/2631] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:08:14 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:08:14.935083 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6b346-e4cf-4bac-be9d-57566a5ac0da admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:08:14.936866 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-79c6b346-e4cf-4bac-be9d-57566a5ac0da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:08:15.012396 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6b346-e4cf-4bac-be9d-57566a5ac0da admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:08:15.017827 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2adf2-a513-4bdc-8533-9b8a46023b5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:08:15.018511 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2adf2-a513-4bdc-8533-9b8a46023b5f service nova] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:15.018795 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2adf2-a513-4bdc-8533-9b8a46023b5f service nova] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:15.019070 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f2adf2-a513-4bdc-8533-9b8a46023b5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:15.074267 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2adf2-a513-4bdc-8533-9b8a46023b5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:08:15.075880 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f2adf2-a513-4bdc-8533-9b8a46023b5f service nova] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:08:15.085063 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1325/2632] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:08:14 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:08:16.230501 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a35d4c-255c-456f-81c0-42641763d5ba None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:08:16.230986 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a35d4c-255c-456f-81c0-42641763d5ba None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:08:16.231084 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a35d4c-255c-456f-81c0-42641763d5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:08:16.249437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-72a35d4c-255c-456f-81c0-42641763d5ba None None] MFA Rules not processed for user `83027dbcdd12482f8a7badb12989cb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:08:16.250684 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-72a35d4c-255c-456f-81c0-42641763d5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:08:16.258543 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1308/2633] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:08:16 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:09:16.646723 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2adf2-a513-4bdc-8533-9b8a46023b5f service nova] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:09:16.648243 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-12f2adf2-a513-4bdc-8533-9b8a46023b5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:09:16.736610 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f2adf2-a513-4bdc-8533-9b8a46023b5f service nova] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:09:16.740407 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fc9c8-85ea-4623-b625-12c56d516dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:09:16.741069 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fc9c8-85ea-4623-b625-12c56d516dee service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:09:16.741351 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fc9c8-85ea-4623-b625-12c56d516dee service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:09:16.741627 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68fc9c8-85ea-4623-b625-12c56d516dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:09:16.743478 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e68fc9c8-85ea-4623-b625-12c56d516dee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:09:16.757563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fc9c8-85ea-4623-b625-12c56d516dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:09:16.759601 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68fc9c8-85ea-4623-b625-12c56d516dee service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:09:16.771984 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1326/2634] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:09:16 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:09:23.029294 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a35d4c-255c-456f-81c0-42641763d5ba None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:09:23.091904 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a35d4c-255c-456f-81c0-42641763d5ba None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:09:23.096313 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d3ba3-37e8-4b5c-bb75-f7017ed29e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:09:23.097154 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d3ba3-37e8-4b5c-bb75-f7017ed29e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:09:23.097431 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d3ba3-37e8-4b5c-bb75-f7017ed29e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:09:23.097700 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d3ba3-37e8-4b5c-bb75-f7017ed29e5d admin admin] PATH_INFO: `/v3/users/83027dbcdd12482f8a7badb12989cb0a` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:09:23.098938 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d3ba3-37e8-4b5c-bb75-f7017ed29e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=83027dbcdd12482f8a7badb12989cb0a)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:09:23.100836 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012d3ba3-37e8-4b5c-bb75-f7017ed29e5d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:09:23.146871 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-012d3ba3-37e8-4b5c-bb75-f7017ed29e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83027dbcdd12482f8a7badb12989cb0a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:23.154997 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-012d3ba3-37e8-4b5c-bb75-f7017ed29e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83027dbcdd12482f8a7badb12989cb0a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:23.162138 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-012d3ba3-37e8-4b5c-bb75-f7017ed29e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83027dbcdd12482f8a7badb12989cb0a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:23.162791 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-012d3ba3-37e8-4b5c-bb75-f7017ed29e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83027dbcdd12482f8a7badb12989cb0a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:23.174167 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-012d3ba3-37e8-4b5c-bb75-f7017ed29e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83027dbcdd12482f8a7badb12989cb0a'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:23.179947 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1309/2635] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:09:23 2021] DELETE /identity/v3/users/83027dbcdd12482f8a7badb12989cb0a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 17:09:23.356333 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fc9c8-85ea-4623-b625-12c56d516dee service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:09:23.366154 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68fc9c8-85ea-4623-b625-12c56d516dee service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:09:23.428354 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c67a6e-4cd0-4e1f-80dd-3e173bc731f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:09:23.429210 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c67a6e-4cd0-4e1f-80dd-3e173bc731f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:09:23.429490 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c67a6e-4cd0-4e1f-80dd-3e173bc731f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:09:23.429784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c67a6e-4cd0-4e1f-80dd-3e173bc731f7 admin admin] PATH_INFO: `/v3/projects/4f05eceedaf647bda6d8b8b071be0b44` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:09:23.431811 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c67a6e-4cd0-4e1f-80dd-3e173bc731f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f05eceedaf647bda6d8b8b071be0b44)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:09:23.433717 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c67a6e-4cd0-4e1f-80dd-3e173bc731f7 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:09:23.481857 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-95c67a6e-4cd0-4e1f-80dd-3e173bc731f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f05eceedaf647bda6d8b8b071be0b44', 'request_id': 'req-95c67a6e-4cd0-4e1f-80dd-3e173bc731f7'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:23.487018 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-95c67a6e-4cd0-4e1f-80dd-3e173bc731f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f05eceedaf647bda6d8b8b071be0b44', 'request_id': 'req-95c67a6e-4cd0-4e1f-80dd-3e173bc731f7'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:23.494437 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-95c67a6e-4cd0-4e1f-80dd-3e173bc731f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f05eceedaf647bda6d8b8b071be0b44', 'request_id': 'req-95c67a6e-4cd0-4e1f-80dd-3e173bc731f7'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:23.505131 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-95c67a6e-4cd0-4e1f-80dd-3e173bc731f7 admin admin] The token cache is being invalidate because project 4f05eceedaf647bda6d8b8b071be0b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:09:23.505417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-95c67a6e-4cd0-4e1f-80dd-3e173bc731f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:23.506082 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-95c67a6e-4cd0-4e1f-80dd-3e173bc731f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:23.507744 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1327/2636] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:09:23 2021] DELETE /identity/v3/projects/4f05eceedaf647bda6d8b8b071be0b44 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:09:23.511787 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d3ba3-37e8-4b5c-bb75-f7017ed29e5d admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:09:23.513129 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-012d3ba3-37e8-4b5c-bb75-f7017ed29e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:09:23.527518 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d3ba3-37e8-4b5c-bb75-f7017ed29e5d admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:09:23.587681 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b58736-a688-4e3c-8089-1196ce935feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:09:23.588603 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b58736-a688-4e3c-8089-1196ce935feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:09:23.588836 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b58736-a688-4e3c-8089-1196ce935feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:09:23.589163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b58736-a688-4e3c-8089-1196ce935feb admin admin] PATH_INFO: `/v3/users/f9aba75ef13643cb92ed415d0267f9fd` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:09:23.590324 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b58736-a688-4e3c-8089-1196ce935feb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9aba75ef13643cb92ed415d0267f9fd)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:09:23.592204 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b58736-a688-4e3c-8089-1196ce935feb admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:09:23.643999 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-93b58736-a688-4e3c-8089-1196ce935feb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9aba75ef13643cb92ed415d0267f9fd'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:23.652146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-93b58736-a688-4e3c-8089-1196ce935feb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9aba75ef13643cb92ed415d0267f9fd'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:23.659147 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-93b58736-a688-4e3c-8089-1196ce935feb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9aba75ef13643cb92ed415d0267f9fd'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:23.659791 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-93b58736-a688-4e3c-8089-1196ce935feb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9aba75ef13643cb92ed415d0267f9fd'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:23.671879 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-93b58736-a688-4e3c-8089-1196ce935feb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9aba75ef13643cb92ed415d0267f9fd'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:23.677638 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1310/2637] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:09:23 2021] DELETE /identity/v3/users/f9aba75ef13643cb92ed415d0267f9fd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 17:09:23.851310 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c67a6e-4cd0-4e1f-80dd-3e173bc731f7 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:09:23.853665 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-95c67a6e-4cd0-4e1f-80dd-3e173bc731f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:09:23.868935 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c67a6e-4cd0-4e1f-80dd-3e173bc731f7 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:09:23.927635 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517297fb-38e4-412f-b682-4aeee69e4de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:09:23.929156 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517297fb-38e4-412f-b682-4aeee69e4de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:09:23.929834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517297fb-38e4-412f-b682-4aeee69e4de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:09:23.930648 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517297fb-38e4-412f-b682-4aeee69e4de5 admin admin] PATH_INFO: `/v3/projects/d06eb05efc8a41d988800153f00dba66` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:09:23.931869 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517297fb-38e4-412f-b682-4aeee69e4de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d06eb05efc8a41d988800153f00dba66)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:09:23.933794 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517297fb-38e4-412f-b682-4aeee69e4de5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:09:23.980071 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-517297fb-38e4-412f-b682-4aeee69e4de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd06eb05efc8a41d988800153f00dba66', 'request_id': 'req-517297fb-38e4-412f-b682-4aeee69e4de5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:23.985477 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-517297fb-38e4-412f-b682-4aeee69e4de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd06eb05efc8a41d988800153f00dba66', 'request_id': 'req-517297fb-38e4-412f-b682-4aeee69e4de5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:23.992496 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-517297fb-38e4-412f-b682-4aeee69e4de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd06eb05efc8a41d988800153f00dba66', 'request_id': 'req-517297fb-38e4-412f-b682-4aeee69e4de5'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:24.003931 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-517297fb-38e4-412f-b682-4aeee69e4de5 admin admin] The token cache is being invalidate because project d06eb05efc8a41d988800153f00dba66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:09:24.004215 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-517297fb-38e4-412f-b682-4aeee69e4de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:24.004852 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-517297fb-38e4-412f-b682-4aeee69e4de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:09:24.006978 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1328/2638] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:09:23 2021] DELETE /identity/v3/projects/d06eb05efc8a41d988800153f00dba66 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:09:41.985444 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b58736-a688-4e3c-8089-1196ce935feb admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:09:41.986893 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-93b58736-a688-4e3c-8089-1196ce935feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:09:42.066821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b58736-a688-4e3c-8089-1196ce935feb admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:09:42.126339 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139f644-fcf9-4720-838f-96954e5fbd99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f13d0e9f79a433c81759ecd819a6dfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:09:42.126976 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139f644-fcf9-4720-838f-96954e5fbd99 service nova] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:09:42.127266 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139f644-fcf9-4720-838f-96954e5fbd99 service nova] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:09:42.127539 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a139f644-fcf9-4720-838f-96954e5fbd99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:09:42.129303 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a139f644-fcf9-4720-838f-96954e5fbd99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:09:42.194127 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139f644-fcf9-4720-838f-96954e5fbd99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:09:42.195694 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a139f644-fcf9-4720-838f-96954e5fbd99 service nova] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:09:42.205021 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1311/2639] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:09:41 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:10:25.919274 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9dbe7-2c0c-44eb-8b3d-1ec45d81d3cb None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:10:25.919900 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9dbe7-2c0c-44eb-8b3d-1ec45d81d3cb None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:10:25.919900 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9dbe7-2c0c-44eb-8b3d-1ec45d81d3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:10:25.975938 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-fbe9dbe7-2c0c-44eb-8b3d-1ec45d81d3cb None None] MFA Rules not processed for user `34c34efa8fd24230aa45e0f67209260e`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:10:25.977161 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-fbe9dbe7-2c0c-44eb-8b3d-1ec45d81d3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:10:26.046690 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1329/2640] 10.222.0.53 () {58 vars in 1015 bytes} [Fri Oct 29 17:10:25 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:10:26.060837 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139f644-fcf9-4720-838f-96954e5fbd99 service nova] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:10:26.062291 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a139f644-fcf9-4720-838f-96954e5fbd99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:10:26.085581 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a139f644-fcf9-4720-838f-96954e5fbd99 service nova] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:10:26.090648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13f134-5bbf-4bc2-beb3-94063389186c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:10:26.091276 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13f134-5bbf-4bc2-beb3-94063389186c service placement] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:10:26.091560 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13f134-5bbf-4bc2-beb3-94063389186c service placement] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:10:26.091834 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13f134-5bbf-4bc2-beb3-94063389186c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:10:26.099959 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13f134-5bbf-4bc2-beb3-94063389186c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:10:26.101517 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13f134-5bbf-4bc2-beb3-94063389186c service placement] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:10:26.111282 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1312/2641] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:10:26 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:10:34.716042 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9dbe7-2c0c-44eb-8b3d-1ec45d81d3cb None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:10:34.717367 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-fbe9dbe7-2c0c-44eb-8b3d-1ec45d81d3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:10:34.771175 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9dbe7-2c0c-44eb-8b3d-1ec45d81d3cb None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:10:34.774822 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893871b8-3110-4de7-8bb4-0ecea75e4eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:10:34.775466 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893871b8-3110-4de7-8bb4-0ecea75e4eaa service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:10:34.775747 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893871b8-3110-4de7-8bb4-0ecea75e4eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:10:34.776021 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893871b8-3110-4de7-8bb4-0ecea75e4eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:10:34.777793 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-893871b8-3110-4de7-8bb4-0ecea75e4eaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:10:34.791800 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893871b8-3110-4de7-8bb4-0ecea75e4eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:10:34.793227 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893871b8-3110-4de7-8bb4-0ecea75e4eaa service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:10:34.805166 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1330/2642] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:10:34 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:11:20.219896 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93b9f8-86a8-4a20-8f7e-a1ff6672ee27 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:11:20.220309 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93b9f8-86a8-4a20-8f7e-a1ff6672ee27 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:11:20.220309 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d93b9f8-86a8-4a20-8f7e-a1ff6672ee27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:11:20.248975 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-1d93b9f8-86a8-4a20-8f7e-a1ff6672ee27 None None] MFA Rules not processed for user `9652ec3b44ee410dba2491c8f9795e20`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:11:20.250200 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1d93b9f8-86a8-4a20-8f7e-a1ff6672ee27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:11:20.308332 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1313/2643] 10.222.0.41 () {58 vars in 1059 bytes} [Fri Oct 29 17:11:20 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:11:20.314576 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893871b8-3110-4de7-8bb4-0ecea75e4eaa service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:11:20.323483 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893871b8-3110-4de7-8bb4-0ecea75e4eaa service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:11:20.327610 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f8bf1-7154-4d39-9f4f-1f7de7bde896 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:11:20.328240 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f8bf1-7154-4d39-9f4f-1f7de7bde896 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:11:20.328524 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f8bf1-7154-4d39-9f4f-1f7de7bde896 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:11:20.328801 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061f8bf1-7154-4d39-9f4f-1f7de7bde896 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:11:20.330554 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-061f8bf1-7154-4d39-9f4f-1f7de7bde896 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:11:20.407951 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f8bf1-7154-4d39-9f4f-1f7de7bde896 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:11:20.409402 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061f8bf1-7154-4d39-9f4f-1f7de7bde896 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:11:20.426950 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1331/2644] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:11:20 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:13:20.691151 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93b9f8-86a8-4a20-8f7e-a1ff6672ee27 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:13:20.698837 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d93b9f8-86a8-4a20-8f7e-a1ff6672ee27 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:13:20.702411 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6423d69-053c-4c7f-8e8e-6b796ce71b80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:13:20.703032 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6423d69-053c-4c7f-8e8e-6b796ce71b80 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:13:20.703354 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6423d69-053c-4c7f-8e8e-6b796ce71b80 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:13:20.703633 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6423d69-053c-4c7f-8e8e-6b796ce71b80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:13:20.705362 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-f6423d69-053c-4c7f-8e8e-6b796ce71b80 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:13:20.773475 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6423d69-053c-4c7f-8e8e-6b796ce71b80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:13:20.774943 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6423d69-053c-4c7f-8e8e-6b796ce71b80 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:13:20.784544 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1314/2645] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:13:20 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:13:20.826095 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f8bf1-7154-4d39-9f4f-1f7de7bde896 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:13:20.834092 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061f8bf1-7154-4d39-9f4f-1f7de7bde896 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:13:20.837588 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf36fc0-0a4b-41e1-bbc2-60c4e335b2a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:13:20.838254 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf36fc0-0a4b-41e1-bbc2-60c4e335b2a9 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:13:20.838532 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf36fc0-0a4b-41e1-bbc2-60c4e335b2a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:13:20.838802 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf36fc0-0a4b-41e1-bbc2-60c4e335b2a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:13:20.840539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-fcf36fc0-0a4b-41e1-bbc2-60c4e335b2a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:13:20.908188 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf36fc0-0a4b-41e1-bbc2-60c4e335b2a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:13:20.909639 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf36fc0-0a4b-41e1-bbc2-60c4e335b2a9 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:13:20.918571 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1332/2646] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:13:20 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:13:22.131200 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497db23-8a4a-4dd8-8e8c-5c2dd04f78ba None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:13:22.132628 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497db23-8a4a-4dd8-8e8c-5c2dd04f78ba None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:13:22.132628 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497db23-8a4a-4dd8-8e8c-5c2dd04f78ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:13:22.156931 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-1497db23-8a4a-4dd8-8e8c-5c2dd04f78ba None None] MFA Rules not processed for user `33143e95face4c81af346e9ca6991ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:13:22.158174 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1497db23-8a4a-4dd8-8e8c-5c2dd04f78ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:13:22.165006 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1315/2647] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:13:22 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:14:06.043763 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf36fc0-0a4b-41e1-bbc2-60c4e335b2a9 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:14:06.045331 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-fcf36fc0-0a4b-41e1-bbc2-60c4e335b2a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:14:06.056651 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf36fc0-0a4b-41e1-bbc2-60c4e335b2a9 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:14:06.060408 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a18aad-339a-4a42-a78c-318316f71fa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:14:06.061058 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a18aad-339a-4a42-a78c-318316f71fa9 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:14:06.061339 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a18aad-339a-4a42-a78c-318316f71fa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:14:06.061612 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a18aad-339a-4a42-a78c-318316f71fa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:14:06.070402 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a18aad-339a-4a42-a78c-318316f71fa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:14:06.071839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a18aad-339a-4a42-a78c-318316f71fa9 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:14:06.081777 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1333/2648] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:14:06 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:14:06.313763 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497db23-8a4a-4dd8-8e8c-5c2dd04f78ba None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:14:06.323236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497db23-8a4a-4dd8-8e8c-5c2dd04f78ba None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:14:06.326809 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a5784-3142-4759-9e01-99b73bd149f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:14:06.327440 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a5784-3142-4759-9e01-99b73bd149f9 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:14:06.328262 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a5784-3142-4759-9e01-99b73bd149f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:14:06.328539 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a5784-3142-4759-9e01-99b73bd149f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:14:06.330309 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d42a5784-3142-4759-9e01-99b73bd149f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:14:06.412473 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a5784-3142-4759-9e01-99b73bd149f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:14:06.413900 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a5784-3142-4759-9e01-99b73bd149f9 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:14:06.431957 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1316/2649] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:14:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:14:07.017398 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1bb17-31c8-4838-827c-a1a152e5d365 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:14:07.017778 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1bb17-31c8-4838-827c-a1a152e5d365 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:14:07.018216 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1bb17-31c8-4838-827c-a1a152e5d365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:14:07.043746 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-a0f1bb17-31c8-4838-827c-a1a152e5d365 None None] MFA Rules not processed for user `8719b276102043fda5c941da84654009`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:14:07.044865 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a0f1bb17-31c8-4838-827c-a1a152e5d365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:14:07.052327 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1334/2650] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:14:07 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:14:12.269709 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a5784-3142-4759-9e01-99b73bd149f9 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:14:12.271287 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d42a5784-3142-4759-9e01-99b73bd149f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:14:12.287366 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a5784-3142-4759-9e01-99b73bd149f9 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:14:12.294074 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e666d-a625-4ea3-a4c9-6494e9f12511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:14:12.295615 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e666d-a625-4ea3-a4c9-6494e9f12511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:14:12.295886 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e666d-a625-4ea3-a4c9-6494e9f12511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:14:12.296132 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e666d-a625-4ea3-a4c9-6494e9f12511 admin admin] PATH_INFO: `/v3/users/341008d14e7542dfb594eea1cf304ba4` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:14:12.297354 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e666d-a625-4ea3-a4c9-6494e9f12511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=341008d14e7542dfb594eea1cf304ba4)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:14:12.299436 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e666d-a625-4ea3-a4c9-6494e9f12511 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:14:12.344827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-1b6e666d-a625-4ea3-a4c9-6494e9f12511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '341008d14e7542dfb594eea1cf304ba4'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:12.352100 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-1b6e666d-a625-4ea3-a4c9-6494e9f12511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '341008d14e7542dfb594eea1cf304ba4'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:12.359193 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-1b6e666d-a625-4ea3-a4c9-6494e9f12511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '341008d14e7542dfb594eea1cf304ba4'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:12.359821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-1b6e666d-a625-4ea3-a4c9-6494e9f12511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '341008d14e7542dfb594eea1cf304ba4'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:12.371119 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-1b6e666d-a625-4ea3-a4c9-6494e9f12511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '341008d14e7542dfb594eea1cf304ba4'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:12.377271 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1317/2651] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:14:12 2021] DELETE /identity/v3/users/341008d14e7542dfb594eea1cf304ba4 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:14:12.544947 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1bb17-31c8-4838-827c-a1a152e5d365 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:14:12.560932 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1bb17-31c8-4838-827c-a1a152e5d365 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:14:12.614631 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d496c-84c9-4ae1-ba3e-035d71164f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:14:12.615469 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d496c-84c9-4ae1-ba3e-035d71164f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:14:12.615743 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d496c-84c9-4ae1-ba3e-035d71164f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:14:12.616118 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d496c-84c9-4ae1-ba3e-035d71164f85 admin admin] PATH_INFO: `/v3/projects/3e527ec7466240de936dcb59eb9328a6` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:14:12.617282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d496c-84c9-4ae1-ba3e-035d71164f85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e527ec7466240de936dcb59eb9328a6)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:14:12.619198 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d496c-84c9-4ae1-ba3e-035d71164f85 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:14:12.661872 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d10d496c-84c9-4ae1-ba3e-035d71164f85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e527ec7466240de936dcb59eb9328a6', 'request_id': 'req-d10d496c-84c9-4ae1-ba3e-035d71164f85'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:12.666989 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d10d496c-84c9-4ae1-ba3e-035d71164f85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e527ec7466240de936dcb59eb9328a6', 'request_id': 'req-d10d496c-84c9-4ae1-ba3e-035d71164f85'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:12.673998 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d10d496c-84c9-4ae1-ba3e-035d71164f85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e527ec7466240de936dcb59eb9328a6', 'request_id': 'req-d10d496c-84c9-4ae1-ba3e-035d71164f85'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:12.684298 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d10d496c-84c9-4ae1-ba3e-035d71164f85 admin admin] The token cache is being invalidate because project 3e527ec7466240de936dcb59eb9328a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:14:12.684578 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d10d496c-84c9-4ae1-ba3e-035d71164f85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:12.685190 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d10d496c-84c9-4ae1-ba3e-035d71164f85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:12.686721 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1335/2652] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:14:12 2021] DELETE /identity/v3/projects/3e527ec7466240de936dcb59eb9328a6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:14:12.691206 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e666d-a625-4ea3-a4c9-6494e9f12511 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:14:12.692567 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1b6e666d-a625-4ea3-a4c9-6494e9f12511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:14:12.706072 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e666d-a625-4ea3-a4c9-6494e9f12511 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:14:12.759721 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7dbfa-8216-44ba-9981-4cf377782a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:14:12.760501 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7dbfa-8216-44ba-9981-4cf377782a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:14:12.760782 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7dbfa-8216-44ba-9981-4cf377782a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:14:12.761058 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7dbfa-8216-44ba-9981-4cf377782a35 admin admin] PATH_INFO: `/v3/users/838f1bda40b546dc8cf970f229481ac7` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:14:12.774529 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7dbfa-8216-44ba-9981-4cf377782a35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=838f1bda40b546dc8cf970f229481ac7)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:14:12.776493 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7dbfa-8216-44ba-9981-4cf377782a35 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:14:12.819642 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-65e7dbfa-8216-44ba-9981-4cf377782a35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '838f1bda40b546dc8cf970f229481ac7'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:12.827047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-65e7dbfa-8216-44ba-9981-4cf377782a35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '838f1bda40b546dc8cf970f229481ac7'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:12.834376 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-65e7dbfa-8216-44ba-9981-4cf377782a35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '838f1bda40b546dc8cf970f229481ac7'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:12.835001 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-65e7dbfa-8216-44ba-9981-4cf377782a35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '838f1bda40b546dc8cf970f229481ac7'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:12.846157 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-65e7dbfa-8216-44ba-9981-4cf377782a35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '838f1bda40b546dc8cf970f229481ac7'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:12.851839 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1318/2653] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:14:12 2021] DELETE /identity/v3/users/838f1bda40b546dc8cf970f229481ac7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:14:13.022966 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d496c-84c9-4ae1-ba3e-035d71164f85 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:14:13.024848 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-d10d496c-84c9-4ae1-ba3e-035d71164f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:14:13.038173 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d496c-84c9-4ae1-ba3e-035d71164f85 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:14:13.094164 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55730a-271f-45e8-8ec3-fffc1914af59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:14:13.095024 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55730a-271f-45e8-8ec3-fffc1914af59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:14:13.095310 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55730a-271f-45e8-8ec3-fffc1914af59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:14:13.095588 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b55730a-271f-45e8-8ec3-fffc1914af59 admin admin] PATH_INFO: `/v3/projects/e8297dadeca64ed098a4379ea1d556c2` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:14:13.105607 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55730a-271f-45e8-8ec3-fffc1914af59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8297dadeca64ed098a4379ea1d556c2)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:14:13.107562 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b55730a-271f-45e8-8ec3-fffc1914af59 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:14:13.151381 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7b55730a-271f-45e8-8ec3-fffc1914af59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8297dadeca64ed098a4379ea1d556c2', 'request_id': 'req-7b55730a-271f-45e8-8ec3-fffc1914af59'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:13.156876 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7b55730a-271f-45e8-8ec3-fffc1914af59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8297dadeca64ed098a4379ea1d556c2', 'request_id': 'req-7b55730a-271f-45e8-8ec3-fffc1914af59'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:13.164018 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7b55730a-271f-45e8-8ec3-fffc1914af59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8297dadeca64ed098a4379ea1d556c2', 'request_id': 'req-7b55730a-271f-45e8-8ec3-fffc1914af59'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:13.175835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7b55730a-271f-45e8-8ec3-fffc1914af59 admin admin] The token cache is being invalidate because project e8297dadeca64ed098a4379ea1d556c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:14:13.176118 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7b55730a-271f-45e8-8ec3-fffc1914af59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:13.176746 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7b55730a-271f-45e8-8ec3-fffc1914af59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:14:13.178294 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1336/2654] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:14:13 2021] DELETE /identity/v3/projects/e8297dadeca64ed098a4379ea1d556c2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:15:21.221705 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7dbfa-8216-44ba-9981-4cf377782a35 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:21.222511 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-65e7dbfa-8216-44ba-9981-4cf377782a35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:15:21.282251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7dbfa-8216-44ba-9981-4cf377782a35 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:21.329537 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9214ec0-4e6a-42df-9813-700f4e94711c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:21.330214 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9214ec0-4e6a-42df-9813-700f4e94711c service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:21.330527 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9214ec0-4e6a-42df-9813-700f4e94711c service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:21.330828 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9214ec0-4e6a-42df-9813-700f4e94711c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:21.332582 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d9214ec0-4e6a-42df-9813-700f4e94711c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:15:21.389377 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9214ec0-4e6a-42df-9813-700f4e94711c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:21.390823 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9214ec0-4e6a-42df-9813-700f4e94711c service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:21.399368 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1319/2655] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:15:21 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:15:21.617088 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55730a-271f-45e8-8ec3-fffc1914af59 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:21.618563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-7b55730a-271f-45e8-8ec3-fffc1914af59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:15:21.673223 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b55730a-271f-45e8-8ec3-fffc1914af59 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:21.676857 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a4909-2cda-45b6-943f-4b82dfab3468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:21.677435 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a4909-2cda-45b6-943f-4b82dfab3468 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:21.677716 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a4909-2cda-45b6-943f-4b82dfab3468 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:21.678015 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a4909-2cda-45b6-943f-4b82dfab3468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:21.679741 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-222a4909-2cda-45b6-943f-4b82dfab3468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:15:21.739072 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a4909-2cda-45b6-943f-4b82dfab3468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:21.740506 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a4909-2cda-45b6-943f-4b82dfab3468 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:21.749856 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1337/2656] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:15:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:15:22.904289 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9214ec0-4e6a-42df-9813-700f4e94711c service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:22.905933 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-d9214ec0-4e6a-42df-9813-700f4e94711c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:15:22.920520 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9214ec0-4e6a-42df-9813-700f4e94711c service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:22.925251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6d979-3ec8-43f5-8e0c-8a970f0f8371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:22.926129 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6d979-3ec8-43f5-8e0c-8a970f0f8371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:22.926408 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6d979-3ec8-43f5-8e0c-8a970f0f8371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:22.926678 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6d979-3ec8-43f5-8e0c-8a970f0f8371 admin admin] PATH_INFO: `/v3/users/5f31ab27b7e34eaa8c02e06c9c6a14ec` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:22.927855 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6d979-3ec8-43f5-8e0c-8a970f0f8371 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f31ab27b7e34eaa8c02e06c9c6a14ec)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:22.929744 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6d979-3ec8-43f5-8e0c-8a970f0f8371 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:22.973815 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c5b6d979-3ec8-43f5-8e0c-8a970f0f8371 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f31ab27b7e34eaa8c02e06c9c6a14ec'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:22.980463 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c5b6d979-3ec8-43f5-8e0c-8a970f0f8371 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f31ab27b7e34eaa8c02e06c9c6a14ec'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:22.987753 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c5b6d979-3ec8-43f5-8e0c-8a970f0f8371 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f31ab27b7e34eaa8c02e06c9c6a14ec'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:22.988509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c5b6d979-3ec8-43f5-8e0c-8a970f0f8371 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f31ab27b7e34eaa8c02e06c9c6a14ec'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:22.999859 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-c5b6d979-3ec8-43f5-8e0c-8a970f0f8371 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f31ab27b7e34eaa8c02e06c9c6a14ec'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:23.006198 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1320/2657] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:15:22 2021] DELETE /identity/v3/users/5f31ab27b7e34eaa8c02e06c9c6a14ec => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:15:23.177241 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a4909-2cda-45b6-943f-4b82dfab3468 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:23.187031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a4909-2cda-45b6-943f-4b82dfab3468 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:23.242889 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbb9d4-176e-42fc-a702-7b5eeae4fa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:23.243739 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbb9d4-176e-42fc-a702-7b5eeae4fa92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:23.244022 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbb9d4-176e-42fc-a702-7b5eeae4fa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:23.244298 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dbb9d4-176e-42fc-a702-7b5eeae4fa92 admin admin] PATH_INFO: `/v3/projects/c92d01c81a8e490e9c103c0351f7ad1b` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:23.245481 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbb9d4-176e-42fc-a702-7b5eeae4fa92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c92d01c81a8e490e9c103c0351f7ad1b)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:23.247425 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dbb9d4-176e-42fc-a702-7b5eeae4fa92 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:23.291897 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-63dbb9d4-176e-42fc-a702-7b5eeae4fa92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c92d01c81a8e490e9c103c0351f7ad1b', 'request_id': 'req-63dbb9d4-176e-42fc-a702-7b5eeae4fa92'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:23.297070 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-63dbb9d4-176e-42fc-a702-7b5eeae4fa92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c92d01c81a8e490e9c103c0351f7ad1b', 'request_id': 'req-63dbb9d4-176e-42fc-a702-7b5eeae4fa92'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:23.304572 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-63dbb9d4-176e-42fc-a702-7b5eeae4fa92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c92d01c81a8e490e9c103c0351f7ad1b', 'request_id': 'req-63dbb9d4-176e-42fc-a702-7b5eeae4fa92'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:23.315925 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-63dbb9d4-176e-42fc-a702-7b5eeae4fa92 admin admin] The token cache is being invalidate because project c92d01c81a8e490e9c103c0351f7ad1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:15:23.316212 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-63dbb9d4-176e-42fc-a702-7b5eeae4fa92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:23.316837 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-63dbb9d4-176e-42fc-a702-7b5eeae4fa92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:23.318382 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1338/2658] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:15:23 2021] DELETE /identity/v3/projects/c92d01c81a8e490e9c103c0351f7ad1b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:15:23.322462 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6d979-3ec8-43f5-8e0c-8a970f0f8371 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:23.323932 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-c5b6d979-3ec8-43f5-8e0c-8a970f0f8371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:15:23.336631 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6d979-3ec8-43f5-8e0c-8a970f0f8371 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:23.391413 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65783213-2b27-4b68-860d-4747cc13d387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:23.392250 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65783213-2b27-4b68-860d-4747cc13d387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:23.392534 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65783213-2b27-4b68-860d-4747cc13d387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:23.392864 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65783213-2b27-4b68-860d-4747cc13d387 admin admin] PATH_INFO: `/v3/users/7d5fef1ce3e94490a946ed7305af4930` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:23.404996 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65783213-2b27-4b68-860d-4747cc13d387 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d5fef1ce3e94490a946ed7305af4930)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:23.406991 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65783213-2b27-4b68-860d-4747cc13d387 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:23.453961 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-65783213-2b27-4b68-860d-4747cc13d387 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d5fef1ce3e94490a946ed7305af4930'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:23.461048 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-65783213-2b27-4b68-860d-4747cc13d387 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d5fef1ce3e94490a946ed7305af4930'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:23.467777 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-65783213-2b27-4b68-860d-4747cc13d387 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d5fef1ce3e94490a946ed7305af4930'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:23.468406 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-65783213-2b27-4b68-860d-4747cc13d387 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d5fef1ce3e94490a946ed7305af4930'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:23.479635 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-65783213-2b27-4b68-860d-4747cc13d387 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d5fef1ce3e94490a946ed7305af4930'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:23.486118 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1321/2659] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:15:23 2021] DELETE /identity/v3/users/7d5fef1ce3e94490a946ed7305af4930 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:15:23.663429 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbb9d4-176e-42fc-a702-7b5eeae4fa92 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:23.665153 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-63dbb9d4-176e-42fc-a702-7b5eeae4fa92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:15:23.680372 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dbb9d4-176e-42fc-a702-7b5eeae4fa92 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:23.743223 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862ed25-06c2-4f56-9208-79f82fbd4896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:23.744066 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862ed25-06c2-4f56-9208-79f82fbd4896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:23.744344 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862ed25-06c2-4f56-9208-79f82fbd4896 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:23.744616 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862ed25-06c2-4f56-9208-79f82fbd4896 admin admin] PATH_INFO: `/v3/projects/2777faa3a60d4316ba614f91b1146109` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:23.755342 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862ed25-06c2-4f56-9208-79f82fbd4896 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2777faa3a60d4316ba614f91b1146109)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:23.757235 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862ed25-06c2-4f56-9208-79f82fbd4896 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:23.800891 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-6862ed25-06c2-4f56-9208-79f82fbd4896 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2777faa3a60d4316ba614f91b1146109', 'request_id': 'req-6862ed25-06c2-4f56-9208-79f82fbd4896'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:23.805992 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-6862ed25-06c2-4f56-9208-79f82fbd4896 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2777faa3a60d4316ba614f91b1146109', 'request_id': 'req-6862ed25-06c2-4f56-9208-79f82fbd4896'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:23.813057 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-6862ed25-06c2-4f56-9208-79f82fbd4896 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2777faa3a60d4316ba614f91b1146109', 'request_id': 'req-6862ed25-06c2-4f56-9208-79f82fbd4896'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:23.824111 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-6862ed25-06c2-4f56-9208-79f82fbd4896 admin admin] The token cache is being invalidate because project 2777faa3a60d4316ba614f91b1146109 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:15:23.824391 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-6862ed25-06c2-4f56-9208-79f82fbd4896 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:23.825016 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-6862ed25-06c2-4f56-9208-79f82fbd4896 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:15:23.826545 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1339/2660] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:15:23 2021] DELETE /identity/v3/projects/2777faa3a60d4316ba614f91b1146109 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:15:23.833081 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23859b62-9a94-4543-9fbc-bd41b1766265 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:23.833368 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23859b62-9a94-4543-9fbc-bd41b1766265 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:23.833671 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23859b62-9a94-4543-9fbc-bd41b1766265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:23.879109 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-23859b62-9a94-4543-9fbc-bd41b1766265 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:15:23.880304 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-23859b62-9a94-4543-9fbc-bd41b1766265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:15:23.937251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1322/2661] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:15:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:15:23.945286 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601db581-7699-4439-86c2-8ddff54ffead None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:23.945576 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601db581-7699-4439-86c2-8ddff54ffead None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:23.945851 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601db581-7699-4439-86c2-8ddff54ffead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:23.963531 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-601db581-7699-4439-86c2-8ddff54ffead None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:15:23.964729 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-601db581-7699-4439-86c2-8ddff54ffead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:15:23.973089 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1340/2662] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:15:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:15:23.977196 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23859b62-9a94-4543-9fbc-bd41b1766265 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:23.987553 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23859b62-9a94-4543-9fbc-bd41b1766265 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:23.992124 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2762b-46fd-41a8-a2e5-e2ecfdb4827e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:23.992762 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2762b-46fd-41a8-a2e5-e2ecfdb4827e admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:23.993046 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2762b-46fd-41a8-a2e5-e2ecfdb4827e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:23.993321 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2762b-46fd-41a8-a2e5-e2ecfdb4827e admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:23.994092 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2762b-46fd-41a8-a2e5-e2ecfdb4827e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 17:15:23.994398 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2762b-46fd-41a8-a2e5-e2ecfdb4827e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:23.995983 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2762b-46fd-41a8-a2e5-e2ecfdb4827e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:24.007186 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1323/2663] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 17:15:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 17:15:24.011501 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601db581-7699-4439-86c2-8ddff54ffead None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:24.020895 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601db581-7699-4439-86c2-8ddff54ffead None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:24.025632 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e03da-982d-4338-a8d2-2ca1ffc88948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:24.026305 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e03da-982d-4338-a8d2-2ca1ffc88948 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:24.026587 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e03da-982d-4338-a8d2-2ca1ffc88948 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:24.026861 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201e03da-982d-4338-a8d2-2ca1ffc88948 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:24.027557 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e03da-982d-4338-a8d2-2ca1ffc88948 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:24.029551 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201e03da-982d-4338-a8d2-2ca1ffc88948 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:24.063381 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1341/2664] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:15:24 2021] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:15:24.067462 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2762b-46fd-41a8-a2e5-e2ecfdb4827e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:24.077005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2762b-46fd-41a8-a2e5-e2ecfdb4827e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:24.132263 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f21b8-9928-4884-9d59-fe911ec962c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:24.132914 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f21b8-9928-4884-9d59-fe911ec962c4 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:24.133192 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f21b8-9928-4884-9d59-fe911ec962c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:24.133461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f21b8-9928-4884-9d59-fe911ec962c4 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:24.134177 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f21b8-9928-4884-9d59-fe911ec962c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:24.136065 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f21b8-9928-4884-9d59-fe911ec962c4 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:24.155562 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1324/2665] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:15:24 2021] POST /identity/v3/users => generated 292 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:15:24.160209 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e03da-982d-4338-a8d2-2ca1ffc88948 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:24.170285 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201e03da-982d-4338-a8d2-2ca1ffc88948 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:24.174926 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b69cc-475c-42d7-9fa2-67f1bccebe3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:24.175581 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b69cc-475c-42d7-9fa2-67f1bccebe3a admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:24.175865 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b69cc-475c-42d7-9fa2-67f1bccebe3a admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:24.176140 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b69cc-475c-42d7-9fa2-67f1bccebe3a admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:24.176872 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b69cc-475c-42d7-9fa2-67f1bccebe3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:24.178506 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b69cc-475c-42d7-9fa2-67f1bccebe3a admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:24.188209 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1342/2666] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:15:24 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:15:24.192134 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f21b8-9928-4884-9d59-fe911ec962c4 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:24.202919 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f21b8-9928-4884-9d59-fe911ec962c4 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:24.208221 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973217e-dd82-47eb-9a07-faa154877978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:24.208881 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973217e-dd82-47eb-9a07-faa154877978 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:24.209164 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973217e-dd82-47eb-9a07-faa154877978 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:24.209441 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973217e-dd82-47eb-9a07-faa154877978 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:24.210223 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973217e-dd82-47eb-9a07-faa154877978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:24.211841 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4973217e-dd82-47eb-9a07-faa154877978 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:24.222236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1325/2667] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:15:24 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:15:24.226497 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b69cc-475c-42d7-9fa2-67f1bccebe3a admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:24.236728 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b69cc-475c-42d7-9fa2-67f1bccebe3a admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:24.241361 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2968a83-6dbc-4a6c-ad89-3d618fd09c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:24.242258 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2968a83-6dbc-4a6c-ad89-3d618fd09c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:24.242544 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2968a83-6dbc-4a6c-ad89-3d618fd09c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:24.242822 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2968a83-6dbc-4a6c-ad89-3d618fd09c4f admin admin] PATH_INFO: `/v3/projects/6da3f28f00664da28169cb7606237c93/users/6fe4f32209784a39a8b451f8fcf23395/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:24.257265 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2968a83-6dbc-4a6c-ad89-3d618fd09c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da3f28f00664da28169cb7606237c93, user_id=6fe4f32209784a39a8b451f8fcf23395, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:24.259951 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2968a83-6dbc-4a6c-ad89-3d618fd09c4f admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:24.276211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1343/2668] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:15:24 2021] PUT /identity/v3/projects/6da3f28f00664da28169cb7606237c93/users/6fe4f32209784a39a8b451f8fcf23395/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:15:24.287010 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55a514-95b8-4892-8d6a-f72e6b3bb597 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:24.287333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55a514-95b8-4892-8d6a-f72e6b3bb597 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:24.287601 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad55a514-95b8-4892-8d6a-f72e6b3bb597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:24.313050 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-ad55a514-95b8-4892-8d6a-f72e6b3bb597 None None] MFA Rules not processed for user `6fe4f32209784a39a8b451f8fcf23395`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:15:24.314289 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-ad55a514-95b8-4892-8d6a-f72e6b3bb597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:15:24.376012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1326/2669] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:15:24 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:15:24.380404 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2968a83-6dbc-4a6c-ad89-3d618fd09c4f admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:24.438780 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2968a83-6dbc-4a6c-ad89-3d618fd09c4f admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:24.443355 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15206f94-6249-4b5f-82cf-b326b1147d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:24.444013 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15206f94-6249-4b5f-82cf-b326b1147d87 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:24.444293 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15206f94-6249-4b5f-82cf-b326b1147d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:24.444569 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15206f94-6249-4b5f-82cf-b326b1147d87 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:24.445259 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15206f94-6249-4b5f-82cf-b326b1147d87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:24.447544 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15206f94-6249-4b5f-82cf-b326b1147d87 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:24.473455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1344/2670] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:15:24 2021] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:15:24.477337 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55a514-95b8-4892-8d6a-f72e6b3bb597 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:24.488644 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad55a514-95b8-4892-8d6a-f72e6b3bb597 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:24.541802 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33e660-61c2-4b84-8d18-51f46c466425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:24.542491 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33e660-61c2-4b84-8d18-51f46c466425 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:24.542766 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33e660-61c2-4b84-8d18-51f46c466425 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:24.543042 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a33e660-61c2-4b84-8d18-51f46c466425 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:24.543812 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33e660-61c2-4b84-8d18-51f46c466425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:24.545713 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a33e660-61c2-4b84-8d18-51f46c466425 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:24.564820 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1327/2671] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:15:24 2021] POST /identity/v3/users => generated 299 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:15:24.568834 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15206f94-6249-4b5f-82cf-b326b1147d87 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:24.579290 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15206f94-6249-4b5f-82cf-b326b1147d87 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:24.583841 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42717f19-5be2-4f96-a1fa-5ffea866f4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:24.584497 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42717f19-5be2-4f96-a1fa-5ffea866f4cb admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:24.584780 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42717f19-5be2-4f96-a1fa-5ffea866f4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:24.585053 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42717f19-5be2-4f96-a1fa-5ffea866f4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:24.585786 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42717f19-5be2-4f96-a1fa-5ffea866f4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:24.587416 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42717f19-5be2-4f96-a1fa-5ffea866f4cb admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:24.598677 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1345/2672] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:15:24 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:15:24.602625 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33e660-61c2-4b84-8d18-51f46c466425 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:24.612913 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a33e660-61c2-4b84-8d18-51f46c466425 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:24.617784 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adc980-3cc0-4b32-81ff-8d4f0d6df790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:24.618675 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adc980-3cc0-4b32-81ff-8d4f0d6df790 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:24.618960 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adc980-3cc0-4b32-81ff-8d4f0d6df790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:24.619235 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adc980-3cc0-4b32-81ff-8d4f0d6df790 admin admin] PATH_INFO: `/v3/projects/364ab4b4ccb044669f28f9cfded640b9/users/e39e3f2a7af64a6996f06a556568a6d8/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:24.633860 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adc980-3cc0-4b32-81ff-8d4f0d6df790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=364ab4b4ccb044669f28f9cfded640b9, user_id=e39e3f2a7af64a6996f06a556568a6d8, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:24.636533 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adc980-3cc0-4b32-81ff-8d4f0d6df790 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:24.649935 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1328/2673] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:15:24 2021] PUT /identity/v3/projects/364ab4b4ccb044669f28f9cfded640b9/users/e39e3f2a7af64a6996f06a556568a6d8/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:15:24.653768 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42717f19-5be2-4f96-a1fa-5ffea866f4cb admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:24.663813 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42717f19-5be2-4f96-a1fa-5ffea866f4cb admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:24.718179 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f022eb-29a2-47f5-a1ce-954c511f3286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:24.718854 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f022eb-29a2-47f5-a1ce-954c511f3286 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:24.719133 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f022eb-29a2-47f5-a1ce-954c511f3286 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:24.719409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f022eb-29a2-47f5-a1ce-954c511f3286 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:24.720147 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f022eb-29a2-47f5-a1ce-954c511f3286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:24.721828 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f022eb-29a2-47f5-a1ce-954c511f3286 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:24.734918 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1346/2674] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:15:24 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:15:24.736091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adc980-3cc0-4b32-81ff-8d4f0d6df790 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:24.746311 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adc980-3cc0-4b32-81ff-8d4f0d6df790 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:24.751532 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301e933-a88b-42b9-878d-15f31ab3bdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:24.752399 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301e933-a88b-42b9-878d-15f31ab3bdfe admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:24.752688 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301e933-a88b-42b9-878d-15f31ab3bdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:24.753156 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4301e933-a88b-42b9-878d-15f31ab3bdfe admin admin] PATH_INFO: `/v3/projects/364ab4b4ccb044669f28f9cfded640b9/users/e39e3f2a7af64a6996f06a556568a6d8/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:24.755696 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301e933-a88b-42b9-878d-15f31ab3bdfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=364ab4b4ccb044669f28f9cfded640b9, user_id=e39e3f2a7af64a6996f06a556568a6d8, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:24.758325 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4301e933-a88b-42b9-878d-15f31ab3bdfe admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:24.772286 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1329/2675] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:15:24 2021] PUT /identity/v3/projects/364ab4b4ccb044669f28f9cfded640b9/users/e39e3f2a7af64a6996f06a556568a6d8/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 17:15:24.783197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54dcdb-379e-4ec7-beb7-a5f903675954 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:24.783619 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54dcdb-379e-4ec7-beb7-a5f903675954 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:24.783901 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54dcdb-379e-4ec7-beb7-a5f903675954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:24.810355 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-ef54dcdb-379e-4ec7-beb7-a5f903675954 None None] MFA Rules not processed for user `e39e3f2a7af64a6996f06a556568a6d8`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:15:24.811563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ef54dcdb-379e-4ec7-beb7-a5f903675954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:15:24.877346 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1347/2676] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:15:24 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:15:24.887015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301e933-a88b-42b9-878d-15f31ab3bdfe admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:24.888703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-4301e933-a88b-42b9-878d-15f31ab3bdfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:15:24.944037 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4301e933-a88b-42b9-878d-15f31ab3bdfe admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:24.947820 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04bad0-2008-4f2c-9cae-5b80db2830ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:24.948476 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04bad0-2008-4f2c-9cae-5b80db2830ca service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:24.948755 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04bad0-2008-4f2c-9cae-5b80db2830ca service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:24.949028 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04bad0-2008-4f2c-9cae-5b80db2830ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:25.003026 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04bad0-2008-4f2c-9cae-5b80db2830ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:25.004430 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04bad0-2008-4f2c-9cae-5b80db2830ca service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:25.012965 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1330/2677] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:15:24 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:15:31.914737 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54dcdb-379e-4ec7-beb7-a5f903675954 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:15:31.916101 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-ef54dcdb-379e-4ec7-beb7-a5f903675954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:15:31.982246 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54dcdb-379e-4ec7-beb7-a5f903675954 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:15:31.987573 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e0992-5b19-4898-9346-b549578d6546 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:15:31.988220 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e0992-5b19-4898-9346-b549578d6546 service placement] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:15:31.988505 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e0992-5b19-4898-9346-b549578d6546 service placement] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:15:31.988777 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e0992-5b19-4898-9346-b549578d6546 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:15:31.990579 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-636e0992-5b19-4898-9346-b549578d6546 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:15:32.002211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e0992-5b19-4898-9346-b549578d6546 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:15:32.003787 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e0992-5b19-4898-9346-b549578d6546 service placement] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:15:32.013736 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1348/2678] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:15:31 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:18:05.164600 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e29706-a376-44e2-8f19-9b468613bd54 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:05.165338 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e29706-a376-44e2-8f19-9b468613bd54 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:05.165338 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e29706-a376-44e2-8f19-9b468613bd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:05.172466 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da6d65-e5c1-4106-a28e-a7a6a39ebcfd None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:05.172919 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da6d65-e5c1-4106-a28e-a7a6a39ebcfd None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:05.173030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da6d65-e5c1-4106-a28e-a7a6a39ebcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:05.216007 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-94e29706-a376-44e2-8f19-9b468613bd54 None None] MFA Rules not processed for user `e27a0c9ae2bf40caa92e9dbceff8d68b`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:18:05.216993 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-40da6d65-e5c1-4106-a28e-a7a6a39ebcfd None None] MFA Rules not processed for user `e27a0c9ae2bf40caa92e9dbceff8d68b`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:18:05.217283 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-94e29706-a376-44e2-8f19-9b468613bd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:05.218195 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-40da6d65-e5c1-4106-a28e-a7a6a39ebcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:05.289075 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1349/2679] 10.222.0.41 () {58 vars in 1059 bytes} [Fri Oct 29 17:18:05 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:18:05.290068 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1331/2680] 10.222.0.41 () {58 vars in 1059 bytes} [Fri Oct 29 17:18:05 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:18:05.295892 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da6d65-e5c1-4106-a28e-a7a6a39ebcfd None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:05.297398 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e29706-a376-44e2-8f19-9b468613bd54 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:05.303888 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da6d65-e5c1-4106-a28e-a7a6a39ebcfd None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:05.305091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e29706-a376-44e2-8f19-9b468613bd54 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:05.307759 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fdfef-d26a-4c41-ad3f-17c4220ce84f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27a0c9ae2bf40caa92e9dbceff8d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:05.308497 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fdfef-d26a-4c41-ad3f-17c4220ce84f service glance] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:05.308738 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6aba1-39db-4b5f-a8fe-b25b724b5d0b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27a0c9ae2bf40caa92e9dbceff8d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:05.308877 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fdfef-d26a-4c41-ad3f-17c4220ce84f service glance] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:05.309193 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fdfef-d26a-4c41-ad3f-17c4220ce84f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:05.309352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6aba1-39db-4b5f-a8fe-b25b724b5d0b service glance] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:05.309635 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6aba1-39db-4b5f-a8fe-b25b724b5d0b service glance] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:05.309909 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba6aba1-39db-4b5f-a8fe-b25b724b5d0b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:05.311279 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-679fdfef-d26a-4c41-ad3f-17c4220ce84f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:05.311683 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8ba6aba1-39db-4b5f-a8fe-b25b724b5d0b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:05.324099 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-8ba6aba1-39db-4b5f-a8fe-b25b724b5d0b service glance] Could not find project: 62ff1389dc744db48b4db05f2c82eb63.: keystone.exception.ProjectNotFound: Could not find project: 62ff1389dc744db48b4db05f2c82eb63. Oct 29 17:18:05.325593 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1332/2681] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:18:05 2021] GET /identity/v3/auth/tokens => generated 113 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 29 17:18:05.326038 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: WARNING keystone.server.flask.application [None req-679fdfef-d26a-4c41-ad3f-17c4220ce84f service glance] Could not find project: 3e527ec7466240de936dcb59eb9328a6.: keystone.exception.ProjectNotFound: Could not find project: 3e527ec7466240de936dcb59eb9328a6. Oct 29 17:18:05.327406 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1350/2682] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:18:05 2021] GET /identity/v3/auth/tokens => generated 113 bytes in 32 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 17:18:05.358089 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6aba1-39db-4b5f-a8fe-b25b724b5d0b service glance] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:05.366797 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba6aba1-39db-4b5f-a8fe-b25b724b5d0b service glance] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:05.370533 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05e0e18-a469-4e40-b497-5f8303e02198 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27a0c9ae2bf40caa92e9dbceff8d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:05.371160 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e0e18-a469-4e40-b497-5f8303e02198 service glance] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:05.371436 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e0e18-a469-4e40-b497-5f8303e02198 service glance] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:05.371720 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05e0e18-a469-4e40-b497-5f8303e02198 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:05.373499 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-c05e0e18-a469-4e40-b497-5f8303e02198 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:05.385454 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: WARNING keystone.server.flask.application [None req-c05e0e18-a469-4e40-b497-5f8303e02198 service glance] Could not find project: 4f05eceedaf647bda6d8b8b071be0b44.: keystone.exception.ProjectNotFound: Could not find project: 4f05eceedaf647bda6d8b8b071be0b44. Oct 29 17:18:05.386854 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1333/2683] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:18:05 2021] GET /identity/v3/auth/tokens => generated 113 bytes in 29 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 29 17:18:10.056004 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fdfef-d26a-4c41-ad3f-17c4220ce84f service glance] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:10.065710 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fdfef-d26a-4c41-ad3f-17c4220ce84f service glance] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:10.069418 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b28d6-eeaf-4969-8fc8-de1e77917667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:10.070086 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b28d6-eeaf-4969-8fc8-de1e77917667 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:10.070370 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b28d6-eeaf-4969-8fc8-de1e77917667 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:10.070643 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b28d6-eeaf-4969-8fc8-de1e77917667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:10.100432 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b28d6-eeaf-4969-8fc8-de1e77917667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:10.101870 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b28d6-eeaf-4969-8fc8-de1e77917667 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:10.112472 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1351/2684] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:18:10 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:18:10.609475 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650fe8b-d7b0-409f-9d0e-7c292ff12a60 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:10.609949 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650fe8b-d7b0-409f-9d0e-7c292ff12a60 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:10.610049 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650fe8b-d7b0-409f-9d0e-7c292ff12a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:10.627821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-1650fe8b-d7b0-409f-9d0e-7c292ff12a60 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:18:10.628985 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1650fe8b-d7b0-409f-9d0e-7c292ff12a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:10.684703 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1334/2685] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:18:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:18:10.696037 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b28d6-eeaf-4969-8fc8-de1e77917667 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:10.697444 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-cb8b28d6-eeaf-4969-8fc8-de1e77917667 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:10.751221 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b28d6-eeaf-4969-8fc8-de1e77917667 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:10.755002 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17b2de-2a8a-46c9-a78a-4431c874268a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:10.755681 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17b2de-2a8a-46c9-a78a-4431c874268a service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:10.756017 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17b2de-2a8a-46c9-a78a-4431c874268a service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:10.756256 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d17b2de-2a8a-46c9-a78a-4431c874268a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:10.765547 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17b2de-2a8a-46c9-a78a-4431c874268a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:10.767058 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d17b2de-2a8a-46c9-a78a-4431c874268a service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:10.777400 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1352/2686] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:18:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:18:14.120781 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4a633-87b4-4208-b2de-f004f3d7eb78 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:14.121286 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4a633-87b4-4208-b2de-f004f3d7eb78 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:14.121690 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d4a633-87b4-4208-b2de-f004f3d7eb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:14.142018 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-46d4a633-87b4-4208-b2de-f004f3d7eb78 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:18:14.143246 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-46d4a633-87b4-4208-b2de-f004f3d7eb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:14.152351 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1335/2687] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:18:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:18:14.156630 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17b2de-2a8a-46c9-a78a-4431c874268a service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:14.167568 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d17b2de-2a8a-46c9-a78a-4431c874268a service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:14.172162 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845c738-f9d7-4817-8fd5-1998bed2559e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:14.173009 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845c738-f9d7-4817-8fd5-1998bed2559e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:14.173285 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845c738-f9d7-4817-8fd5-1998bed2559e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:14.173554 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845c738-f9d7-4817-8fd5-1998bed2559e admin admin] PATH_INFO: `/v3/users/33143e95face4c81af346e9ca6991ae1` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:14.175448 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845c738-f9d7-4817-8fd5-1998bed2559e admin admin] RBAC: Authorizing `identity:delete_user(user_id=33143e95face4c81af346e9ca6991ae1)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:14.177673 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4845c738-f9d7-4817-8fd5-1998bed2559e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:14.234218 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4845c738-f9d7-4817-8fd5-1998bed2559e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33143e95face4c81af346e9ca6991ae1'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:14.234791 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4845c738-f9d7-4817-8fd5-1998bed2559e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33143e95face4c81af346e9ca6991ae1'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:14.247438 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4845c738-f9d7-4817-8fd5-1998bed2559e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33143e95face4c81af346e9ca6991ae1'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:14.248058 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4845c738-f9d7-4817-8fd5-1998bed2559e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33143e95face4c81af346e9ca6991ae1'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:14.255409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-4845c738-f9d7-4817-8fd5-1998bed2559e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33143e95face4c81af346e9ca6991ae1'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:14.267461 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1353/2688] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:18:14 2021] DELETE /identity/v3/users/33143e95face4c81af346e9ca6991ae1 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:18:14.436918 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4a633-87b4-4208-b2de-f004f3d7eb78 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:14.447225 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d4a633-87b4-4208-b2de-f004f3d7eb78 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:14.503725 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760bf10-4a94-4850-94bf-2609f55cd2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:14.504489 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760bf10-4a94-4850-94bf-2609f55cd2ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:14.504767 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760bf10-4a94-4850-94bf-2609f55cd2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:14.505042 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760bf10-4a94-4850-94bf-2609f55cd2ae admin admin] PATH_INFO: `/v3/projects/de51f8a7357a4ead9bd0ffa8beae355c` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:14.515080 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760bf10-4a94-4850-94bf-2609f55cd2ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=de51f8a7357a4ead9bd0ffa8beae355c)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:14.516969 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760bf10-4a94-4850-94bf-2609f55cd2ae admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:14.560026 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-5760bf10-4a94-4850-94bf-2609f55cd2ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de51f8a7357a4ead9bd0ffa8beae355c', 'request_id': 'req-5760bf10-4a94-4850-94bf-2609f55cd2ae'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:14.566009 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-5760bf10-4a94-4850-94bf-2609f55cd2ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de51f8a7357a4ead9bd0ffa8beae355c', 'request_id': 'req-5760bf10-4a94-4850-94bf-2609f55cd2ae'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:14.572802 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-5760bf10-4a94-4850-94bf-2609f55cd2ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de51f8a7357a4ead9bd0ffa8beae355c', 'request_id': 'req-5760bf10-4a94-4850-94bf-2609f55cd2ae'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:14.583825 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-5760bf10-4a94-4850-94bf-2609f55cd2ae admin admin] The token cache is being invalidate because project de51f8a7357a4ead9bd0ffa8beae355c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:18:14.584156 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-5760bf10-4a94-4850-94bf-2609f55cd2ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:14.584773 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-5760bf10-4a94-4850-94bf-2609f55cd2ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:14.586310 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1336/2689] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:18:14 2021] DELETE /identity/v3/projects/de51f8a7357a4ead9bd0ffa8beae355c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:18:14.593279 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc4ad4-3c4b-452a-a83c-d97e5ab00957 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:14.593595 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc4ad4-3c4b-452a-a83c-d97e5ab00957 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:14.593878 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc4ad4-3c4b-452a-a83c-d97e5ab00957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:14.612404 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-87bc4ad4-3c4b-452a-a83c-d97e5ab00957 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:18:14.613591 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-87bc4ad4-3c4b-452a-a83c-d97e5ab00957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:14.668743 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1354/2690] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:18:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 17:18:14.676979 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3907e49-6663-45b1-8a67-818daf21e525 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:14.677267 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3907e49-6663-45b1-8a67-818daf21e525 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:14.677547 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3907e49-6663-45b1-8a67-818daf21e525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:14.695898 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-a3907e49-6663-45b1-8a67-818daf21e525 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:18:14.697104 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a3907e49-6663-45b1-8a67-818daf21e525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:14.705203 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1337/2691] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:18:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:18:14.709492 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc4ad4-3c4b-452a-a83c-d97e5ab00957 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:14.719305 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc4ad4-3c4b-452a-a83c-d97e5ab00957 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:14.724377 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea673145-520e-432f-9ee8-9003ccbe2fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:14.725050 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea673145-520e-432f-9ee8-9003ccbe2fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:14.725400 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea673145-520e-432f-9ee8-9003ccbe2fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:14.725678 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea673145-520e-432f-9ee8-9003ccbe2fa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:14.726462 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea673145-520e-432f-9ee8-9003ccbe2fa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 17:18:14.726769 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea673145-520e-432f-9ee8-9003ccbe2fa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:14.728405 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea673145-520e-432f-9ee8-9003ccbe2fa0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:14.740756 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1355/2692] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 17:18:14 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 17:18:14.745012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3907e49-6663-45b1-8a67-818daf21e525 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:14.754933 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3907e49-6663-45b1-8a67-818daf21e525 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:14.759806 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3985d-4a7d-4ad6-a6b7-39dadfff2fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:14.760435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3985d-4a7d-4ad6-a6b7-39dadfff2fea admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:14.760715 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3985d-4a7d-4ad6-a6b7-39dadfff2fea admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:14.760990 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3985d-4a7d-4ad6-a6b7-39dadfff2fea admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:14.761708 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3985d-4a7d-4ad6-a6b7-39dadfff2fea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:14.763673 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3985d-4a7d-4ad6-a6b7-39dadfff2fea admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:14.798336 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1338/2693] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:18:14 2021] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:18:14.799953 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea673145-520e-432f-9ee8-9003ccbe2fa0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:14.810390 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea673145-520e-432f-9ee8-9003ccbe2fa0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:14.864654 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b489d-bbc4-4a6c-a2b8-7e82556c20f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:14.865314 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b489d-bbc4-4a6c-a2b8-7e82556c20f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:14.865594 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b489d-bbc4-4a6c-a2b8-7e82556c20f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:14.865869 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622b489d-bbc4-4a6c-a2b8-7e82556c20f5 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:14.866592 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b489d-bbc4-4a6c-a2b8-7e82556c20f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:14.868493 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622b489d-bbc4-4a6c-a2b8-7e82556c20f5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:14.891327 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1356/2694] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:18:14 2021] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:18:14.896029 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3985d-4a7d-4ad6-a6b7-39dadfff2fea admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:14.906818 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3985d-4a7d-4ad6-a6b7-39dadfff2fea admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:14.914609 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c130e9c-718d-4a0e-9f94-360a8ff8438f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:14.915672 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c130e9c-718d-4a0e-9f94-360a8ff8438f admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:14.916006 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c130e9c-718d-4a0e-9f94-360a8ff8438f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:14.916490 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c130e9c-718d-4a0e-9f94-360a8ff8438f admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:14.917893 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c130e9c-718d-4a0e-9f94-360a8ff8438f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:14.920468 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c130e9c-718d-4a0e-9f94-360a8ff8438f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:14.932549 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1339/2695] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:18:14 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:18:14.936758 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b489d-bbc4-4a6c-a2b8-7e82556c20f5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:14.947228 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622b489d-bbc4-4a6c-a2b8-7e82556c20f5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:14.952613 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62f5bf-0000-471e-b0de-e1565a77a34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:14.953272 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62f5bf-0000-471e-b0de-e1565a77a34e admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:14.953565 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62f5bf-0000-471e-b0de-e1565a77a34e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:14.953826 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a62f5bf-0000-471e-b0de-e1565a77a34e admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:14.954594 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62f5bf-0000-471e-b0de-e1565a77a34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:14.956195 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a62f5bf-0000-471e-b0de-e1565a77a34e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:14.966244 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1357/2696] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:18:14 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:18:14.970642 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c130e9c-718d-4a0e-9f94-360a8ff8438f admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:14.981349 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c130e9c-718d-4a0e-9f94-360a8ff8438f admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:14.987662 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bada1-033b-4efc-9847-082d598e94b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:14.988542 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bada1-033b-4efc-9847-082d598e94b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:14.988827 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bada1-033b-4efc-9847-082d598e94b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:14.989117 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bada1-033b-4efc-9847-082d598e94b1 admin admin] PATH_INFO: `/v3/projects/647a54c5367d410ba86c7f99da1e8f24/users/4504e665d7a543faa45b9a34cc0f9e5d/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:15.005273 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bada1-033b-4efc-9847-082d598e94b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=647a54c5367d410ba86c7f99da1e8f24, user_id=4504e665d7a543faa45b9a34cc0f9e5d, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:15.008948 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bada1-033b-4efc-9847-082d598e94b1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:15.009112 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62f5bf-0000-471e-b0de-e1565a77a34e admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:15.010928 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-7a62f5bf-0000-471e-b0de-e1565a77a34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:15.024082 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a62f5bf-0000-471e-b0de-e1565a77a34e admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:15.024970 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1340/2697] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:18:14 2021] PUT /identity/v3/projects/647a54c5367d410ba86c7f99da1e8f24/users/4504e665d7a543faa45b9a34cc0f9e5d/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:18:15.035305 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5666d-d8e3-421d-81b6-780174494dbe None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:15.035592 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5666d-d8e3-421d-81b6-780174494dbe None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:15.035869 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f5666d-d8e3-421d-81b6-780174494dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:15.061908 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-51f5666d-d8e3-421d-81b6-780174494dbe None None] MFA Rules not processed for user `4504e665d7a543faa45b9a34cc0f9e5d`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:18:15.063144 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-51f5666d-d8e3-421d-81b6-780174494dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:15.087414 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0da9d35-8c35-4aea-83c0-c8a08e5bd114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:15.088291 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da9d35-8c35-4aea-83c0-c8a08e5bd114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:15.088575 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da9d35-8c35-4aea-83c0-c8a08e5bd114 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:15.088852 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0da9d35-8c35-4aea-83c0-c8a08e5bd114 admin admin] PATH_INFO: `/v3/users/6fe4f32209784a39a8b451f8fcf23395` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:15.090098 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da9d35-8c35-4aea-83c0-c8a08e5bd114 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe4f32209784a39a8b451f8fcf23395)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:15.092079 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0da9d35-8c35-4aea-83c0-c8a08e5bd114 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:15.126985 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1341/2698] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:18:15 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 17:18:15.131491 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5666d-d8e3-421d-81b6-780174494dbe None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:15.137048 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b0da9d35-8c35-4aea-83c0-c8a08e5bd114 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe4f32209784a39a8b451f8fcf23395'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:15.137712 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b0da9d35-8c35-4aea-83c0-c8a08e5bd114 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe4f32209784a39a8b451f8fcf23395'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:15.141753 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f5666d-d8e3-421d-81b6-780174494dbe None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:15.146461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73a16e-a850-477d-a2a9-0408eaec5272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:15.147098 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73a16e-a850-477d-a2a9-0408eaec5272 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:15.147378 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73a16e-a850-477d-a2a9-0408eaec5272 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:15.147652 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73a16e-a850-477d-a2a9-0408eaec5272 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:15.148363 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73a16e-a850-477d-a2a9-0408eaec5272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:15.150290 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73a16e-a850-477d-a2a9-0408eaec5272 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:15.150428 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b0da9d35-8c35-4aea-83c0-c8a08e5bd114 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe4f32209784a39a8b451f8fcf23395'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:15.150983 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b0da9d35-8c35-4aea-83c0-c8a08e5bd114 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe4f32209784a39a8b451f8fcf23395'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:15.159619 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b0da9d35-8c35-4aea-83c0-c8a08e5bd114 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe4f32209784a39a8b451f8fcf23395'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:15.171945 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1358/2699] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:18:15 2021] DELETE /identity/v3/users/6fe4f32209784a39a8b451f8fcf23395 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:18:15.176678 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ab8f8-2e1d-4c5a-9a22-503d5313ed11 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:15.176994 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ab8f8-2e1d-4c5a-9a22-503d5313ed11 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:15.177278 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ab8f8-2e1d-4c5a-9a22-503d5313ed11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:15.178938 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1342/2700] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:18:15 2021] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:18:15.182595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73a16e-a850-477d-a2a9-0408eaec5272 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:15.184320 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-fc73a16e-a850-477d-a2a9-0408eaec5272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:15.197032 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-022ab8f8-2e1d-4c5a-9a22-503d5313ed11 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:18:15.198376 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-022ab8f8-2e1d-4c5a-9a22-503d5313ed11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:15.248460 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73a16e-a850-477d-a2a9-0408eaec5272 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:15.253629 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d12c9-8b9e-4652-a5a8-6895a1eff710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:15.254328 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d12c9-8b9e-4652-a5a8-6895a1eff710 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:15.254608 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d12c9-8b9e-4652-a5a8-6895a1eff710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:15.254876 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d12c9-8b9e-4652-a5a8-6895a1eff710 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:15.255643 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d12c9-8b9e-4652-a5a8-6895a1eff710 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:15.257474 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1359/2701] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:18:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 17:18:15.257605 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424d12c9-8b9e-4652-a5a8-6895a1eff710 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:15.267229 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ab8f8-2e1d-4c5a-9a22-503d5313ed11 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:15.269781 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-022ab8f8-2e1d-4c5a-9a22-503d5313ed11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:15.279426 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1343/2702] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:18:15 2021] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:18:15.283261 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d12c9-8b9e-4652-a5a8-6895a1eff710 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:15.293842 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424d12c9-8b9e-4652-a5a8-6895a1eff710 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:15.299661 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cc51d-dd5e-462e-aa84-d4387f21c15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:15.300723 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cc51d-dd5e-462e-aa84-d4387f21c15e admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:15.301008 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cc51d-dd5e-462e-aa84-d4387f21c15e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:15.301817 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cc51d-dd5e-462e-aa84-d4387f21c15e admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:15.302681 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cc51d-dd5e-462e-aa84-d4387f21c15e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:15.304742 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cc51d-dd5e-462e-aa84-d4387f21c15e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:15.317979 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1344/2703] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:18:15 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 17:18:15.318999 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cc51d-dd5e-462e-aa84-d4387f21c15e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:15.329479 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cc51d-dd5e-462e-aa84-d4387f21c15e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:15.334524 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ab8f8-2e1d-4c5a-9a22-503d5313ed11 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:15.335296 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff82c59-c53c-44c7-98ae-342ff7287449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:15.336185 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff82c59-c53c-44c7-98ae-342ff7287449 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:15.336578 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff82c59-c53c-44c7-98ae-342ff7287449 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:15.336975 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff82c59-c53c-44c7-98ae-342ff7287449 admin admin] PATH_INFO: `/v3/projects/9291eb972f244cf09a5cf52e6f8cee16/users/cb17fbe39a5949ba85250333ed303f34/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:15.338447 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b0d33-c77b-4f0a-be7a-2f186a97de62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:15.339307 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b0d33-c77b-4f0a-be7a-2f186a97de62 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:15.339596 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b0d33-c77b-4f0a-be7a-2f186a97de62 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:15.339871 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b0d33-c77b-4f0a-be7a-2f186a97de62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:15.349662 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b0d33-c77b-4f0a-be7a-2f186a97de62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:15.351163 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b0d33-c77b-4f0a-be7a-2f186a97de62 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:15.355711 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff82c59-c53c-44c7-98ae-342ff7287449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9291eb972f244cf09a5cf52e6f8cee16, user_id=cb17fbe39a5949ba85250333ed303f34, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:15.359469 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff82c59-c53c-44c7-98ae-342ff7287449 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:15.361090 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1360/2704] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:18:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 17:18:15.374240 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1345/2705] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:18:15 2021] PUT /identity/v3/projects/9291eb972f244cf09a5cf52e6f8cee16/users/cb17fbe39a5949ba85250333ed303f34/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 17:18:15.378065 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b0d33-c77b-4f0a-be7a-2f186a97de62 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:15.387681 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b0d33-c77b-4f0a-be7a-2f186a97de62 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:15.445954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839dd898-4086-4e8c-9444-87a168307686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:15.446614 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839dd898-4086-4e8c-9444-87a168307686 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:15.446900 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839dd898-4086-4e8c-9444-87a168307686 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:15.447179 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839dd898-4086-4e8c-9444-87a168307686 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:15.447918 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839dd898-4086-4e8c-9444-87a168307686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:15.449524 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839dd898-4086-4e8c-9444-87a168307686 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:15.460965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1361/2706] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:18:15 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:18:15.465076 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff82c59-c53c-44c7-98ae-342ff7287449 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:15.476165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff82c59-c53c-44c7-98ae-342ff7287449 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:15.480927 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1ca57-e704-4897-8e21-31640dfb84f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:15.481803 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1ca57-e704-4897-8e21-31640dfb84f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:15.482123 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1ca57-e704-4897-8e21-31640dfb84f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:15.482404 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1ca57-e704-4897-8e21-31640dfb84f9 admin admin] PATH_INFO: `/v3/projects/9291eb972f244cf09a5cf52e6f8cee16/users/cb17fbe39a5949ba85250333ed303f34/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:15.484442 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1ca57-e704-4897-8e21-31640dfb84f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9291eb972f244cf09a5cf52e6f8cee16, user_id=cb17fbe39a5949ba85250333ed303f34, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:15.487377 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1ca57-e704-4897-8e21-31640dfb84f9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:15.498149 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1346/2707] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:18:15 2021] PUT /identity/v3/projects/9291eb972f244cf09a5cf52e6f8cee16/users/cb17fbe39a5949ba85250333ed303f34/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 17:18:15.510042 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb3e8c-1d3e-45e8-9ab9-a0cda9be77e4 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:15.510597 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb3e8c-1d3e-45e8-9ab9-a0cda9be77e4 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:15.511085 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb3e8c-1d3e-45e8-9ab9-a0cda9be77e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:15.543003 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-f8fb3e8c-1d3e-45e8-9ab9-a0cda9be77e4 None None] MFA Rules not processed for user `cb17fbe39a5949ba85250333ed303f34`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:18:15.544226 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f8fb3e8c-1d3e-45e8-9ab9-a0cda9be77e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:15.610957 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1362/2708] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:18:15 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:18:15.621872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1ca57-e704-4897-8e21-31640dfb84f9 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:15.623647 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-85e1ca57-e704-4897-8e21-31640dfb84f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:15.634482 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb3e8c-1d3e-45e8-9ab9-a0cda9be77e4 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:15.636491 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f8fb3e8c-1d3e-45e8-9ab9-a0cda9be77e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:15.691945 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1ca57-e704-4897-8e21-31640dfb84f9 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:15.695706 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a61ecd-6a41-427b-836e-5d8edd8bbfe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:15.696474 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a61ecd-6a41-427b-836e-5d8edd8bbfe4 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:15.696825 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a61ecd-6a41-427b-836e-5d8edd8bbfe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:15.697175 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a61ecd-6a41-427b-836e-5d8edd8bbfe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:15.701564 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb3e8c-1d3e-45e8-9ab9-a0cda9be77e4 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:15.706289 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb0aa5-fec9-4474-8b64-ae1d9337b363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:15.706847 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a61ecd-6a41-427b-836e-5d8edd8bbfe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:15.707192 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb0aa5-fec9-4474-8b64-ae1d9337b363 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:15.707476 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb0aa5-fec9-4474-8b64-ae1d9337b363 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:15.707753 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb0aa5-fec9-4474-8b64-ae1d9337b363 admin admin] PATH_INFO: `/v3/projects/6da3f28f00664da28169cb7606237c93` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:15.708298 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a61ecd-6a41-427b-836e-5d8edd8bbfe4 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:15.708951 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb0aa5-fec9-4474-8b64-ae1d9337b363 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da3f28f00664da28169cb7606237c93)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:15.710884 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb0aa5-fec9-4474-8b64-ae1d9337b363 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:15.717901 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1347/2709] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:18:15 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:18:15.759680 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-3dcb0aa5-fec9-4474-8b64-ae1d9337b363 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da3f28f00664da28169cb7606237c93', 'request_id': 'req-3dcb0aa5-fec9-4474-8b64-ae1d9337b363'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:15.765244 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-3dcb0aa5-fec9-4474-8b64-ae1d9337b363 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da3f28f00664da28169cb7606237c93', 'request_id': 'req-3dcb0aa5-fec9-4474-8b64-ae1d9337b363'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:15.774061 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-3dcb0aa5-fec9-4474-8b64-ae1d9337b363 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da3f28f00664da28169cb7606237c93', 'request_id': 'req-3dcb0aa5-fec9-4474-8b64-ae1d9337b363'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:15.788088 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-3dcb0aa5-fec9-4474-8b64-ae1d9337b363 admin admin] The token cache is being invalidate because project 6da3f28f00664da28169cb7606237c93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:18:15.788381 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-3dcb0aa5-fec9-4474-8b64-ae1d9337b363 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:15.789337 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-3dcb0aa5-fec9-4474-8b64-ae1d9337b363 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:15.789995 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a61ecd-6a41-427b-836e-5d8edd8bbfe4 service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:15.790821 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1363/2710] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:18:15 2021] DELETE /identity/v3/projects/6da3f28f00664da28169cb7606237c93 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:18:15.794416 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb0aa5-fec9-4474-8b64-ae1d9337b363 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:15.795743 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-3dcb0aa5-fec9-4474-8b64-ae1d9337b363 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:15.801896 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a61ecd-6a41-427b-836e-5d8edd8bbfe4 service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:15.855406 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bcdf9-6ad6-4e60-871b-d5111346b9fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:15.856052 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bcdf9-6ad6-4e60-871b-d5111346b9fd service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:15.856329 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bcdf9-6ad6-4e60-871b-d5111346b9fd service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:15.856603 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8bcdf9-6ad6-4e60-871b-d5111346b9fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:15.858465 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-0f8bcdf9-6ad6-4e60-871b-d5111346b9fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:15.862092 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb0aa5-fec9-4474-8b64-ae1d9337b363 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:15.867724 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2386bb3-1f90-4057-b109-d39db34e6944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:15.868598 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2386bb3-1f90-4057-b109-d39db34e6944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:15.868882 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2386bb3-1f90-4057-b109-d39db34e6944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:15.869159 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2386bb3-1f90-4057-b109-d39db34e6944 admin admin] PATH_INFO: `/v3/users/e39e3f2a7af64a6996f06a556568a6d8` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:15.870427 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2386bb3-1f90-4057-b109-d39db34e6944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e39e3f2a7af64a6996f06a556568a6d8)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:15.872355 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2386bb3-1f90-4057-b109-d39db34e6944 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:15.924448 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d2386bb3-1f90-4057-b109-d39db34e6944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e39e3f2a7af64a6996f06a556568a6d8'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:15.925359 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d2386bb3-1f90-4057-b109-d39db34e6944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e39e3f2a7af64a6996f06a556568a6d8'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:15.927754 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8bcdf9-6ad6-4e60-871b-d5111346b9fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:15.929518 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8bcdf9-6ad6-4e60-871b-d5111346b9fd service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:15.938841 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d2386bb3-1f90-4057-b109-d39db34e6944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e39e3f2a7af64a6996f06a556568a6d8'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:15.939569 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d2386bb3-1f90-4057-b109-d39db34e6944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e39e3f2a7af64a6996f06a556568a6d8'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:15.941000 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1348/2711] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:18:15 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 17:18:15.947040 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-d2386bb3-1f90-4057-b109-d39db34e6944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e39e3f2a7af64a6996f06a556568a6d8'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:15.959136 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1364/2712] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:18:15 2021] DELETE /identity/v3/users/e39e3f2a7af64a6996f06a556568a6d8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 17:18:16.231713 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bcdf9-6ad6-4e60-871b-d5111346b9fd service cinder] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:16.242735 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8bcdf9-6ad6-4e60-871b-d5111346b9fd service cinder] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:16.300556 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ce111-a2af-4050-b404-3227c5882dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:16.301321 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ce111-a2af-4050-b404-3227c5882dc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:16.301600 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ce111-a2af-4050-b404-3227c5882dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:16.301875 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ce111-a2af-4050-b404-3227c5882dc5 admin admin] PATH_INFO: `/v3/projects/364ab4b4ccb044669f28f9cfded640b9` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:16.303072 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ce111-a2af-4050-b404-3227c5882dc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=364ab4b4ccb044669f28f9cfded640b9)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:16.304953 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ce111-a2af-4050-b404-3227c5882dc5 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:16.348537 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-240ce111-a2af-4050-b404-3227c5882dc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '364ab4b4ccb044669f28f9cfded640b9', 'request_id': 'req-240ce111-a2af-4050-b404-3227c5882dc5'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:16.353676 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-240ce111-a2af-4050-b404-3227c5882dc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '364ab4b4ccb044669f28f9cfded640b9', 'request_id': 'req-240ce111-a2af-4050-b404-3227c5882dc5'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:16.361464 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-240ce111-a2af-4050-b404-3227c5882dc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '364ab4b4ccb044669f28f9cfded640b9', 'request_id': 'req-240ce111-a2af-4050-b404-3227c5882dc5'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:16.371953 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-240ce111-a2af-4050-b404-3227c5882dc5 admin admin] The token cache is being invalidate because project 364ab4b4ccb044669f28f9cfded640b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:18:16.372263 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-240ce111-a2af-4050-b404-3227c5882dc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:16.372884 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-240ce111-a2af-4050-b404-3227c5882dc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:16.374447 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1349/2713] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:18:16 2021] DELETE /identity/v3/projects/364ab4b4ccb044669f28f9cfded640b9 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:18:16.383439 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbeee9-052b-4496-8392-75c99f6ca367 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:16.383924 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbeee9-052b-4496-8392-75c99f6ca367 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:16.384055 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbeee9-052b-4496-8392-75c99f6ca367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:16.401990 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-a3dbeee9-052b-4496-8392-75c99f6ca367 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:18:16.403191 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a3dbeee9-052b-4496-8392-75c99f6ca367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:16.459557 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1365/2714] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:18:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:18:16.468062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef336572-0886-44c0-a72c-e6e68bc26f49 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:16.468062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef336572-0886-44c0-a72c-e6e68bc26f49 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:16.468062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef336572-0886-44c0-a72c-e6e68bc26f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:16.486418 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-ef336572-0886-44c0-a72c-e6e68bc26f49 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:18:16.487595 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-ef336572-0886-44c0-a72c-e6e68bc26f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:16.495293 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1350/2715] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:18:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:18:16.499326 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbeee9-052b-4496-8392-75c99f6ca367 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:16.509385 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbeee9-052b-4496-8392-75c99f6ca367 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:16.514063 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc795a-6f73-4e85-9412-130b835c38e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:16.514712 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc795a-6f73-4e85-9412-130b835c38e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:16.514998 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc795a-6f73-4e85-9412-130b835c38e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:16.515278 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc795a-6f73-4e85-9412-130b835c38e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:16.516036 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc795a-6f73-4e85-9412-130b835c38e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 17:18:16.516342 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc795a-6f73-4e85-9412-130b835c38e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:16.518580 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc795a-6f73-4e85-9412-130b835c38e2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:16.529982 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1366/2716] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 17:18:16 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 17:18:16.534049 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef336572-0886-44c0-a72c-e6e68bc26f49 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:16.543086 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef336572-0886-44c0-a72c-e6e68bc26f49 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:16.548308 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc551e-73d9-4868-aad2-2be3733a6011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:16.548945 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc551e-73d9-4868-aad2-2be3733a6011 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:16.549229 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc551e-73d9-4868-aad2-2be3733a6011 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:16.549507 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc551e-73d9-4868-aad2-2be3733a6011 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:16.550255 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc551e-73d9-4868-aad2-2be3733a6011 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:16.552207 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc551e-73d9-4868-aad2-2be3733a6011 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:16.576983 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1351/2717] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:18:16 2021] POST /identity/v3/projects => generated 371 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:18:16.581485 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc795a-6f73-4e85-9412-130b835c38e2 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:16.591167 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc795a-6f73-4e85-9412-130b835c38e2 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:16.644217 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3400eae-c7f0-47fc-9d75-a2f2b5922166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:16.644902 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3400eae-c7f0-47fc-9d75-a2f2b5922166 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:16.645184 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3400eae-c7f0-47fc-9d75-a2f2b5922166 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:16.645460 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3400eae-c7f0-47fc-9d75-a2f2b5922166 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:16.646182 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3400eae-c7f0-47fc-9d75-a2f2b5922166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:16.648085 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3400eae-c7f0-47fc-9d75-a2f2b5922166 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:16.666827 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1367/2718] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:18:16 2021] POST /identity/v3/users => generated 286 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:18:16.670874 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc551e-73d9-4868-aad2-2be3733a6011 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:16.680758 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc551e-73d9-4868-aad2-2be3733a6011 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:16.685377 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb34b6f-6548-4f99-9fed-1c7eae80af1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:16.686131 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb34b6f-6548-4f99-9fed-1c7eae80af1c admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:16.686417 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb34b6f-6548-4f99-9fed-1c7eae80af1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:16.686695 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb34b6f-6548-4f99-9fed-1c7eae80af1c admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:16.687439 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb34b6f-6548-4f99-9fed-1c7eae80af1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:16.689016 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb34b6f-6548-4f99-9fed-1c7eae80af1c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:16.699648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1352/2719] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:18:16 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:18:16.703296 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3400eae-c7f0-47fc-9d75-a2f2b5922166 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:16.713352 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3400eae-c7f0-47fc-9d75-a2f2b5922166 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:16.718313 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5678bb-e6b4-4dce-95bf-e314993865a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:16.718956 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5678bb-e6b4-4dce-95bf-e314993865a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:16.719234 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5678bb-e6b4-4dce-95bf-e314993865a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:16.719510 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5678bb-e6b4-4dce-95bf-e314993865a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:16.720228 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5678bb-e6b4-4dce-95bf-e314993865a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:16.721784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5678bb-e6b4-4dce-95bf-e314993865a4 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:16.731317 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1368/2720] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:18:16 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:18:16.735260 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb34b6f-6548-4f99-9fed-1c7eae80af1c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:16.745640 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb34b6f-6548-4f99-9fed-1c7eae80af1c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:16.750450 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f169d-8b63-4a1c-bf60-ac965e13166c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:16.751314 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f169d-8b63-4a1c-bf60-ac965e13166c admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:16.751592 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f169d-8b63-4a1c-bf60-ac965e13166c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:16.752448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f169d-8b63-4a1c-bf60-ac965e13166c admin admin] PATH_INFO: `/v3/projects/80984852745544ab9f057926201c7232/users/725ee718173d47ee88571aca67805ff0/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:16.766940 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f169d-8b63-4a1c-bf60-ac965e13166c admin admin] RBAC: Authorizing `identity:create_grant(project_id=80984852745544ab9f057926201c7232, user_id=725ee718173d47ee88571aca67805ff0, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:16.769630 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f169d-8b63-4a1c-bf60-ac965e13166c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:16.783092 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1353/2721] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:18:16 2021] PUT /identity/v3/projects/80984852745544ab9f057926201c7232/users/725ee718173d47ee88571aca67805ff0/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:18:16.794029 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334b572-f064-4a09-b41a-0e02f1ed2dea None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:16.794320 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334b572-f064-4a09-b41a-0e02f1ed2dea None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:16.794599 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b334b572-f064-4a09-b41a-0e02f1ed2dea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:16.821017 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-b334b572-f064-4a09-b41a-0e02f1ed2dea None None] MFA Rules not processed for user `725ee718173d47ee88571aca67805ff0`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:18:16.822161 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b334b572-f064-4a09-b41a-0e02f1ed2dea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:16.882874 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1369/2722] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:18:16 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:18:16.893143 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f169d-8b63-4a1c-bf60-ac965e13166c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:16.894857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7a7f169d-8b63-4a1c-bf60-ac965e13166c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:16.952414 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f169d-8b63-4a1c-bf60-ac965e13166c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:16.956101 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6baf7-98f1-421c-bdb8-a751eef764ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:16.956744 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6baf7-98f1-421c-bdb8-a751eef764ca service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:16.957026 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6baf7-98f1-421c-bdb8-a751eef764ca service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:16.957302 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6baf7-98f1-421c-bdb8-a751eef764ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:16.965556 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6baf7-98f1-421c-bdb8-a751eef764ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:16.967292 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b6baf7-98f1-421c-bdb8-a751eef764ca service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:16.981503 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1354/2723] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:18:16 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:18:17.008119 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334b572-f064-4a09-b41a-0e02f1ed2dea None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:17.070202 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b334b572-f064-4a09-b41a-0e02f1ed2dea None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:17.074838 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dddb2d-06a1-477b-895a-ee7b165a7673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:17.075699 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dddb2d-06a1-477b-895a-ee7b165a7673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:17.075981 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dddb2d-06a1-477b-895a-ee7b165a7673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:17.076259 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dddb2d-06a1-477b-895a-ee7b165a7673 admin admin] PATH_INFO: `/v3/users/725ee718173d47ee88571aca67805ff0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:17.077471 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dddb2d-06a1-477b-895a-ee7b165a7673 admin admin] RBAC: Authorizing `identity:delete_user(user_id=725ee718173d47ee88571aca67805ff0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:17.079418 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dddb2d-06a1-477b-895a-ee7b165a7673 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:17.127664 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-45dddb2d-06a1-477b-895a-ee7b165a7673 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '725ee718173d47ee88571aca67805ff0'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:17.128513 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-45dddb2d-06a1-477b-895a-ee7b165a7673 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '725ee718173d47ee88571aca67805ff0'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:17.142590 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-45dddb2d-06a1-477b-895a-ee7b165a7673 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '725ee718173d47ee88571aca67805ff0'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:17.143129 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-45dddb2d-06a1-477b-895a-ee7b165a7673 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '725ee718173d47ee88571aca67805ff0'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:17.152356 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-45dddb2d-06a1-477b-895a-ee7b165a7673 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '725ee718173d47ee88571aca67805ff0'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:17.164826 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1370/2724] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:18:17 2021] DELETE /identity/v3/users/725ee718173d47ee88571aca67805ff0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:18:17.169798 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb296cf9-728c-4fff-8566-9d5d31bac1c4 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:17.170130 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb296cf9-728c-4fff-8566-9d5d31bac1c4 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:17.170410 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb296cf9-728c-4fff-8566-9d5d31bac1c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:17.188022 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-eb296cf9-728c-4fff-8566-9d5d31bac1c4 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:18:17.189227 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-eb296cf9-728c-4fff-8566-9d5d31bac1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:17.247619 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1355/2725] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:18:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:18:17.257821 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dddb2d-06a1-477b-895a-ee7b165a7673 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:17.259271 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-45dddb2d-06a1-477b-895a-ee7b165a7673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:17.317012 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dddb2d-06a1-477b-895a-ee7b165a7673 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:17.320759 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c3ace-cdcf-484a-a9d1-9256fb113431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:17.321414 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c3ace-cdcf-484a-a9d1-9256fb113431 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:17.321693 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c3ace-cdcf-484a-a9d1-9256fb113431 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:17.321983 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c3ace-cdcf-484a-a9d1-9256fb113431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:17.333711 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c3ace-cdcf-484a-a9d1-9256fb113431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:17.335195 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c3ace-cdcf-484a-a9d1-9256fb113431 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:17.344816 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1371/2726] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:18:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:18:17.623401 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb296cf9-728c-4fff-8566-9d5d31bac1c4 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:17.624839 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-eb296cf9-728c-4fff-8566-9d5d31bac1c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:17.637048 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb296cf9-728c-4fff-8566-9d5d31bac1c4 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:17.642087 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c63eb-8df6-4e76-8c43-2504566371f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:17.643365 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c63eb-8df6-4e76-8c43-2504566371f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:17.643686 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c63eb-8df6-4e76-8c43-2504566371f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:17.643934 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c63eb-8df6-4e76-8c43-2504566371f3 admin admin] PATH_INFO: `/v3/projects/80984852745544ab9f057926201c7232` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:17.645170 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c63eb-8df6-4e76-8c43-2504566371f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80984852745544ab9f057926201c7232)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:17.647348 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c63eb-8df6-4e76-8c43-2504566371f3 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:17.693048 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0e5c63eb-8df6-4e76-8c43-2504566371f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80984852745544ab9f057926201c7232', 'request_id': 'req-0e5c63eb-8df6-4e76-8c43-2504566371f3'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:17.698296 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0e5c63eb-8df6-4e76-8c43-2504566371f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80984852745544ab9f057926201c7232', 'request_id': 'req-0e5c63eb-8df6-4e76-8c43-2504566371f3'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:17.705707 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0e5c63eb-8df6-4e76-8c43-2504566371f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80984852745544ab9f057926201c7232', 'request_id': 'req-0e5c63eb-8df6-4e76-8c43-2504566371f3'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:17.716428 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0e5c63eb-8df6-4e76-8c43-2504566371f3 admin admin] The token cache is being invalidate because project 80984852745544ab9f057926201c7232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:18:17.716724 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0e5c63eb-8df6-4e76-8c43-2504566371f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:17.717353 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-0e5c63eb-8df6-4e76-8c43-2504566371f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:17.718916 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1356/2727] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:18:17 2021] DELETE /identity/v3/projects/80984852745544ab9f057926201c7232 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:18:26.672322 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b116f-e4ff-4f90-85b4-6a0fcef083b6 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:26.672762 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b116f-e4ff-4f90-85b4-6a0fcef083b6 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:26.672868 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b116f-e4ff-4f90-85b4-6a0fcef083b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:26.689413 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-901b116f-e4ff-4f90-85b4-6a0fcef083b6 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:18:26.690647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-901b116f-e4ff-4f90-85b4-6a0fcef083b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:26.747154 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1372/2728] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:18:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:18:26.756740 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c63eb-8df6-4e76-8c43-2504566371f3 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:26.758137 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-0e5c63eb-8df6-4e76-8c43-2504566371f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:26.812925 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c63eb-8df6-4e76-8c43-2504566371f3 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:26.817037 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4767c33-9ff0-43b6-b7e5-ff57bebd85d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:26.817688 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4767c33-9ff0-43b6-b7e5-ff57bebd85d1 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:26.817973 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4767c33-9ff0-43b6-b7e5-ff57bebd85d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:26.818249 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4767c33-9ff0-43b6-b7e5-ff57bebd85d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:26.826904 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4767c33-9ff0-43b6-b7e5-ff57bebd85d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:26.828315 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4767c33-9ff0-43b6-b7e5-ff57bebd85d1 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:26.838868 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1357/2729] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:18:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:18:27.339989 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc3c22-fe35-4548-9cb3-2878d7749587 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:27.340279 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc3c22-fe35-4548-9cb3-2878d7749587 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:27.340557 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cc3c22-fe35-4548-9cb3-2878d7749587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:27.358458 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-12cc3c22-fe35-4548-9cb3-2878d7749587 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:18:27.359730 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-12cc3c22-fe35-4548-9cb3-2878d7749587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:27.368272 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1373/2730] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:18:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:18:27.372414 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4767c33-9ff0-43b6-b7e5-ff57bebd85d1 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:27.382616 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4767c33-9ff0-43b6-b7e5-ff57bebd85d1 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:27.387403 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd40755a-6e30-4c50-8685-d5bceb478520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:27.388249 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40755a-6e30-4c50-8685-d5bceb478520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:27.388532 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40755a-6e30-4c50-8685-d5bceb478520 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:27.388810 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd40755a-6e30-4c50-8685-d5bceb478520 admin admin] PATH_INFO: `/v3/users/8719b276102043fda5c941da84654009` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:27.390035 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40755a-6e30-4c50-8685-d5bceb478520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8719b276102043fda5c941da84654009)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:27.391953 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd40755a-6e30-4c50-8685-d5bceb478520 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:27.436286 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-fd40755a-6e30-4c50-8685-d5bceb478520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8719b276102043fda5c941da84654009'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:27.444536 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-fd40755a-6e30-4c50-8685-d5bceb478520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8719b276102043fda5c941da84654009'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:27.452452 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-fd40755a-6e30-4c50-8685-d5bceb478520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8719b276102043fda5c941da84654009'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:27.453032 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-fd40755a-6e30-4c50-8685-d5bceb478520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8719b276102043fda5c941da84654009'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:27.464575 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-fd40755a-6e30-4c50-8685-d5bceb478520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8719b276102043fda5c941da84654009'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:27.470619 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1358/2731] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:18:27 2021] DELETE /identity/v3/users/8719b276102043fda5c941da84654009 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:18:27.645152 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc3c22-fe35-4548-9cb3-2878d7749587 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:27.650306 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cc3c22-fe35-4548-9cb3-2878d7749587 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:27.705401 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae134182-11bd-4b14-9042-bd5db43b4a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:27.706209 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae134182-11bd-4b14-9042-bd5db43b4a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:27.706494 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae134182-11bd-4b14-9042-bd5db43b4a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:27.706795 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae134182-11bd-4b14-9042-bd5db43b4a59 admin admin] PATH_INFO: `/v3/projects/46d63e53a20045f28167ee1dc6b383e3` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:27.716688 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae134182-11bd-4b14-9042-bd5db43b4a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46d63e53a20045f28167ee1dc6b383e3)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:27.718647 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae134182-11bd-4b14-9042-bd5db43b4a59 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:27.762771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ae134182-11bd-4b14-9042-bd5db43b4a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46d63e53a20045f28167ee1dc6b383e3', 'request_id': 'req-ae134182-11bd-4b14-9042-bd5db43b4a59'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:27.767954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ae134182-11bd-4b14-9042-bd5db43b4a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46d63e53a20045f28167ee1dc6b383e3', 'request_id': 'req-ae134182-11bd-4b14-9042-bd5db43b4a59'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:27.775683 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ae134182-11bd-4b14-9042-bd5db43b4a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46d63e53a20045f28167ee1dc6b383e3', 'request_id': 'req-ae134182-11bd-4b14-9042-bd5db43b4a59'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:27.787823 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ae134182-11bd-4b14-9042-bd5db43b4a59 admin admin] The token cache is being invalidate because project 46d63e53a20045f28167ee1dc6b383e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:18:27.788109 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ae134182-11bd-4b14-9042-bd5db43b4a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:27.788737 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-ae134182-11bd-4b14-9042-bd5db43b4a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:27.790321 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1374/2732] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:18:27 2021] DELETE /identity/v3/projects/46d63e53a20045f28167ee1dc6b383e3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:18:27.795896 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a85db4-16d5-4ce5-88f8-e30f4155ed42 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:27.796344 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a85db4-16d5-4ce5-88f8-e30f4155ed42 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:27.796471 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a85db4-16d5-4ce5-88f8-e30f4155ed42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:27.814655 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-32a85db4-16d5-4ce5-88f8-e30f4155ed42 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:18:27.815860 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-32a85db4-16d5-4ce5-88f8-e30f4155ed42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:27.875165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1359/2733] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:18:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:18:27.883091 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0bb14-1f16-45f6-8cd6-12005b5fbda5 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:27.883381 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0bb14-1f16-45f6-8cd6-12005b5fbda5 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:27.883660 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0bb14-1f16-45f6-8cd6-12005b5fbda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:27.900964 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-20b0bb14-1f16-45f6-8cd6-12005b5fbda5 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:18:27.902177 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-20b0bb14-1f16-45f6-8cd6-12005b5fbda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:27.910430 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1375/2734] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:18:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:18:27.914483 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a85db4-16d5-4ce5-88f8-e30f4155ed42 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:27.923871 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a85db4-16d5-4ce5-88f8-e30f4155ed42 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:27.929124 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a9864-8ca6-44cb-b884-e95838afc336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:27.929763 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a9864-8ca6-44cb-b884-e95838afc336 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:27.930077 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a9864-8ca6-44cb-b884-e95838afc336 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:27.930356 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a9864-8ca6-44cb-b884-e95838afc336 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:27.931090 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a9864-8ca6-44cb-b884-e95838afc336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 17:18:27.931411 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a9864-8ca6-44cb-b884-e95838afc336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:27.932992 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a9864-8ca6-44cb-b884-e95838afc336 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:27.944222 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1360/2735] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 17:18:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 17:18:27.948360 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0bb14-1f16-45f6-8cd6-12005b5fbda5 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:27.957784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0bb14-1f16-45f6-8cd6-12005b5fbda5 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:27.962357 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9522c69-9abc-466b-82c6-3c74baf4efc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:27.962993 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9522c69-9abc-466b-82c6-3c74baf4efc9 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:27.963273 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9522c69-9abc-466b-82c6-3c74baf4efc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:27.963545 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9522c69-9abc-466b-82c6-3c74baf4efc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:27.964245 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9522c69-9abc-466b-82c6-3c74baf4efc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:27.966145 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9522c69-9abc-466b-82c6-3c74baf4efc9 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:27.992545 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1376/2736] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:18:27 2021] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:18:27.996639 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a9864-8ca6-44cb-b884-e95838afc336 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:28.006610 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a9864-8ca6-44cb-b884-e95838afc336 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:28.060772 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035901f3-6379-407d-84d0-73b7cbfbc87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:28.061428 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035901f3-6379-407d-84d0-73b7cbfbc87f admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:28.061713 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035901f3-6379-407d-84d0-73b7cbfbc87f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:28.062049 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035901f3-6379-407d-84d0-73b7cbfbc87f admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:28.062763 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035901f3-6379-407d-84d0-73b7cbfbc87f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:28.064666 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035901f3-6379-407d-84d0-73b7cbfbc87f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:28.084656 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1361/2737] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:18:27 2021] POST /identity/v3/users => generated 296 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:18:28.088737 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9522c69-9abc-466b-82c6-3c74baf4efc9 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:28.099337 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9522c69-9abc-466b-82c6-3c74baf4efc9 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:28.103931 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b639b-d04b-4f6f-b15d-0719537dd359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:28.104577 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b639b-d04b-4f6f-b15d-0719537dd359 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:28.104858 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b639b-d04b-4f6f-b15d-0719537dd359 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:28.105136 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21b639b-d04b-4f6f-b15d-0719537dd359 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:28.105866 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b639b-d04b-4f6f-b15d-0719537dd359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:28.107535 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21b639b-d04b-4f6f-b15d-0719537dd359 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:28.117314 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1377/2738] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:18:28 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:18:28.121232 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035901f3-6379-407d-84d0-73b7cbfbc87f admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:28.130932 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035901f3-6379-407d-84d0-73b7cbfbc87f admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:28.135551 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b1a4a6-63c8-45f8-b0d8-0bb131dbcb8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:28.136201 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1a4a6-63c8-45f8-b0d8-0bb131dbcb8a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:28.136483 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1a4a6-63c8-45f8-b0d8-0bb131dbcb8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:28.136759 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b1a4a6-63c8-45f8-b0d8-0bb131dbcb8a admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:28.137496 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1a4a6-63c8-45f8-b0d8-0bb131dbcb8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:28.139172 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b1a4a6-63c8-45f8-b0d8-0bb131dbcb8a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:28.151897 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1362/2739] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:18:28 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:18:28.156141 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b639b-d04b-4f6f-b15d-0719537dd359 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:28.166619 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21b639b-d04b-4f6f-b15d-0719537dd359 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:28.171239 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704adf7-b63b-4075-a6a0-23fd40e3da1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:28.172100 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704adf7-b63b-4075-a6a0-23fd40e3da1b admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:28.172382 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704adf7-b63b-4075-a6a0-23fd40e3da1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:28.172656 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704adf7-b63b-4075-a6a0-23fd40e3da1b admin admin] PATH_INFO: `/v3/projects/02cbfd66421b4de2af07df76f9ea9ff3/users/45364fb97b524c3c84a584a76fd7dc1f/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:28.187071 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704adf7-b63b-4075-a6a0-23fd40e3da1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=02cbfd66421b4de2af07df76f9ea9ff3, user_id=45364fb97b524c3c84a584a76fd7dc1f, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:28.189719 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704adf7-b63b-4075-a6a0-23fd40e3da1b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:28.202215 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1378/2740] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:18:28 2021] PUT /identity/v3/projects/02cbfd66421b4de2af07df76f9ea9ff3/users/45364fb97b524c3c84a584a76fd7dc1f/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:18:28.213082 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa349d-76da-4179-9849-f6913fb3092b None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:28.213229 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa349d-76da-4179-9849-f6913fb3092b None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:28.213585 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aa349d-76da-4179-9849-f6913fb3092b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:28.239600 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-47aa349d-76da-4179-9849-f6913fb3092b None None] MFA Rules not processed for user `45364fb97b524c3c84a584a76fd7dc1f`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:18:28.240779 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-47aa349d-76da-4179-9849-f6913fb3092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:28.305040 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1363/2741] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:18:28 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:18:28.312258 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704adf7-b63b-4075-a6a0-23fd40e3da1b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:28.313944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4704adf7-b63b-4075-a6a0-23fd40e3da1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:28.370426 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704adf7-b63b-4075-a6a0-23fd40e3da1b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:28.374087 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b68167-7082-4e23-b843-90ff3f91d0a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:28.374741 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b68167-7082-4e23-b843-90ff3f91d0a0 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:28.375027 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b68167-7082-4e23-b843-90ff3f91d0a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:28.375309 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b68167-7082-4e23-b843-90ff3f91d0a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:28.384766 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b68167-7082-4e23-b843-90ff3f91d0a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:28.386237 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b68167-7082-4e23-b843-90ff3f91d0a0 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:28.399461 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1379/2742] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:18:28 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:18:51.568724 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa349d-76da-4179-9849-f6913fb3092b None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:51.628291 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aa349d-76da-4179-9849-f6913fb3092b None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:51.633441 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d283d-f198-4ed7-9ab4-5244f4df0a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:51.634334 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d283d-f198-4ed7-9ab4-5244f4df0a7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:51.634627 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d283d-f198-4ed7-9ab4-5244f4df0a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:51.634951 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d283d-f198-4ed7-9ab4-5244f4df0a7f admin admin] PATH_INFO: `/v3/users/45364fb97b524c3c84a584a76fd7dc1f` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:51.636155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d283d-f198-4ed7-9ab4-5244f4df0a7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=45364fb97b524c3c84a584a76fd7dc1f)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:51.638081 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d283d-f198-4ed7-9ab4-5244f4df0a7f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:51.681851 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-397d283d-f198-4ed7-9ab4-5244f4df0a7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45364fb97b524c3c84a584a76fd7dc1f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:51.688714 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-397d283d-f198-4ed7-9ab4-5244f4df0a7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45364fb97b524c3c84a584a76fd7dc1f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:51.696034 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-397d283d-f198-4ed7-9ab4-5244f4df0a7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45364fb97b524c3c84a584a76fd7dc1f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:51.696655 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-397d283d-f198-4ed7-9ab4-5244f4df0a7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45364fb97b524c3c84a584a76fd7dc1f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:51.707702 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-397d283d-f198-4ed7-9ab4-5244f4df0a7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45364fb97b524c3c84a584a76fd7dc1f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:51.713798 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1364/2743] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:18:51 2021] DELETE /identity/v3/users/45364fb97b524c3c84a584a76fd7dc1f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:18:51.718319 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be213caf-771f-42dd-85ed-d8f616eaa3a8 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:51.718824 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be213caf-771f-42dd-85ed-d8f616eaa3a8 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:51.718931 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be213caf-771f-42dd-85ed-d8f616eaa3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:51.735329 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-be213caf-771f-42dd-85ed-d8f616eaa3a8 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:18:51.736813 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-be213caf-771f-42dd-85ed-d8f616eaa3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:51.793706 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1380/2744] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:18:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 17:18:51.803720 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d283d-f198-4ed7-9ab4-5244f4df0a7f admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:51.805026 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-397d283d-f198-4ed7-9ab4-5244f4df0a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:51.860717 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d283d-f198-4ed7-9ab4-5244f4df0a7f admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:51.864696 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b9cee-4988-4278-8ac6-5996bb8225d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:51.865330 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b9cee-4988-4278-8ac6-5996bb8225d4 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:51.865614 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b9cee-4988-4278-8ac6-5996bb8225d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:51.865891 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b9cee-4988-4278-8ac6-5996bb8225d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:51.874797 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b9cee-4988-4278-8ac6-5996bb8225d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:51.876223 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b9cee-4988-4278-8ac6-5996bb8225d4 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:51.886005 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1365/2745] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:18:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:18:52.147652 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be213caf-771f-42dd-85ed-d8f616eaa3a8 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:18:52.149186 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-be213caf-771f-42dd-85ed-d8f616eaa3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:18:52.161658 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be213caf-771f-42dd-85ed-d8f616eaa3a8 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:18:52.166465 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47997bc7-d8f8-4680-8126-017453663df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:18:52.167324 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47997bc7-d8f8-4680-8126-017453663df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:18:52.167613 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47997bc7-d8f8-4680-8126-017453663df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:18:52.167886 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47997bc7-d8f8-4680-8126-017453663df3 admin admin] PATH_INFO: `/v3/projects/02cbfd66421b4de2af07df76f9ea9ff3` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:18:52.169085 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47997bc7-d8f8-4680-8126-017453663df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02cbfd66421b4de2af07df76f9ea9ff3)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:18:52.171104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47997bc7-d8f8-4680-8126-017453663df3 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:18:52.219633 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-47997bc7-d8f8-4680-8126-017453663df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02cbfd66421b4de2af07df76f9ea9ff3', 'request_id': 'req-47997bc7-d8f8-4680-8126-017453663df3'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:52.225228 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-47997bc7-d8f8-4680-8126-017453663df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02cbfd66421b4de2af07df76f9ea9ff3', 'request_id': 'req-47997bc7-d8f8-4680-8126-017453663df3'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:52.233623 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-47997bc7-d8f8-4680-8126-017453663df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02cbfd66421b4de2af07df76f9ea9ff3', 'request_id': 'req-47997bc7-d8f8-4680-8126-017453663df3'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:52.245813 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-47997bc7-d8f8-4680-8126-017453663df3 admin admin] The token cache is being invalidate because project 02cbfd66421b4de2af07df76f9ea9ff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:18:52.246232 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-47997bc7-d8f8-4680-8126-017453663df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:52.246970 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-47997bc7-d8f8-4680-8126-017453663df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:18:52.248688 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1381/2746] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:18:52 2021] DELETE /identity/v3/projects/02cbfd66421b4de2af07df76f9ea9ff3 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:02.048060 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b9cee-4988-4278-8ac6-5996bb8225d4 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:02.049454 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-684b9cee-4988-4278-8ac6-5996bb8225d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:02.062393 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b9cee-4988-4278-8ac6-5996bb8225d4 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:02.116365 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b7115-cc77-4a82-b05d-2ef5659cc022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:02.117208 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b7115-cc77-4a82-b05d-2ef5659cc022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:02.117484 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b7115-cc77-4a82-b05d-2ef5659cc022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:02.117754 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b7115-cc77-4a82-b05d-2ef5659cc022 admin admin] PATH_INFO: `/v3/users/4504e665d7a543faa45b9a34cc0f9e5d` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:02.118958 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b7115-cc77-4a82-b05d-2ef5659cc022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4504e665d7a543faa45b9a34cc0f9e5d)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:02.120851 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285b7115-cc77-4a82-b05d-2ef5659cc022 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:02.163671 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-285b7115-cc77-4a82-b05d-2ef5659cc022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4504e665d7a543faa45b9a34cc0f9e5d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:02.170930 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-285b7115-cc77-4a82-b05d-2ef5659cc022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4504e665d7a543faa45b9a34cc0f9e5d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:02.178625 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-285b7115-cc77-4a82-b05d-2ef5659cc022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4504e665d7a543faa45b9a34cc0f9e5d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:02.179267 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-285b7115-cc77-4a82-b05d-2ef5659cc022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4504e665d7a543faa45b9a34cc0f9e5d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:02.190577 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-285b7115-cc77-4a82-b05d-2ef5659cc022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4504e665d7a543faa45b9a34cc0f9e5d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:02.196283 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1366/2747] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:19:02 2021] DELETE /identity/v3/users/4504e665d7a543faa45b9a34cc0f9e5d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:02.200870 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f0f06-7453-48a1-a8c4-dd9f52e289aa None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:02.201336 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f0f06-7453-48a1-a8c4-dd9f52e289aa None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:02.201440 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f0f06-7453-48a1-a8c4-dd9f52e289aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:02.218800 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-de5f0f06-7453-48a1-a8c4-dd9f52e289aa None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:02.219930 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-de5f0f06-7453-48a1-a8c4-dd9f52e289aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:02.275847 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1382/2748] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:02.286122 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b7115-cc77-4a82-b05d-2ef5659cc022 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:02.287503 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-285b7115-cc77-4a82-b05d-2ef5659cc022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:02.341557 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b7115-cc77-4a82-b05d-2ef5659cc022 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:02.345349 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a031ab-e0a4-4146-92de-4d9bb84107a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:02.346040 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a031ab-e0a4-4146-92de-4d9bb84107a3 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:02.346328 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a031ab-e0a4-4146-92de-4d9bb84107a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:02.346608 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a031ab-e0a4-4146-92de-4d9bb84107a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:02.356016 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a031ab-e0a4-4146-92de-4d9bb84107a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:02.357447 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a031ab-e0a4-4146-92de-4d9bb84107a3 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:02.367496 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1367/2749] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:19:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:19:02.621473 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f0f06-7453-48a1-a8c4-dd9f52e289aa None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:02.623025 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-de5f0f06-7453-48a1-a8c4-dd9f52e289aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:02.634844 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f0f06-7453-48a1-a8c4-dd9f52e289aa None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:02.639472 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da26fb-9136-4837-8565-885b4a659d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:02.640297 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da26fb-9136-4837-8565-885b4a659d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:02.640577 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da26fb-9136-4837-8565-885b4a659d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:02.640847 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1da26fb-9136-4837-8565-885b4a659d41 admin admin] PATH_INFO: `/v3/projects/647a54c5367d410ba86c7f99da1e8f24` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:02.642094 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da26fb-9136-4837-8565-885b4a659d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=647a54c5367d410ba86c7f99da1e8f24)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:02.644017 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1da26fb-9136-4837-8565-885b4a659d41 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:02.688636 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b1da26fb-9136-4837-8565-885b4a659d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '647a54c5367d410ba86c7f99da1e8f24', 'request_id': 'req-b1da26fb-9136-4837-8565-885b4a659d41'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:02.693754 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b1da26fb-9136-4837-8565-885b4a659d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '647a54c5367d410ba86c7f99da1e8f24', 'request_id': 'req-b1da26fb-9136-4837-8565-885b4a659d41'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:02.699846 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b1da26fb-9136-4837-8565-885b4a659d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '647a54c5367d410ba86c7f99da1e8f24', 'request_id': 'req-b1da26fb-9136-4837-8565-885b4a659d41'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:02.711130 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b1da26fb-9136-4837-8565-885b4a659d41 admin admin] The token cache is being invalidate because project 647a54c5367d410ba86c7f99da1e8f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:19:02.711415 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b1da26fb-9136-4837-8565-885b4a659d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:02.712034 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b1da26fb-9136-4837-8565-885b4a659d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:02.713530 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1383/2750] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:19:02 2021] DELETE /identity/v3/projects/647a54c5367d410ba86c7f99da1e8f24 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:02.717439 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a031ab-e0a4-4146-92de-4d9bb84107a3 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:02.727586 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a031ab-e0a4-4146-92de-4d9bb84107a3 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:02.782059 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa61ed1e-bcd5-4f4d-b6b4-7d01f14d82b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:02.782926 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61ed1e-bcd5-4f4d-b6b4-7d01f14d82b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:02.783210 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61ed1e-bcd5-4f4d-b6b4-7d01f14d82b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:02.783485 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa61ed1e-bcd5-4f4d-b6b4-7d01f14d82b9 admin admin] PATH_INFO: `/v3/users/cb17fbe39a5949ba85250333ed303f34` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:02.784690 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61ed1e-bcd5-4f4d-b6b4-7d01f14d82b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb17fbe39a5949ba85250333ed303f34)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:02.787251 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa61ed1e-bcd5-4f4d-b6b4-7d01f14d82b9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:02.831025 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-aa61ed1e-bcd5-4f4d-b6b4-7d01f14d82b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb17fbe39a5949ba85250333ed303f34'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:02.839688 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-aa61ed1e-bcd5-4f4d-b6b4-7d01f14d82b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb17fbe39a5949ba85250333ed303f34'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:02.846573 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-aa61ed1e-bcd5-4f4d-b6b4-7d01f14d82b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb17fbe39a5949ba85250333ed303f34'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:02.847190 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-aa61ed1e-bcd5-4f4d-b6b4-7d01f14d82b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb17fbe39a5949ba85250333ed303f34'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:02.858766 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-aa61ed1e-bcd5-4f4d-b6b4-7d01f14d82b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb17fbe39a5949ba85250333ed303f34'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:02.864818 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1368/2751] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:19:02 2021] DELETE /identity/v3/users/cb17fbe39a5949ba85250333ed303f34 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:03.119737 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da26fb-9136-4837-8565-885b4a659d41 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:03.121198 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b1da26fb-9136-4837-8565-885b4a659d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:03.134548 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1da26fb-9136-4837-8565-885b4a659d41 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:03.189074 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a5575-41aa-4fb8-a72e-1d9aca45e2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:03.189953 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a5575-41aa-4fb8-a72e-1d9aca45e2f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:03.190228 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a5575-41aa-4fb8-a72e-1d9aca45e2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:03.190498 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a5575-41aa-4fb8-a72e-1d9aca45e2f2 admin admin] PATH_INFO: `/v3/projects/9291eb972f244cf09a5cf52e6f8cee16` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:03.191749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a5575-41aa-4fb8-a72e-1d9aca45e2f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9291eb972f244cf09a5cf52e6f8cee16)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:03.194284 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a5575-41aa-4fb8-a72e-1d9aca45e2f2 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:03.237066 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-0d3a5575-41aa-4fb8-a72e-1d9aca45e2f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9291eb972f244cf09a5cf52e6f8cee16', 'request_id': 'req-0d3a5575-41aa-4fb8-a72e-1d9aca45e2f2'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:03.242725 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-0d3a5575-41aa-4fb8-a72e-1d9aca45e2f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9291eb972f244cf09a5cf52e6f8cee16', 'request_id': 'req-0d3a5575-41aa-4fb8-a72e-1d9aca45e2f2'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:03.249989 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-0d3a5575-41aa-4fb8-a72e-1d9aca45e2f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9291eb972f244cf09a5cf52e6f8cee16', 'request_id': 'req-0d3a5575-41aa-4fb8-a72e-1d9aca45e2f2'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:03.261028 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-0d3a5575-41aa-4fb8-a72e-1d9aca45e2f2 admin admin] The token cache is being invalidate because project 9291eb972f244cf09a5cf52e6f8cee16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:19:03.261313 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-0d3a5575-41aa-4fb8-a72e-1d9aca45e2f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:03.261960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-0d3a5575-41aa-4fb8-a72e-1d9aca45e2f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:03.263473 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1384/2752] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:19:03 2021] DELETE /identity/v3/projects/9291eb972f244cf09a5cf52e6f8cee16 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:03.269074 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae04f5-4ce9-4aa2-a657-21ef8e25a6d1 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:03.269524 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae04f5-4ce9-4aa2-a657-21ef8e25a6d1 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:03.269622 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae04f5-4ce9-4aa2-a657-21ef8e25a6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:03.290170 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-afae04f5-4ce9-4aa2-a657-21ef8e25a6d1 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:03.291370 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-afae04f5-4ce9-4aa2-a657-21ef8e25a6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:03.347022 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1369/2753] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:03.354792 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c20f4-1fc8-43ed-b293-56b0956b7216 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:03.355085 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c20f4-1fc8-43ed-b293-56b0956b7216 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:03.355393 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c20f4-1fc8-43ed-b293-56b0956b7216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:03.374116 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-dc8c20f4-1fc8-43ed-b293-56b0956b7216 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:03.375350 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-dc8c20f4-1fc8-43ed-b293-56b0956b7216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:03.383845 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1385/2754] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:03.387949 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae04f5-4ce9-4aa2-a657-21ef8e25a6d1 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:03.397285 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae04f5-4ce9-4aa2-a657-21ef8e25a6d1 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:03.401729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d6c56-e653-4fdf-ab97-2496d0acd854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:03.402402 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d6c56-e653-4fdf-ab97-2496d0acd854 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:03.402687 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d6c56-e653-4fdf-ab97-2496d0acd854 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:03.402965 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74d6c56-e653-4fdf-ab97-2496d0acd854 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:03.403694 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d6c56-e653-4fdf-ab97-2496d0acd854 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 17:19:03.403999 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d6c56-e653-4fdf-ab97-2496d0acd854 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:03.405563 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74d6c56-e653-4fdf-ab97-2496d0acd854 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:03.416401 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1370/2755] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 17:19:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 29 17:19:03.420505 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c20f4-1fc8-43ed-b293-56b0956b7216 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:03.430131 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c20f4-1fc8-43ed-b293-56b0956b7216 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:03.434944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0c9d0-3180-4bda-bc06-d14e7e5b7e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:03.435623 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0c9d0-3180-4bda-bc06-d14e7e5b7e4b admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:03.435937 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0c9d0-3180-4bda-bc06-d14e7e5b7e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:03.436213 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0c9d0-3180-4bda-bc06-d14e7e5b7e4b admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:03.436906 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0c9d0-3180-4bda-bc06-d14e7e5b7e4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:03.438836 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0c9d0-3180-4bda-bc06-d14e7e5b7e4b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:03.464132 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1386/2756] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:19:03 2021] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:19:03.468158 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d6c56-e653-4fdf-ab97-2496d0acd854 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:03.478026 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74d6c56-e653-4fdf-ab97-2496d0acd854 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:03.533012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c54162-56ed-4ba8-9f52-924e6d86aaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:03.533676 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c54162-56ed-4ba8-9f52-924e6d86aaa9 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:03.533992 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c54162-56ed-4ba8-9f52-924e6d86aaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:03.534272 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c54162-56ed-4ba8-9f52-924e6d86aaa9 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:03.534977 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c54162-56ed-4ba8-9f52-924e6d86aaa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:03.537379 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c54162-56ed-4ba8-9f52-924e6d86aaa9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:03.556746 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1371/2757] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:19:03 2021] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:19:03.560830 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0c9d0-3180-4bda-bc06-d14e7e5b7e4b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:03.570913 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0c9d0-3180-4bda-bc06-d14e7e5b7e4b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:03.575529 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e1ae8-1e2a-48ba-9389-4ea67c9b97de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:03.576189 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e1ae8-1e2a-48ba-9389-4ea67c9b97de admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:03.576472 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e1ae8-1e2a-48ba-9389-4ea67c9b97de admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:03.576751 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e1ae8-1e2a-48ba-9389-4ea67c9b97de admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:03.577523 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e1ae8-1e2a-48ba-9389-4ea67c9b97de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:03.579222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e1ae8-1e2a-48ba-9389-4ea67c9b97de admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:03.590385 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1387/2758] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:03 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:19:03.594344 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c54162-56ed-4ba8-9f52-924e6d86aaa9 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:03.604695 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c54162-56ed-4ba8-9f52-924e6d86aaa9 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:03.609247 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a4b97e-ccd8-4852-9933-1e1689af55f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:03.609896 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4b97e-ccd8-4852-9933-1e1689af55f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:03.610213 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4b97e-ccd8-4852-9933-1e1689af55f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:03.610491 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a4b97e-ccd8-4852-9933-1e1689af55f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:03.611486 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4b97e-ccd8-4852-9933-1e1689af55f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:03.613071 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a4b97e-ccd8-4852-9933-1e1689af55f9 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:03.623405 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1372/2759] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:03 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:19:03.627204 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e1ae8-1e2a-48ba-9389-4ea67c9b97de admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:03.636932 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e1ae8-1e2a-48ba-9389-4ea67c9b97de admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:03.641442 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13217d8-981f-40ce-9afa-186fb4d4c627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:03.642322 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13217d8-981f-40ce-9afa-186fb4d4c627 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:03.642599 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13217d8-981f-40ce-9afa-186fb4d4c627 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:03.642867 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13217d8-981f-40ce-9afa-186fb4d4c627 admin admin] PATH_INFO: `/v3/projects/36219cbbae2945409c45b87c2ab1cf79/users/9f34ed933e344591ae1590e62111c19b/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:03.657122 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13217d8-981f-40ce-9afa-186fb4d4c627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36219cbbae2945409c45b87c2ab1cf79, user_id=9f34ed933e344591ae1590e62111c19b, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:03.660854 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13217d8-981f-40ce-9afa-186fb4d4c627 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:03.673004 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1388/2760] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:19:03 2021] PUT /identity/v3/projects/36219cbbae2945409c45b87c2ab1cf79/users/9f34ed933e344591ae1590e62111c19b/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 17:19:03.684622 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410cb48-c6ea-4107-a85e-537472101d5f None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:03.684910 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410cb48-c6ea-4107-a85e-537472101d5f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:03.685186 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410cb48-c6ea-4107-a85e-537472101d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:03.710356 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-8410cb48-c6ea-4107-a85e-537472101d5f None None] MFA Rules not processed for user `9f34ed933e344591ae1590e62111c19b`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:03.711564 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8410cb48-c6ea-4107-a85e-537472101d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:03.773266 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1373/2761] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:03 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:03.778217 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13217d8-981f-40ce-9afa-186fb4d4c627 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:03.838084 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13217d8-981f-40ce-9afa-186fb4d4c627 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:03.842948 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d40706-5089-415c-b722-55cba7ca732b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:03.843629 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d40706-5089-415c-b722-55cba7ca732b admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:03.843906 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d40706-5089-415c-b722-55cba7ca732b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:03.844177 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d40706-5089-415c-b722-55cba7ca732b admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:03.844875 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d40706-5089-415c-b722-55cba7ca732b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:03.846827 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d40706-5089-415c-b722-55cba7ca732b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:03.871955 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1389/2762] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:19:03 2021] POST /identity/v3/projects => generated 373 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:19:03.875929 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410cb48-c6ea-4107-a85e-537472101d5f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:03.886179 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410cb48-c6ea-4107-a85e-537472101d5f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:03.940657 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4545b7-b359-45ca-8cac-80f579add54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:03.941309 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4545b7-b359-45ca-8cac-80f579add54c admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:03.941614 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4545b7-b359-45ca-8cac-80f579add54c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:03.942102 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4545b7-b359-45ca-8cac-80f579add54c admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:03.942810 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4545b7-b359-45ca-8cac-80f579add54c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:03.944742 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4545b7-b359-45ca-8cac-80f579add54c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:03.963816 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1374/2763] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:19:03 2021] POST /identity/v3/users => generated 293 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:19:03.967749 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d40706-5089-415c-b722-55cba7ca732b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:03.978484 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d40706-5089-415c-b722-55cba7ca732b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:03.983158 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87526c6a-a4ca-4f2a-aada-fb0b59b005b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:03.983808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87526c6a-a4ca-4f2a-aada-fb0b59b005b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:03.984092 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87526c6a-a4ca-4f2a-aada-fb0b59b005b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:03.984369 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87526c6a-a4ca-4f2a-aada-fb0b59b005b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:03.985104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87526c6a-a4ca-4f2a-aada-fb0b59b005b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:03.986997 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87526c6a-a4ca-4f2a-aada-fb0b59b005b0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:03.997168 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1390/2764] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:03 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:19:04.000955 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4545b7-b359-45ca-8cac-80f579add54c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:04.010657 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4545b7-b359-45ca-8cac-80f579add54c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:04.015163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cd069-739f-4f67-b55c-708e447dd61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:04.016127 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cd069-739f-4f67-b55c-708e447dd61c admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:04.016412 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cd069-739f-4f67-b55c-708e447dd61c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:04.016681 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cd069-739f-4f67-b55c-708e447dd61c admin admin] PATH_INFO: `/v3/projects/79bc12e01b6e4e3981217d69037b91e7/users/36721b34bc524dca9063392ab759d0ee/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:04.031023 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cd069-739f-4f67-b55c-708e447dd61c admin admin] RBAC: Authorizing `identity:create_grant(project_id=79bc12e01b6e4e3981217d69037b91e7, user_id=36721b34bc524dca9063392ab759d0ee, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:04.033721 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613cd069-739f-4f67-b55c-708e447dd61c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:04.046952 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1375/2765] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:19:03 2021] PUT /identity/v3/projects/79bc12e01b6e4e3981217d69037b91e7/users/36721b34bc524dca9063392ab759d0ee/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:04.050748 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87526c6a-a4ca-4f2a-aada-fb0b59b005b0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:04.060555 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87526c6a-a4ca-4f2a-aada-fb0b59b005b0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:04.113123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d686e-fc3d-49c9-8eac-7a769c068b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:04.113829 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d686e-fc3d-49c9-8eac-7a769c068b88 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:04.114138 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d686e-fc3d-49c9-8eac-7a769c068b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:04.114410 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d686e-fc3d-49c9-8eac-7a769c068b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:04.115129 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d686e-fc3d-49c9-8eac-7a769c068b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:04.116703 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d686e-fc3d-49c9-8eac-7a769c068b88 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:04.125949 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1391/2766] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:04 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:19:04.130191 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cd069-739f-4f67-b55c-708e447dd61c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:04.139984 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cd069-739f-4f67-b55c-708e447dd61c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:04.144515 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef5537-1e73-4797-aec1-f1d6f427ac2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:04.146196 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef5537-1e73-4797-aec1-f1d6f427ac2f admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:04.146481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef5537-1e73-4797-aec1-f1d6f427ac2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:04.146754 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ef5537-1e73-4797-aec1-f1d6f427ac2f admin admin] PATH_INFO: `/v3/projects/79bc12e01b6e4e3981217d69037b91e7/users/36721b34bc524dca9063392ab759d0ee/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:04.148699 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef5537-1e73-4797-aec1-f1d6f427ac2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=79bc12e01b6e4e3981217d69037b91e7, user_id=36721b34bc524dca9063392ab759d0ee, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:04.151335 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ef5537-1e73-4797-aec1-f1d6f427ac2f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:04.161907 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1376/2767] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:19:04 2021] PUT /identity/v3/projects/79bc12e01b6e4e3981217d69037b91e7/users/36721b34bc524dca9063392ab759d0ee/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:04.171537 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aca8ee-a5c8-4e61-9ea9-bbf06dbc7be0 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:04.171820 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aca8ee-a5c8-4e61-9ea9-bbf06dbc7be0 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:04.172096 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aca8ee-a5c8-4e61-9ea9-bbf06dbc7be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:04.198761 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-72aca8ee-a5c8-4e61-9ea9-bbf06dbc7be0 None None] MFA Rules not processed for user `36721b34bc524dca9063392ab759d0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:04.199950 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-72aca8ee-a5c8-4e61-9ea9-bbf06dbc7be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:04.264059 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1392/2768] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:04 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 17:19:04.275155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef5537-1e73-4797-aec1-f1d6f427ac2f admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:04.276913 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-44ef5537-1e73-4797-aec1-f1d6f427ac2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:04.331512 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ef5537-1e73-4797-aec1-f1d6f427ac2f admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:04.335804 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69d0ac-e102-4f53-afa3-6c7661d6f72c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:04.336440 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69d0ac-e102-4f53-afa3-6c7661d6f72c service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:04.336722 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69d0ac-e102-4f53-afa3-6c7661d6f72c service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:04.337001 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69d0ac-e102-4f53-afa3-6c7661d6f72c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:04.345819 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69d0ac-e102-4f53-afa3-6c7661d6f72c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:04.347253 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69d0ac-e102-4f53-afa3-6c7661d6f72c service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:04.356542 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1377/2769] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:19:04 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:19:04.607622 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aca8ee-a5c8-4e61-9ea9-bbf06dbc7be0 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:04.666839 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aca8ee-a5c8-4e61-9ea9-bbf06dbc7be0 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:04.671305 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4489f4c-4334-4cf3-9678-bc79d7ed5c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:04.672158 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4489f4c-4334-4cf3-9678-bc79d7ed5c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:04.672444 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4489f4c-4334-4cf3-9678-bc79d7ed5c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:04.672720 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4489f4c-4334-4cf3-9678-bc79d7ed5c67 admin admin] PATH_INFO: `/v3/users/9f34ed933e344591ae1590e62111c19b` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:04.673910 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4489f4c-4334-4cf3-9678-bc79d7ed5c67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f34ed933e344591ae1590e62111c19b)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:04.675849 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4489f4c-4334-4cf3-9678-bc79d7ed5c67 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:04.719968 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b4489f4c-4334-4cf3-9678-bc79d7ed5c67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f34ed933e344591ae1590e62111c19b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:04.720617 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b4489f4c-4334-4cf3-9678-bc79d7ed5c67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f34ed933e344591ae1590e62111c19b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:04.731643 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b4489f4c-4334-4cf3-9678-bc79d7ed5c67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f34ed933e344591ae1590e62111c19b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:04.732266 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b4489f4c-4334-4cf3-9678-bc79d7ed5c67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f34ed933e344591ae1590e62111c19b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:04.739837 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-b4489f4c-4334-4cf3-9678-bc79d7ed5c67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f34ed933e344591ae1590e62111c19b'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:04.751459 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1393/2770] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:19:04 2021] DELETE /identity/v3/users/9f34ed933e344591ae1590e62111c19b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:04.756501 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46802829-b6f7-4a3b-aa35-9119a12ea1f5 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:04.756790 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46802829-b6f7-4a3b-aa35-9119a12ea1f5 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:04.757067 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46802829-b6f7-4a3b-aa35-9119a12ea1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:04.774663 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-46802829-b6f7-4a3b-aa35-9119a12ea1f5 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:04.775850 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-46802829-b6f7-4a3b-aa35-9119a12ea1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:04.831480 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1378/2771] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:04.841226 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4489f4c-4334-4cf3-9678-bc79d7ed5c67 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:04.842611 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-b4489f4c-4334-4cf3-9678-bc79d7ed5c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:04.897447 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4489f4c-4334-4cf3-9678-bc79d7ed5c67 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:04.901074 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc15ff0-1a5f-465a-a7d8-a1b10608c87c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:04.901709 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc15ff0-1a5f-465a-a7d8-a1b10608c87c service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:04.902016 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc15ff0-1a5f-465a-a7d8-a1b10608c87c service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:04.902291 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc15ff0-1a5f-465a-a7d8-a1b10608c87c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:04.910878 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc15ff0-1a5f-465a-a7d8-a1b10608c87c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:04.912281 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc15ff0-1a5f-465a-a7d8-a1b10608c87c service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:04.921378 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1394/2772] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:19:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:19:05.175286 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46802829-b6f7-4a3b-aa35-9119a12ea1f5 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:05.177271 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-46802829-b6f7-4a3b-aa35-9119a12ea1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:05.190388 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46802829-b6f7-4a3b-aa35-9119a12ea1f5 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:05.194926 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c2955-40bb-4712-93d3-b1f16ebf3e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:05.195798 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c2955-40bb-4712-93d3-b1f16ebf3e38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:05.196080 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c2955-40bb-4712-93d3-b1f16ebf3e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:05.196350 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c2955-40bb-4712-93d3-b1f16ebf3e38 admin admin] PATH_INFO: `/v3/projects/36219cbbae2945409c45b87c2ab1cf79` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:05.198239 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c2955-40bb-4712-93d3-b1f16ebf3e38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36219cbbae2945409c45b87c2ab1cf79)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:05.200153 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285c2955-40bb-4712-93d3-b1f16ebf3e38 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:05.252745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-285c2955-40bb-4712-93d3-b1f16ebf3e38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36219cbbae2945409c45b87c2ab1cf79', 'request_id': 'req-285c2955-40bb-4712-93d3-b1f16ebf3e38'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:05.258353 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-285c2955-40bb-4712-93d3-b1f16ebf3e38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36219cbbae2945409c45b87c2ab1cf79', 'request_id': 'req-285c2955-40bb-4712-93d3-b1f16ebf3e38'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:05.265779 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-285c2955-40bb-4712-93d3-b1f16ebf3e38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36219cbbae2945409c45b87c2ab1cf79', 'request_id': 'req-285c2955-40bb-4712-93d3-b1f16ebf3e38'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:05.276387 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-285c2955-40bb-4712-93d3-b1f16ebf3e38 admin admin] The token cache is being invalidate because project 36219cbbae2945409c45b87c2ab1cf79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:19:05.276965 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-285c2955-40bb-4712-93d3-b1f16ebf3e38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:05.277434 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-285c2955-40bb-4712-93d3-b1f16ebf3e38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:05.279032 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1379/2773] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:19:05 2021] DELETE /identity/v3/projects/36219cbbae2945409c45b87c2ab1cf79 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:05.282884 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc15ff0-1a5f-465a-a7d8-a1b10608c87c service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:05.292923 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc15ff0-1a5f-465a-a7d8-a1b10608c87c service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:05.353881 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c3d2f-a3e1-4b6c-9ca9-1790ed3a123e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:05.354882 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c3d2f-a3e1-4b6c-9ca9-1790ed3a123e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:05.355157 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c3d2f-a3e1-4b6c-9ca9-1790ed3a123e admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:05.355424 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c3d2f-a3e1-4b6c-9ca9-1790ed3a123e admin admin] PATH_INFO: `/v3/users/36721b34bc524dca9063392ab759d0ee` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:05.356598 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c3d2f-a3e1-4b6c-9ca9-1790ed3a123e admin admin] RBAC: Authorizing `identity:delete_user(user_id=36721b34bc524dca9063392ab759d0ee)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:05.358736 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3c3d2f-a3e1-4b6c-9ca9-1790ed3a123e admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:05.402275 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cb3c3d2f-a3e1-4b6c-9ca9-1790ed3a123e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36721b34bc524dca9063392ab759d0ee'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:05.402947 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cb3c3d2f-a3e1-4b6c-9ca9-1790ed3a123e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36721b34bc524dca9063392ab759d0ee'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:05.414876 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cb3c3d2f-a3e1-4b6c-9ca9-1790ed3a123e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36721b34bc524dca9063392ab759d0ee'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:05.415495 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cb3c3d2f-a3e1-4b6c-9ca9-1790ed3a123e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36721b34bc524dca9063392ab759d0ee'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:05.424252 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-cb3c3d2f-a3e1-4b6c-9ca9-1790ed3a123e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36721b34bc524dca9063392ab759d0ee'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:05.435931 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1395/2774] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:19:05 2021] DELETE /identity/v3/users/36721b34bc524dca9063392ab759d0ee => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:05.695940 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c2955-40bb-4712-93d3-b1f16ebf3e38 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:05.697421 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-285c2955-40bb-4712-93d3-b1f16ebf3e38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:05.712062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c2955-40bb-4712-93d3-b1f16ebf3e38 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:05.767042 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106c5c9-65d5-475d-982f-3186d9f7860b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:05.767901 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106c5c9-65d5-475d-982f-3186d9f7860b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:05.768286 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106c5c9-65d5-475d-982f-3186d9f7860b admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:05.768566 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106c5c9-65d5-475d-982f-3186d9f7860b admin admin] PATH_INFO: `/v3/projects/79bc12e01b6e4e3981217d69037b91e7` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:05.770321 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106c5c9-65d5-475d-982f-3186d9f7860b admin admin] RBAC: Authorizing `identity:delete_project(project_id=79bc12e01b6e4e3981217d69037b91e7)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:05.772215 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106c5c9-65d5-475d-982f-3186d9f7860b admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:05.818117 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-3106c5c9-65d5-475d-982f-3186d9f7860b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79bc12e01b6e4e3981217d69037b91e7', 'request_id': 'req-3106c5c9-65d5-475d-982f-3186d9f7860b'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:05.823444 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-3106c5c9-65d5-475d-982f-3186d9f7860b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79bc12e01b6e4e3981217d69037b91e7', 'request_id': 'req-3106c5c9-65d5-475d-982f-3186d9f7860b'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:05.830377 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-3106c5c9-65d5-475d-982f-3186d9f7860b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79bc12e01b6e4e3981217d69037b91e7', 'request_id': 'req-3106c5c9-65d5-475d-982f-3186d9f7860b'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:05.842031 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-3106c5c9-65d5-475d-982f-3186d9f7860b admin admin] The token cache is being invalidate because project 79bc12e01b6e4e3981217d69037b91e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:19:05.842323 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-3106c5c9-65d5-475d-982f-3186d9f7860b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:05.842961 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-3106c5c9-65d5-475d-982f-3186d9f7860b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:05.844493 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1380/2775] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:19:05 2021] DELETE /identity/v3/projects/79bc12e01b6e4e3981217d69037b91e7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:05.850203 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b7314-0f77-446a-9d59-5eb3ae297c5e None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:05.850501 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b7314-0f77-446a-9d59-5eb3ae297c5e None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:05.850783 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b7314-0f77-446a-9d59-5eb3ae297c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:05.868140 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-df2b7314-0f77-446a-9d59-5eb3ae297c5e None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:05.869336 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-df2b7314-0f77-446a-9d59-5eb3ae297c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:05.924894 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1396/2776] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:05.933874 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754345b-c43d-4360-8dab-df6d19675e21 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:05.934226 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754345b-c43d-4360-8dab-df6d19675e21 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:05.934553 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754345b-c43d-4360-8dab-df6d19675e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:05.952996 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-e754345b-c43d-4360-8dab-df6d19675e21 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:05.954166 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e754345b-c43d-4360-8dab-df6d19675e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:05.962881 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1381/2777] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 17:19:05.966926 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b7314-0f77-446a-9d59-5eb3ae297c5e None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:05.976409 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b7314-0f77-446a-9d59-5eb3ae297c5e None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:05.980982 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8572ea9-a1e1-4d42-8cae-7f0a1a256886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:05.981631 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8572ea9-a1e1-4d42-8cae-7f0a1a256886 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:05.981935 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8572ea9-a1e1-4d42-8cae-7f0a1a256886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:05.982230 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8572ea9-a1e1-4d42-8cae-7f0a1a256886 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:05.982972 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8572ea9-a1e1-4d42-8cae-7f0a1a256886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 17:19:05.983278 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8572ea9-a1e1-4d42-8cae-7f0a1a256886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:05.984877 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8572ea9-a1e1-4d42-8cae-7f0a1a256886 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:05.996217 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1397/2778] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 17:19:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 17:19:06.000625 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754345b-c43d-4360-8dab-df6d19675e21 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:06.010197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754345b-c43d-4360-8dab-df6d19675e21 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:06.014795 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d7fc9-3d70-49b6-babb-6eb5ae499b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:06.015422 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d7fc9-3d70-49b6-babb-6eb5ae499b53 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:06.015701 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d7fc9-3d70-49b6-babb-6eb5ae499b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:06.015972 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8d7fc9-3d70-49b6-babb-6eb5ae499b53 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:06.016675 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d7fc9-3d70-49b6-babb-6eb5ae499b53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:06.018593 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8d7fc9-3d70-49b6-babb-6eb5ae499b53 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:06.043437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1382/2779] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:19:05 2021] POST /identity/v3/projects => generated 355 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:19:06.047633 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8572ea9-a1e1-4d42-8cae-7f0a1a256886 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:06.057449 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8572ea9-a1e1-4d42-8cae-7f0a1a256886 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:06.111407 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29343d2-8ef2-4496-9d9d-97aed5cfd43c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:06.112065 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29343d2-8ef2-4496-9d9d-97aed5cfd43c admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:06.112349 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29343d2-8ef2-4496-9d9d-97aed5cfd43c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:06.112627 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29343d2-8ef2-4496-9d9d-97aed5cfd43c admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:06.113327 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29343d2-8ef2-4496-9d9d-97aed5cfd43c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:06.115279 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29343d2-8ef2-4496-9d9d-97aed5cfd43c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:06.134713 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1398/2780] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:19:06 2021] POST /identity/v3/users => generated 278 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:19:06.138720 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d7fc9-3d70-49b6-babb-6eb5ae499b53 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:06.149617 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8d7fc9-3d70-49b6-babb-6eb5ae499b53 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:06.154211 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f339600-aa69-4c72-9f2e-5892fb7827df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:06.154853 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f339600-aa69-4c72-9f2e-5892fb7827df admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:06.155135 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f339600-aa69-4c72-9f2e-5892fb7827df admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:06.155417 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f339600-aa69-4c72-9f2e-5892fb7827df admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:06.156311 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f339600-aa69-4c72-9f2e-5892fb7827df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:06.157899 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f339600-aa69-4c72-9f2e-5892fb7827df admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:06.167917 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1383/2781] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:06 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:19:06.171691 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29343d2-8ef2-4496-9d9d-97aed5cfd43c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:06.182015 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29343d2-8ef2-4496-9d9d-97aed5cfd43c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:06.186731 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaab384-2076-41ab-9152-9b68dcade42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:06.187381 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaab384-2076-41ab-9152-9b68dcade42b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:06.187666 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaab384-2076-41ab-9152-9b68dcade42b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:06.187944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaab384-2076-41ab-9152-9b68dcade42b admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:06.188732 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaab384-2076-41ab-9152-9b68dcade42b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:06.190364 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaab384-2076-41ab-9152-9b68dcade42b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:06.200513 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1399/2782] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:06 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:19:06.204620 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f339600-aa69-4c72-9f2e-5892fb7827df admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:06.214420 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f339600-aa69-4c72-9f2e-5892fb7827df admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:06.219016 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5c229-58c6-4d81-9d4a-1b86e00e0681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:06.219869 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5c229-58c6-4d81-9d4a-1b86e00e0681 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:06.220148 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5c229-58c6-4d81-9d4a-1b86e00e0681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:06.220421 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b5c229-58c6-4d81-9d4a-1b86e00e0681 admin admin] PATH_INFO: `/v3/projects/7fa12fb88d2345a4a3fc4b923bd154f8/users/7e531f70044c459884a3baa63e3a8840/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:06.234293 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5c229-58c6-4d81-9d4a-1b86e00e0681 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fa12fb88d2345a4a3fc4b923bd154f8, user_id=7e531f70044c459884a3baa63e3a8840, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:06.237177 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b5c229-58c6-4d81-9d4a-1b86e00e0681 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:06.250186 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1384/2783] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:19:06 2021] PUT /identity/v3/projects/7fa12fb88d2345a4a3fc4b923bd154f8/users/7e531f70044c459884a3baa63e3a8840/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:06.260768 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e4d78-a169-4d87-b937-c9f4a87b8301 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:06.261058 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e4d78-a169-4d87-b937-c9f4a87b8301 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:06.261340 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e4d78-a169-4d87-b937-c9f4a87b8301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:06.286786 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-fc9e4d78-a169-4d87-b937-c9f4a87b8301 None None] MFA Rules not processed for user `7e531f70044c459884a3baa63e3a8840`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:06.287985 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-fc9e4d78-a169-4d87-b937-c9f4a87b8301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:06.350474 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1400/2784] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:06 2021] POST /identity/v3/auth/tokens => generated 3375 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:06.354939 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5c229-58c6-4d81-9d4a-1b86e00e0681 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:06.413745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b5c229-58c6-4d81-9d4a-1b86e00e0681 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:06.418437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0164109-1209-4e83-a811-ee26cfb8b31c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:06.419091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0164109-1209-4e83-a811-ee26cfb8b31c admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:06.419376 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0164109-1209-4e83-a811-ee26cfb8b31c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:06.419656 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0164109-1209-4e83-a811-ee26cfb8b31c admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:06.420370 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0164109-1209-4e83-a811-ee26cfb8b31c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:06.422325 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0164109-1209-4e83-a811-ee26cfb8b31c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:06.447648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1385/2785] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:19:06 2021] POST /identity/v3/projects => generated 357 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:19:06.451860 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e4d78-a169-4d87-b937-c9f4a87b8301 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:06.462278 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e4d78-a169-4d87-b937-c9f4a87b8301 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:06.515002 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a547a5e-d091-4b86-ad38-52940c5a7901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:06.515664 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a547a5e-d091-4b86-ad38-52940c5a7901 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:06.515938 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a547a5e-d091-4b86-ad38-52940c5a7901 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:06.516205 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a547a5e-d091-4b86-ad38-52940c5a7901 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:06.516897 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a547a5e-d091-4b86-ad38-52940c5a7901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:06.518829 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a547a5e-d091-4b86-ad38-52940c5a7901 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:06.538062 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1401/2786] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:19:06 2021] POST /identity/v3/users => generated 285 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:19:06.541934 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0164109-1209-4e83-a811-ee26cfb8b31c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:06.553023 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0164109-1209-4e83-a811-ee26cfb8b31c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:06.558373 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5b6ca-9019-4d5d-abb5-e444b85b116d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:06.559031 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5b6ca-9019-4d5d-abb5-e444b85b116d admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:06.559317 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5b6ca-9019-4d5d-abb5-e444b85b116d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:06.559593 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5b6ca-9019-4d5d-abb5-e444b85b116d admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:06.560342 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5b6ca-9019-4d5d-abb5-e444b85b116d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:06.562006 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f5b6ca-9019-4d5d-abb5-e444b85b116d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:06.572839 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1386/2787] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:19:06.576853 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a547a5e-d091-4b86-ad38-52940c5a7901 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:06.586422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a547a5e-d091-4b86-ad38-52940c5a7901 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:06.590914 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba71fb-b731-43d6-a7e0-57e13cbb25b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:06.591766 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba71fb-b731-43d6-a7e0-57e13cbb25b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:06.592044 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba71fb-b731-43d6-a7e0-57e13cbb25b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:06.592312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba71fb-b731-43d6-a7e0-57e13cbb25b8 admin admin] PATH_INFO: `/v3/projects/5bd9c9ce61984fadaaf7d9f11e4b1fc9/users/0f140ff2cf0c4b75b2fda982e0d7e839/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:06.608118 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba71fb-b731-43d6-a7e0-57e13cbb25b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd9c9ce61984fadaaf7d9f11e4b1fc9, user_id=0f140ff2cf0c4b75b2fda982e0d7e839, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:06.610769 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba71fb-b731-43d6-a7e0-57e13cbb25b8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:06.625591 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1402/2788] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:19:06 2021] PUT /identity/v3/projects/5bd9c9ce61984fadaaf7d9f11e4b1fc9/users/0f140ff2cf0c4b75b2fda982e0d7e839/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:06.629606 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5b6ca-9019-4d5d-abb5-e444b85b116d admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:06.639429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5b6ca-9019-4d5d-abb5-e444b85b116d admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:06.693293 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a7c6b-e7a0-46e9-b30c-45edefa1ba4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:06.693975 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a7c6b-e7a0-46e9-b30c-45edefa1ba4f admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:06.694261 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a7c6b-e7a0-46e9-b30c-45edefa1ba4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:06.694538 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a7c6b-e7a0-46e9-b30c-45edefa1ba4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:06.695262 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a7c6b-e7a0-46e9-b30c-45edefa1ba4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:06.696838 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a7c6b-e7a0-46e9-b30c-45edefa1ba4f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:06.706281 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1387/2789] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:06 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:19:06.710483 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba71fb-b731-43d6-a7e0-57e13cbb25b8 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:06.721030 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba71fb-b731-43d6-a7e0-57e13cbb25b8 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:06.726329 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7172618-7314-460e-a7e5-f41ce0336842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:06.727188 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7172618-7314-460e-a7e5-f41ce0336842 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:06.727473 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7172618-7314-460e-a7e5-f41ce0336842 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:06.727745 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7172618-7314-460e-a7e5-f41ce0336842 admin admin] PATH_INFO: `/v3/projects/5bd9c9ce61984fadaaf7d9f11e4b1fc9/users/0f140ff2cf0c4b75b2fda982e0d7e839/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:06.729726 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7172618-7314-460e-a7e5-f41ce0336842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bd9c9ce61984fadaaf7d9f11e4b1fc9, user_id=0f140ff2cf0c4b75b2fda982e0d7e839, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:06.732449 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7172618-7314-460e-a7e5-f41ce0336842 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:06.743222 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1403/2790] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:19:06 2021] PUT /identity/v3/projects/5bd9c9ce61984fadaaf7d9f11e4b1fc9/users/0f140ff2cf0c4b75b2fda982e0d7e839/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:06.753434 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f4a88-1fff-4895-9721-237920957753 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:06.753723 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f4a88-1fff-4895-9721-237920957753 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:06.754029 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0f4a88-1fff-4895-9721-237920957753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:06.779765 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-9f0f4a88-1fff-4895-9721-237920957753 None None] MFA Rules not processed for user `0f140ff2cf0c4b75b2fda982e0d7e839`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:06.780962 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-9f0f4a88-1fff-4895-9721-237920957753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:06.846106 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1388/2791] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:06 2021] POST /identity/v3/auth/tokens => generated 3444 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:06.857080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7172618-7314-460e-a7e5-f41ce0336842 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:06.858835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f7172618-7314-460e-a7e5-f41ce0336842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:06.915251 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7172618-7314-460e-a7e5-f41ce0336842 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:06.918911 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3853cd-e766-4d38-8155-49156ba8dd6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:06.919549 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3853cd-e766-4d38-8155-49156ba8dd6f service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:06.919830 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3853cd-e766-4d38-8155-49156ba8dd6f service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:06.920104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3853cd-e766-4d38-8155-49156ba8dd6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:06.929016 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3853cd-e766-4d38-8155-49156ba8dd6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:06.930513 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3853cd-e766-4d38-8155-49156ba8dd6f service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:06.940124 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1404/2792] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:19:06 2021] GET /identity/v3/auth/tokens => generated 3444 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:19:07.008845 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f4a88-1fff-4895-9721-237920957753 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:07.018130 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0f4a88-1fff-4895-9721-237920957753 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:07.022319 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23eb66-7c0e-4f0e-9c74-b5891d23f93b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:07.022944 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23eb66-7c0e-4f0e-9c74-b5891d23f93b service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:07.023228 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23eb66-7c0e-4f0e-9c74-b5891d23f93b service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:07.023502 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23eb66-7c0e-4f0e-9c74-b5891d23f93b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:07.077333 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23eb66-7c0e-4f0e-9c74-b5891d23f93b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:07.078796 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23eb66-7c0e-4f0e-9c74-b5891d23f93b service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:07.088156 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1389/2793] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:19:07 2021] GET /identity/v3/auth/tokens => generated 3375 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:19:21.636853 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3853cd-e766-4d38-8155-49156ba8dd6f service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:21.698059 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3853cd-e766-4d38-8155-49156ba8dd6f service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:21.702537 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23b4bc-60b8-4067-ad9d-7bcefd3de71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:21.703391 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23b4bc-60b8-4067-ad9d-7bcefd3de71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:21.703673 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23b4bc-60b8-4067-ad9d-7bcefd3de71c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:21.703943 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da23b4bc-60b8-4067-ad9d-7bcefd3de71c admin admin] PATH_INFO: `/v3/users/7e531f70044c459884a3baa63e3a8840` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:21.705125 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23b4bc-60b8-4067-ad9d-7bcefd3de71c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e531f70044c459884a3baa63e3a8840)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:21.707070 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da23b4bc-60b8-4067-ad9d-7bcefd3de71c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:21.750999 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-da23b4bc-60b8-4067-ad9d-7bcefd3de71c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e531f70044c459884a3baa63e3a8840'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:21.751641 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-da23b4bc-60b8-4067-ad9d-7bcefd3de71c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e531f70044c459884a3baa63e3a8840'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:21.763756 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-da23b4bc-60b8-4067-ad9d-7bcefd3de71c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e531f70044c459884a3baa63e3a8840'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:21.764507 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-da23b4bc-60b8-4067-ad9d-7bcefd3de71c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e531f70044c459884a3baa63e3a8840'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:21.771797 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-da23b4bc-60b8-4067-ad9d-7bcefd3de71c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e531f70044c459884a3baa63e3a8840'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:21.784317 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1405/2794] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:19:21 2021] DELETE /identity/v3/users/7e531f70044c459884a3baa63e3a8840 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:21.788996 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283edcf-228f-46ec-b5da-442dd3920cdf None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:21.789486 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283edcf-228f-46ec-b5da-442dd3920cdf None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:21.789603 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283edcf-228f-46ec-b5da-442dd3920cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:21.807550 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-8283edcf-228f-46ec-b5da-442dd3920cdf None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:21.808838 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8283edcf-228f-46ec-b5da-442dd3920cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:21.867145 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1390/2795] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:21.876999 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23b4bc-60b8-4067-ad9d-7bcefd3de71c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:21.878464 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-da23b4bc-60b8-4067-ad9d-7bcefd3de71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:21.962353 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da23b4bc-60b8-4067-ad9d-7bcefd3de71c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:21.965988 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd693ef-a164-4a15-9646-8085bdd58369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:21.966624 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd693ef-a164-4a15-9646-8085bdd58369 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:21.966901 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd693ef-a164-4a15-9646-8085bdd58369 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:21.967171 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd693ef-a164-4a15-9646-8085bdd58369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:21.976759 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd693ef-a164-4a15-9646-8085bdd58369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:21.978212 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd693ef-a164-4a15-9646-8085bdd58369 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:21.987702 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1406/2796] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:19:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 17:19:22.242751 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283edcf-228f-46ec-b5da-442dd3920cdf None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:22.244197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-8283edcf-228f-46ec-b5da-442dd3920cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:22.256599 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283edcf-228f-46ec-b5da-442dd3920cdf None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:22.261237 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6105e83-5da7-4bb5-922c-f8e0f55bcc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:22.262178 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6105e83-5da7-4bb5-922c-f8e0f55bcc7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:22.262593 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6105e83-5da7-4bb5-922c-f8e0f55bcc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:22.262878 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6105e83-5da7-4bb5-922c-f8e0f55bcc7d admin admin] PATH_INFO: `/v3/projects/7fa12fb88d2345a4a3fc4b923bd154f8` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:22.264351 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6105e83-5da7-4bb5-922c-f8e0f55bcc7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fa12fb88d2345a4a3fc4b923bd154f8)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:22.266394 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6105e83-5da7-4bb5-922c-f8e0f55bcc7d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:22.313621 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-e6105e83-5da7-4bb5-922c-f8e0f55bcc7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fa12fb88d2345a4a3fc4b923bd154f8', 'request_id': 'req-e6105e83-5da7-4bb5-922c-f8e0f55bcc7d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:22.319509 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-e6105e83-5da7-4bb5-922c-f8e0f55bcc7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fa12fb88d2345a4a3fc4b923bd154f8', 'request_id': 'req-e6105e83-5da7-4bb5-922c-f8e0f55bcc7d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:22.326290 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-e6105e83-5da7-4bb5-922c-f8e0f55bcc7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fa12fb88d2345a4a3fc4b923bd154f8', 'request_id': 'req-e6105e83-5da7-4bb5-922c-f8e0f55bcc7d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:22.337398 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-e6105e83-5da7-4bb5-922c-f8e0f55bcc7d admin admin] The token cache is being invalidate because project 7fa12fb88d2345a4a3fc4b923bd154f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:19:22.337682 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-e6105e83-5da7-4bb5-922c-f8e0f55bcc7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:22.338336 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-e6105e83-5da7-4bb5-922c-f8e0f55bcc7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:22.339872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1391/2797] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:19:22 2021] DELETE /identity/v3/projects/7fa12fb88d2345a4a3fc4b923bd154f8 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:22.343783 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd693ef-a164-4a15-9646-8085bdd58369 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:22.353393 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd693ef-a164-4a15-9646-8085bdd58369 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:22.407076 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed25d69-6ce0-4a30-9482-0589b23f41b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:22.407934 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed25d69-6ce0-4a30-9482-0589b23f41b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:22.408213 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed25d69-6ce0-4a30-9482-0589b23f41b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:22.408487 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed25d69-6ce0-4a30-9482-0589b23f41b3 admin admin] PATH_INFO: `/v3/users/0f140ff2cf0c4b75b2fda982e0d7e839` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:22.409655 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed25d69-6ce0-4a30-9482-0589b23f41b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f140ff2cf0c4b75b2fda982e0d7e839)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:22.411932 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed25d69-6ce0-4a30-9482-0589b23f41b3 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:22.455253 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-2ed25d69-6ce0-4a30-9482-0589b23f41b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f140ff2cf0c4b75b2fda982e0d7e839'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:22.455892 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-2ed25d69-6ce0-4a30-9482-0589b23f41b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f140ff2cf0c4b75b2fda982e0d7e839'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:22.467816 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-2ed25d69-6ce0-4a30-9482-0589b23f41b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f140ff2cf0c4b75b2fda982e0d7e839'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:22.468452 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-2ed25d69-6ce0-4a30-9482-0589b23f41b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f140ff2cf0c4b75b2fda982e0d7e839'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:22.475217 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-2ed25d69-6ce0-4a30-9482-0589b23f41b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f140ff2cf0c4b75b2fda982e0d7e839'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:22.487144 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1407/2798] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:19:22 2021] DELETE /identity/v3/users/0f140ff2cf0c4b75b2fda982e0d7e839 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:22.744963 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6105e83-5da7-4bb5-922c-f8e0f55bcc7d admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:22.746402 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e6105e83-5da7-4bb5-922c-f8e0f55bcc7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:22.759522 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6105e83-5da7-4bb5-922c-f8e0f55bcc7d admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:22.818792 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbc63d-3d68-4ed3-a81c-31d6c1d8e9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:22.819641 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbc63d-3d68-4ed3-a81c-31d6c1d8e9bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:22.819923 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbc63d-3d68-4ed3-a81c-31d6c1d8e9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:22.820197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbc63d-3d68-4ed3-a81c-31d6c1d8e9bf admin admin] PATH_INFO: `/v3/projects/5bd9c9ce61984fadaaf7d9f11e4b1fc9` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:22.821418 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbc63d-3d68-4ed3-a81c-31d6c1d8e9bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bd9c9ce61984fadaaf7d9f11e4b1fc9)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:22.823352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbc63d-3d68-4ed3-a81c-31d6c1d8e9bf admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:22.867857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-22dbc63d-3d68-4ed3-a81c-31d6c1d8e9bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bd9c9ce61984fadaaf7d9f11e4b1fc9', 'request_id': 'req-22dbc63d-3d68-4ed3-a81c-31d6c1d8e9bf'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:22.872999 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-22dbc63d-3d68-4ed3-a81c-31d6c1d8e9bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bd9c9ce61984fadaaf7d9f11e4b1fc9', 'request_id': 'req-22dbc63d-3d68-4ed3-a81c-31d6c1d8e9bf'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:22.880196 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-22dbc63d-3d68-4ed3-a81c-31d6c1d8e9bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bd9c9ce61984fadaaf7d9f11e4b1fc9', 'request_id': 'req-22dbc63d-3d68-4ed3-a81c-31d6c1d8e9bf'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:22.891315 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-22dbc63d-3d68-4ed3-a81c-31d6c1d8e9bf admin admin] The token cache is being invalidate because project 5bd9c9ce61984fadaaf7d9f11e4b1fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:19:22.891602 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-22dbc63d-3d68-4ed3-a81c-31d6c1d8e9bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:22.892245 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-22dbc63d-3d68-4ed3-a81c-31d6c1d8e9bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:22.893750 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1392/2799] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:19:22 2021] DELETE /identity/v3/projects/5bd9c9ce61984fadaaf7d9f11e4b1fc9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:22.941384 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee315b-be47-48e9-bd85-4c126a7b6e53 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:22.941991 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee315b-be47-48e9-bd85-4c126a7b6e53 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:22.941991 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee315b-be47-48e9-bd85-4c126a7b6e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:22.959917 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-4cee315b-be47-48e9-bd85-4c126a7b6e53 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:22.961108 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4cee315b-be47-48e9-bd85-4c126a7b6e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:23.019738 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1408/2800] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:23.027287 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2504109-167a-42f1-87ea-4ea4f92d6aa6 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:23.027580 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2504109-167a-42f1-87ea-4ea4f92d6aa6 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:23.027860 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2504109-167a-42f1-87ea-4ea4f92d6aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:23.046043 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-f2504109-167a-42f1-87ea-4ea4f92d6aa6 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:23.047240 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-f2504109-167a-42f1-87ea-4ea4f92d6aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:23.055991 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1393/2801] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:23.059956 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee315b-be47-48e9-bd85-4c126a7b6e53 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:23.069345 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee315b-be47-48e9-bd85-4c126a7b6e53 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:23.073752 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf13d0d-7651-4600-b513-d91b4c08e254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:23.074416 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf13d0d-7651-4600-b513-d91b4c08e254 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:23.074694 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf13d0d-7651-4600-b513-d91b4c08e254 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:23.074964 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf13d0d-7651-4600-b513-d91b4c08e254 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:23.075684 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf13d0d-7651-4600-b513-d91b4c08e254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 17:19:23.075985 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf13d0d-7651-4600-b513-d91b4c08e254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:23.077560 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf13d0d-7651-4600-b513-d91b4c08e254 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:23.088535 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1409/2802] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 17:19:23 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 17:19:23.092620 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2504109-167a-42f1-87ea-4ea4f92d6aa6 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:23.102508 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2504109-167a-42f1-87ea-4ea4f92d6aa6 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:23.107130 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0da4c-cd00-4a92-83fc-fa5733d06f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:23.107765 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0da4c-cd00-4a92-83fc-fa5733d06f67 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:23.108048 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0da4c-cd00-4a92-83fc-fa5733d06f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:23.108351 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e0da4c-cd00-4a92-83fc-fa5733d06f67 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:23.109069 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0da4c-cd00-4a92-83fc-fa5733d06f67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:23.110991 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e0da4c-cd00-4a92-83fc-fa5733d06f67 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:23.136194 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1394/2803] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:19:23 2021] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:19:23.140144 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf13d0d-7651-4600-b513-d91b4c08e254 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:23.149796 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf13d0d-7651-4600-b513-d91b4c08e254 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:23.203104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44056aa-531b-4383-ad71-abeeb278d2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:23.203785 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44056aa-531b-4383-ad71-abeeb278d2d5 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:23.204068 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44056aa-531b-4383-ad71-abeeb278d2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:23.204342 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44056aa-531b-4383-ad71-abeeb278d2d5 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:23.205044 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44056aa-531b-4383-ad71-abeeb278d2d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:23.207003 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44056aa-531b-4383-ad71-abeeb278d2d5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:23.226514 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1410/2804] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:19:23 2021] POST /identity/v3/users => generated 289 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:19:23.230581 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0da4c-cd00-4a92-83fc-fa5733d06f67 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:23.241759 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e0da4c-cd00-4a92-83fc-fa5733d06f67 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:23.246407 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cf701-d46f-456e-bc6c-e1a3e1ce5e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:23.247056 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cf701-d46f-456e-bc6c-e1a3e1ce5e5a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:23.247338 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cf701-d46f-456e-bc6c-e1a3e1ce5e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:23.247616 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4cf701-d46f-456e-bc6c-e1a3e1ce5e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:23.248352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4cf701-d46f-456e-bc6c-e1a3e1ce5e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:23.249937 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4cf701-d46f-456e-bc6c-e1a3e1ce5e5a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:23.260062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1395/2805] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:23 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:19:23.263812 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44056aa-531b-4383-ad71-abeeb278d2d5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:23.273628 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44056aa-531b-4383-ad71-abeeb278d2d5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:23.278438 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29dea5d-abae-4df8-9023-1d0c3fe6b055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:23.279236 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dea5d-abae-4df8-9023-1d0c3fe6b055 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:23.279531 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dea5d-abae-4df8-9023-1d0c3fe6b055 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:23.279815 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29dea5d-abae-4df8-9023-1d0c3fe6b055 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:23.280595 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dea5d-abae-4df8-9023-1d0c3fe6b055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:23.282219 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29dea5d-abae-4df8-9023-1d0c3fe6b055 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:23.292633 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1411/2806] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:23 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:19:23.296674 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cf701-d46f-456e-bc6c-e1a3e1ce5e5a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:23.307076 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4cf701-d46f-456e-bc6c-e1a3e1ce5e5a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:23.311680 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a372ab7-fdeb-430b-81ea-3008feec7380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:23.312538 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a372ab7-fdeb-430b-81ea-3008feec7380 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:23.312821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a372ab7-fdeb-430b-81ea-3008feec7380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:23.313096 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a372ab7-fdeb-430b-81ea-3008feec7380 admin admin] PATH_INFO: `/v3/projects/ae19ef0b685e472fa9b8ef2ea65946c6/users/ddb813bcabed4f48a4db3bb0bb423fb3/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:23.327562 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a372ab7-fdeb-430b-81ea-3008feec7380 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae19ef0b685e472fa9b8ef2ea65946c6, user_id=ddb813bcabed4f48a4db3bb0bb423fb3, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:23.330321 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a372ab7-fdeb-430b-81ea-3008feec7380 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:23.342884 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1396/2807] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:19:23 2021] PUT /identity/v3/projects/ae19ef0b685e472fa9b8ef2ea65946c6/users/ddb813bcabed4f48a4db3bb0bb423fb3/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:23.353648 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3b3a2-4283-4bf0-b7bc-39fffc57e7ff None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:23.353965 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3b3a2-4283-4bf0-b7bc-39fffc57e7ff None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:23.354253 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3b3a2-4283-4bf0-b7bc-39fffc57e7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:23.382055 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e0c3b3a2-4283-4bf0-b7bc-39fffc57e7ff None None] MFA Rules not processed for user `ddb813bcabed4f48a4db3bb0bb423fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:23.383266 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e0c3b3a2-4283-4bf0-b7bc-39fffc57e7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:23.443992 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1412/2808] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:23 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:23.448486 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a372ab7-fdeb-430b-81ea-3008feec7380 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:23.508296 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a372ab7-fdeb-430b-81ea-3008feec7380 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:23.513739 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1280b-451e-4aab-835a-5d2f61ab09c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:23.514865 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1280b-451e-4aab-835a-5d2f61ab09c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:23.515376 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1280b-451e-4aab-835a-5d2f61ab09c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:23.515865 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1280b-451e-4aab-835a-5d2f61ab09c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:23.517166 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1280b-451e-4aab-835a-5d2f61ab09c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:23.521368 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1280b-451e-4aab-835a-5d2f61ab09c7 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:23.550794 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1397/2809] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:19:23 2021] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:19:23.555040 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3b3a2-4283-4bf0-b7bc-39fffc57e7ff None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:23.565744 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3b3a2-4283-4bf0-b7bc-39fffc57e7ff None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:23.620978 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f8eff-fbf1-4eb9-8645-4a2e6dc79270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:23.621638 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f8eff-fbf1-4eb9-8645-4a2e6dc79270 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:23.621936 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f8eff-fbf1-4eb9-8645-4a2e6dc79270 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:23.622209 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f8eff-fbf1-4eb9-8645-4a2e6dc79270 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:23.622899 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f8eff-fbf1-4eb9-8645-4a2e6dc79270 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:23.624786 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f8eff-fbf1-4eb9-8645-4a2e6dc79270 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:23.643373 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1413/2810] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:19:23 2021] POST /identity/v3/users => generated 295 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:19:23.648023 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1280b-451e-4aab-835a-5d2f61ab09c7 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:23.658375 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1280b-451e-4aab-835a-5d2f61ab09c7 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:23.663998 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727e68a-9496-451e-ba6d-e78bed33d0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:23.664649 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727e68a-9496-451e-ba6d-e78bed33d0c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:23.664932 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727e68a-9496-451e-ba6d-e78bed33d0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:23.665211 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727e68a-9496-451e-ba6d-e78bed33d0c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:23.665983 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727e68a-9496-451e-ba6d-e78bed33d0c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:23.667632 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727e68a-9496-451e-ba6d-e78bed33d0c1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:23.678429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1398/2811] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:23 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 17:19:23.682634 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f8eff-fbf1-4eb9-8645-4a2e6dc79270 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:23.692612 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f8eff-fbf1-4eb9-8645-4a2e6dc79270 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:23.697369 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a0c7b-0aea-4366-b81c-e115dbc083b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:23.698211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a0c7b-0aea-4366-b81c-e115dbc083b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:23.698496 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a0c7b-0aea-4366-b81c-e115dbc083b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:23.698770 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a0c7b-0aea-4366-b81c-e115dbc083b6 admin admin] PATH_INFO: `/v3/projects/b2270abcc85045eea812811bf0c607bb/users/3764260a957d4e279413f863473153e1/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:23.713395 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a0c7b-0aea-4366-b81c-e115dbc083b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2270abcc85045eea812811bf0c607bb, user_id=3764260a957d4e279413f863473153e1, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:23.716068 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476a0c7b-0aea-4366-b81c-e115dbc083b6 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:23.729572 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1414/2812] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:19:23 2021] PUT /identity/v3/projects/b2270abcc85045eea812811bf0c607bb/users/3764260a957d4e279413f863473153e1/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 17:19:23.733396 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727e68a-9496-451e-ba6d-e78bed33d0c1 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:23.743502 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727e68a-9496-451e-ba6d-e78bed33d0c1 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:23.799117 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ebfa37-9cdd-4a36-b92d-f541ed6fb6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:23.799782 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebfa37-9cdd-4a36-b92d-f541ed6fb6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:23.800068 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebfa37-9cdd-4a36-b92d-f541ed6fb6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:23.800354 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ebfa37-9cdd-4a36-b92d-f541ed6fb6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:23.801092 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebfa37-9cdd-4a36-b92d-f541ed6fb6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:23.802819 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ebfa37-9cdd-4a36-b92d-f541ed6fb6b5 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:23.812459 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1399/2813] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:23 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:19:23.816472 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a0c7b-0aea-4366-b81c-e115dbc083b6 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:23.827254 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a0c7b-0aea-4366-b81c-e115dbc083b6 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:23.831799 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a4961-be45-4464-bb69-182232d66459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:23.832660 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a4961-be45-4464-bb69-182232d66459 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:23.832957 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a4961-be45-4464-bb69-182232d66459 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:23.833211 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119a4961-be45-4464-bb69-182232d66459 admin admin] PATH_INFO: `/v3/projects/b2270abcc85045eea812811bf0c607bb/users/3764260a957d4e279413f863473153e1/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:23.835861 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a4961-be45-4464-bb69-182232d66459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2270abcc85045eea812811bf0c607bb, user_id=3764260a957d4e279413f863473153e1, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:23.838518 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119a4961-be45-4464-bb69-182232d66459 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:23.848335 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1415/2814] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:19:23 2021] PUT /identity/v3/projects/b2270abcc85045eea812811bf0c607bb/users/3764260a957d4e279413f863473153e1/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:23.859195 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ead1e-2152-4b6d-a2ca-9199902517b3 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:23.859681 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ead1e-2152-4b6d-a2ca-9199902517b3 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:23.859779 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2ead1e-2152-4b6d-a2ca-9199902517b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:23.886342 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-cf2ead1e-2152-4b6d-a2ca-9199902517b3 None None] MFA Rules not processed for user `3764260a957d4e279413f863473153e1`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:23.887532 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-cf2ead1e-2152-4b6d-a2ca-9199902517b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:23.952125 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1400/2815] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:23 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:23.962699 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a4961-be45-4464-bb69-182232d66459 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:23.964364 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-119a4961-be45-4464-bb69-182232d66459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:24.018213 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119a4961-be45-4464-bb69-182232d66459 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:24.022370 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de668b89-6870-4bab-b234-6a80b99af641 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:24.023008 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de668b89-6870-4bab-b234-6a80b99af641 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:24.023289 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de668b89-6870-4bab-b234-6a80b99af641 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:24.023563 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de668b89-6870-4bab-b234-6a80b99af641 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:24.076852 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de668b89-6870-4bab-b234-6a80b99af641 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:24.078312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de668b89-6870-4bab-b234-6a80b99af641 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:24.087656 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1416/2816] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:19:23 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:19:29.672668 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ead1e-2152-4b6d-a2ca-9199902517b3 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:29.674162 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-cf2ead1e-2152-4b6d-a2ca-9199902517b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:29.686311 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2ead1e-2152-4b6d-a2ca-9199902517b3 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:29.689823 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98039dd7-adb5-4cba-b0cc-816e4d2c6cf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:29.690480 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98039dd7-adb5-4cba-b0cc-816e4d2c6cf4 service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:29.690766 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98039dd7-adb5-4cba-b0cc-816e4d2c6cf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:29.691043 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98039dd7-adb5-4cba-b0cc-816e4d2c6cf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:29.700422 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98039dd7-adb5-4cba-b0cc-816e4d2c6cf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:29.701841 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98039dd7-adb5-4cba-b0cc-816e4d2c6cf4 service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:29.711060 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1401/2817] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:19:29 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:19:54.234882 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de668b89-6870-4bab-b234-6a80b99af641 service cinder] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:54.294312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de668b89-6870-4bab-b234-6a80b99af641 service cinder] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:54.299050 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dae321-1043-48fd-9e5d-5109007f2228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:54.299905 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dae321-1043-48fd-9e5d-5109007f2228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:54.300184 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dae321-1043-48fd-9e5d-5109007f2228 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:54.300455 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dae321-1043-48fd-9e5d-5109007f2228 admin admin] PATH_INFO: `/v3/users/ddb813bcabed4f48a4db3bb0bb423fb3` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:54.301639 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dae321-1043-48fd-9e5d-5109007f2228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddb813bcabed4f48a4db3bb0bb423fb3)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:54.304099 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dae321-1043-48fd-9e5d-5109007f2228 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:54.347210 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-47dae321-1043-48fd-9e5d-5109007f2228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddb813bcabed4f48a4db3bb0bb423fb3'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:54.347850 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-47dae321-1043-48fd-9e5d-5109007f2228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddb813bcabed4f48a4db3bb0bb423fb3'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:54.359027 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-47dae321-1043-48fd-9e5d-5109007f2228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddb813bcabed4f48a4db3bb0bb423fb3'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:54.359668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-47dae321-1043-48fd-9e5d-5109007f2228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddb813bcabed4f48a4db3bb0bb423fb3'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:54.367263 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-47dae321-1043-48fd-9e5d-5109007f2228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddb813bcabed4f48a4db3bb0bb423fb3'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:54.379187 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1417/2818] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:19:54 2021] DELETE /identity/v3/users/ddb813bcabed4f48a4db3bb0bb423fb3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:54.384406 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbeb39-f27d-4115-b017-229e5a1c64f9 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:54.384898 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbeb39-f27d-4115-b017-229e5a1c64f9 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:54.385008 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afbeb39-f27d-4115-b017-229e5a1c64f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:54.411262 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-7afbeb39-f27d-4115-b017-229e5a1c64f9 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:54.412449 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7afbeb39-f27d-4115-b017-229e5a1c64f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:54.468314 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1402/2819] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:54 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:54.478506 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dae321-1043-48fd-9e5d-5109007f2228 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:54.479896 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-47dae321-1043-48fd-9e5d-5109007f2228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:54.533864 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dae321-1043-48fd-9e5d-5109007f2228 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:54.538055 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385be96-6360-4143-bdc3-9fe984e7ec9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:54.538690 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385be96-6360-4143-bdc3-9fe984e7ec9e service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:54.538972 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385be96-6360-4143-bdc3-9fe984e7ec9e service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:54.539246 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385be96-6360-4143-bdc3-9fe984e7ec9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:54.547939 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385be96-6360-4143-bdc3-9fe984e7ec9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:54.549356 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385be96-6360-4143-bdc3-9fe984e7ec9e service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:54.559158 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1418/2820] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:19:54 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 17:19:54.815035 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afbeb39-f27d-4115-b017-229e5a1c64f9 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:54.816531 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7afbeb39-f27d-4115-b017-229e5a1c64f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:54.828492 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afbeb39-f27d-4115-b017-229e5a1c64f9 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:54.833264 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe8818-bef6-48f6-a306-aa26ff3639b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:54.834739 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe8818-bef6-48f6-a306-aa26ff3639b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:54.835017 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe8818-bef6-48f6-a306-aa26ff3639b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:54.835287 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe8818-bef6-48f6-a306-aa26ff3639b8 admin admin] PATH_INFO: `/v3/projects/ae19ef0b685e472fa9b8ef2ea65946c6` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:54.836479 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe8818-bef6-48f6-a306-aa26ff3639b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae19ef0b685e472fa9b8ef2ea65946c6)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:54.838404 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe8818-bef6-48f6-a306-aa26ff3639b8 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:54.883793 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-50fe8818-bef6-48f6-a306-aa26ff3639b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae19ef0b685e472fa9b8ef2ea65946c6', 'request_id': 'req-50fe8818-bef6-48f6-a306-aa26ff3639b8'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:54.889102 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-50fe8818-bef6-48f6-a306-aa26ff3639b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae19ef0b685e472fa9b8ef2ea65946c6', 'request_id': 'req-50fe8818-bef6-48f6-a306-aa26ff3639b8'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:54.896383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-50fe8818-bef6-48f6-a306-aa26ff3639b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae19ef0b685e472fa9b8ef2ea65946c6', 'request_id': 'req-50fe8818-bef6-48f6-a306-aa26ff3639b8'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:54.907542 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-50fe8818-bef6-48f6-a306-aa26ff3639b8 admin admin] The token cache is being invalidate because project ae19ef0b685e472fa9b8ef2ea65946c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:19:54.907809 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-50fe8818-bef6-48f6-a306-aa26ff3639b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:54.908433 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-50fe8818-bef6-48f6-a306-aa26ff3639b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:54.909967 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1403/2821] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:19:54 2021] DELETE /identity/v3/projects/ae19ef0b685e472fa9b8ef2ea65946c6 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:54.914435 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385be96-6360-4143-bdc3-9fe984e7ec9e service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:54.923656 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385be96-6360-4143-bdc3-9fe984e7ec9e service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:54.976276 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17971bf9-c444-436c-8f2a-069f1e5d21d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:54.977126 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17971bf9-c444-436c-8f2a-069f1e5d21d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:54.977399 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17971bf9-c444-436c-8f2a-069f1e5d21d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:54.977668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17971bf9-c444-436c-8f2a-069f1e5d21d4 admin admin] PATH_INFO: `/v3/users/3764260a957d4e279413f863473153e1` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:54.978872 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17971bf9-c444-436c-8f2a-069f1e5d21d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3764260a957d4e279413f863473153e1)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:54.980771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17971bf9-c444-436c-8f2a-069f1e5d21d4 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:55.024236 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-17971bf9-c444-436c-8f2a-069f1e5d21d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3764260a957d4e279413f863473153e1'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:55.024815 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-17971bf9-c444-436c-8f2a-069f1e5d21d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3764260a957d4e279413f863473153e1'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:55.036143 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-17971bf9-c444-436c-8f2a-069f1e5d21d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3764260a957d4e279413f863473153e1'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:55.036771 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-17971bf9-c444-436c-8f2a-069f1e5d21d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3764260a957d4e279413f863473153e1'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:55.044110 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-17971bf9-c444-436c-8f2a-069f1e5d21d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3764260a957d4e279413f863473153e1'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:55.055721 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1419/2822] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:19:54 2021] DELETE /identity/v3/users/3764260a957d4e279413f863473153e1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:55.315690 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe8818-bef6-48f6-a306-aa26ff3639b8 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:55.317141 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-50fe8818-bef6-48f6-a306-aa26ff3639b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:55.332308 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe8818-bef6-48f6-a306-aa26ff3639b8 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:55.388184 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6cf095-1974-479f-8675-bae9e660cf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:55.389035 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cf095-1974-479f-8675-bae9e660cf05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:55.389316 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cf095-1974-479f-8675-bae9e660cf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:55.389596 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6cf095-1974-479f-8675-bae9e660cf05 admin admin] PATH_INFO: `/v3/projects/b2270abcc85045eea812811bf0c607bb` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:55.390829 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6cf095-1974-479f-8675-bae9e660cf05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2270abcc85045eea812811bf0c607bb)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:55.392765 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6cf095-1974-479f-8675-bae9e660cf05 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:55.436061 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-2c6cf095-1974-479f-8675-bae9e660cf05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2270abcc85045eea812811bf0c607bb', 'request_id': 'req-2c6cf095-1974-479f-8675-bae9e660cf05'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:55.441434 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-2c6cf095-1974-479f-8675-bae9e660cf05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2270abcc85045eea812811bf0c607bb', 'request_id': 'req-2c6cf095-1974-479f-8675-bae9e660cf05'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:55.449743 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-2c6cf095-1974-479f-8675-bae9e660cf05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2270abcc85045eea812811bf0c607bb', 'request_id': 'req-2c6cf095-1974-479f-8675-bae9e660cf05'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:55.461061 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-2c6cf095-1974-479f-8675-bae9e660cf05 admin admin] The token cache is being invalidate because project b2270abcc85045eea812811bf0c607bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:19:55.461351 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-2c6cf095-1974-479f-8675-bae9e660cf05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:55.462043 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-2c6cf095-1974-479f-8675-bae9e660cf05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:55.463624 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1404/2823] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:19:55 2021] DELETE /identity/v3/projects/b2270abcc85045eea812811bf0c607bb => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:55.469237 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909ab16-2ee6-4973-8a35-b77a3da5febb None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:55.469726 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909ab16-2ee6-4973-8a35-b77a3da5febb None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:55.469835 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909ab16-2ee6-4973-8a35-b77a3da5febb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:55.487270 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-f909ab16-2ee6-4973-8a35-b77a3da5febb None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:55.488468 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-f909ab16-2ee6-4973-8a35-b77a3da5febb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:55.544836 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1420/2824] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:55.552564 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fcdc3-00fe-4c71-a80d-501dd2353faa None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:55.553358 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fcdc3-00fe-4c71-a80d-501dd2353faa None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:55.553632 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283fcdc3-00fe-4c71-a80d-501dd2353faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:55.572030 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-283fcdc3-00fe-4c71-a80d-501dd2353faa None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:55.573163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-283fcdc3-00fe-4c71-a80d-501dd2353faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:55.580951 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1405/2825] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:55.584954 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909ab16-2ee6-4973-8a35-b77a3da5febb None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:55.594149 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909ab16-2ee6-4973-8a35-b77a3da5febb None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:55.598666 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a538c48-f979-4b52-b30c-2e09caf132be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:55.599299 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a538c48-f979-4b52-b30c-2e09caf132be admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:55.599574 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a538c48-f979-4b52-b30c-2e09caf132be admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:55.599862 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a538c48-f979-4b52-b30c-2e09caf132be admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:55.600582 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a538c48-f979-4b52-b30c-2e09caf132be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 17:19:55.600905 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a538c48-f979-4b52-b30c-2e09caf132be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:55.602547 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a538c48-f979-4b52-b30c-2e09caf132be admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:55.613652 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1421/2826] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 17:19:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 17:19:55.618426 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fcdc3-00fe-4c71-a80d-501dd2353faa None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:55.627420 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283fcdc3-00fe-4c71-a80d-501dd2353faa None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:55.632740 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2548ec3-ad3b-496d-9697-c9a08cb81d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:55.633374 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2548ec3-ad3b-496d-9697-c9a08cb81d26 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:55.633659 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2548ec3-ad3b-496d-9697-c9a08cb81d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:55.633963 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2548ec3-ad3b-496d-9697-c9a08cb81d26 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:55.634686 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2548ec3-ad3b-496d-9697-c9a08cb81d26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:55.636577 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2548ec3-ad3b-496d-9697-c9a08cb81d26 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:55.662040 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1406/2827] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:19:55 2021] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:19:55.665814 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a538c48-f979-4b52-b30c-2e09caf132be admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:55.675592 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a538c48-f979-4b52-b30c-2e09caf132be admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:55.729312 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74591b-e035-466e-8731-9a0eb75aaa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:55.729990 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74591b-e035-466e-8731-9a0eb75aaa7c admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:55.730271 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74591b-e035-466e-8731-9a0eb75aaa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:55.730543 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c74591b-e035-466e-8731-9a0eb75aaa7c admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:55.731236 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74591b-e035-466e-8731-9a0eb75aaa7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:55.733165 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c74591b-e035-466e-8731-9a0eb75aaa7c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:55.755377 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1422/2828] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:19:55 2021] POST /identity/v3/users => generated 293 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:19:55.757178 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2548ec3-ad3b-496d-9697-c9a08cb81d26 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:55.767278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2548ec3-ad3b-496d-9697-c9a08cb81d26 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:55.771898 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3cd27-008f-4740-8d5b-fa4cc8b5759c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:55.772583 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3cd27-008f-4740-8d5b-fa4cc8b5759c admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:55.772865 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3cd27-008f-4740-8d5b-fa4cc8b5759c admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:55.773141 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3cd27-008f-4740-8d5b-fa4cc8b5759c admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:55.773885 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3cd27-008f-4740-8d5b-fa4cc8b5759c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:55.775493 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3cd27-008f-4740-8d5b-fa4cc8b5759c admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:55.785881 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1407/2829] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:55 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:19:55.789706 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74591b-e035-466e-8731-9a0eb75aaa7c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:55.800613 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c74591b-e035-466e-8731-9a0eb75aaa7c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:55.806476 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880760d7-224b-464d-b2b5-b4be1f9b61e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:55.807140 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880760d7-224b-464d-b2b5-b4be1f9b61e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:55.807423 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880760d7-224b-464d-b2b5-b4be1f9b61e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:55.807700 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880760d7-224b-464d-b2b5-b4be1f9b61e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:55.808434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880760d7-224b-464d-b2b5-b4be1f9b61e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:55.810061 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880760d7-224b-464d-b2b5-b4be1f9b61e1 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:55.820734 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1423/2830] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:55 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:19:55.825357 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3cd27-008f-4740-8d5b-fa4cc8b5759c admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:55.835442 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3cd27-008f-4740-8d5b-fa4cc8b5759c admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:55.840255 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dfde4-4e2f-4e77-b100-5d53c5f9d0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:55.841155 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dfde4-4e2f-4e77-b100-5d53c5f9d0e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:55.841464 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dfde4-4e2f-4e77-b100-5d53c5f9d0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:55.841747 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dfde4-4e2f-4e77-b100-5d53c5f9d0e1 admin admin] PATH_INFO: `/v3/projects/4a4ef430bcde4c549f4d73b5d73f35f2/users/901ccfe014f344a5a3b99e5911bd618d/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:55.856148 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dfde4-4e2f-4e77-b100-5d53c5f9d0e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a4ef430bcde4c549f4d73b5d73f35f2, user_id=901ccfe014f344a5a3b99e5911bd618d, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:55.858861 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dfde4-4e2f-4e77-b100-5d53c5f9d0e1 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:55.873145 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1408/2831] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:19:55 2021] PUT /identity/v3/projects/4a4ef430bcde4c549f4d73b5d73f35f2/users/901ccfe014f344a5a3b99e5911bd618d/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:55.884703 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119d61f-f2d9-4718-b9bd-231bb60494ae None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:55.884981 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119d61f-f2d9-4718-b9bd-231bb60494ae None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:55.885259 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119d61f-f2d9-4718-b9bd-231bb60494ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:55.910968 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-3119d61f-f2d9-4718-b9bd-231bb60494ae None None] MFA Rules not processed for user `901ccfe014f344a5a3b99e5911bd618d`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:55.912167 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-3119d61f-f2d9-4718-b9bd-231bb60494ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:55.974304 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1424/2832] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:55 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:55.979343 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dfde4-4e2f-4e77-b100-5d53c5f9d0e1 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:56.037067 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dfde4-4e2f-4e77-b100-5d53c5f9d0e1 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:56.042269 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21b119-d053-4061-a840-a2c62ae2aed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:56.042921 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21b119-d053-4061-a840-a2c62ae2aed6 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:56.043204 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21b119-d053-4061-a840-a2c62ae2aed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:56.043481 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21b119-d053-4061-a840-a2c62ae2aed6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:56.044198 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21b119-d053-4061-a840-a2c62ae2aed6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:56.046114 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e21b119-d053-4061-a840-a2c62ae2aed6 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:56.070437 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1409/2833] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:19:55 2021] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:19:56.074505 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119d61f-f2d9-4718-b9bd-231bb60494ae None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:56.084723 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119d61f-f2d9-4718-b9bd-231bb60494ae None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:56.138711 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64456a17-3194-4d41-b4fd-8dcc96af0ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:56.139360 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64456a17-3194-4d41-b4fd-8dcc96af0ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:56.139642 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64456a17-3194-4d41-b4fd-8dcc96af0ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:56.139919 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64456a17-3194-4d41-b4fd-8dcc96af0ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:56.140621 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64456a17-3194-4d41-b4fd-8dcc96af0ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:56.142578 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64456a17-3194-4d41-b4fd-8dcc96af0ec9 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:56.160849 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1425/2834] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:19:56 2021] POST /identity/v3/users => generated 300 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:19:56.165416 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21b119-d053-4061-a840-a2c62ae2aed6 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:56.175516 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21b119-d053-4061-a840-a2c62ae2aed6 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:56.180850 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796c16a-43b4-4454-9ce5-a4897d732d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:56.181494 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796c16a-43b4-4454-9ce5-a4897d732d7a admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:56.181777 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796c16a-43b4-4454-9ce5-a4897d732d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:56.182088 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9796c16a-43b4-4454-9ce5-a4897d732d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:56.182826 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796c16a-43b4-4454-9ce5-a4897d732d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:56.184415 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9796c16a-43b4-4454-9ce5-a4897d732d7a admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:56.194643 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1410/2835] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:56 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:19:56.198745 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64456a17-3194-4d41-b4fd-8dcc96af0ec9 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:56.208550 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64456a17-3194-4d41-b4fd-8dcc96af0ec9 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:56.213276 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f11fa9-c1f5-494f-a584-9f518ad3ff46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:56.214191 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f11fa9-c1f5-494f-a584-9f518ad3ff46 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:56.214472 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f11fa9-c1f5-494f-a584-9f518ad3ff46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:56.214750 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f11fa9-c1f5-494f-a584-9f518ad3ff46 admin admin] PATH_INFO: `/v3/projects/27b8e5c70904405fbafca74eecb263e7/users/0e9676c9202a4b54bfab381bc5d534d1/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:56.230163 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f11fa9-c1f5-494f-a584-9f518ad3ff46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b8e5c70904405fbafca74eecb263e7, user_id=0e9676c9202a4b54bfab381bc5d534d1, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:56.232833 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f11fa9-c1f5-494f-a584-9f518ad3ff46 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:56.245913 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1426/2836] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:19:56 2021] PUT /identity/v3/projects/27b8e5c70904405fbafca74eecb263e7/users/0e9676c9202a4b54bfab381bc5d534d1/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 17:19:56.249935 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796c16a-43b4-4454-9ce5-a4897d732d7a admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:56.259722 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9796c16a-43b4-4454-9ce5-a4897d732d7a admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:56.313070 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a880d-0f89-493d-a36b-a80caf421037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:56.313720 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a880d-0f89-493d-a36b-a80caf421037 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:56.314031 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a880d-0f89-493d-a36b-a80caf421037 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:56.314307 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a880d-0f89-493d-a36b-a80caf421037 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:56.315035 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a880d-0f89-493d-a36b-a80caf421037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:56.316606 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a880d-0f89-493d-a36b-a80caf421037 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:56.325973 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1411/2837] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:56 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:19:56.330104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f11fa9-c1f5-494f-a584-9f518ad3ff46 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:56.340502 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f11fa9-c1f5-494f-a584-9f518ad3ff46 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:56.345060 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404ad37-491f-49b2-a7ff-069efae02702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:56.345949 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404ad37-491f-49b2-a7ff-069efae02702 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:56.346232 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404ad37-491f-49b2-a7ff-069efae02702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:56.346504 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404ad37-491f-49b2-a7ff-069efae02702 admin admin] PATH_INFO: `/v3/projects/27b8e5c70904405fbafca74eecb263e7/users/0e9676c9202a4b54bfab381bc5d534d1/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:56.348444 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404ad37-491f-49b2-a7ff-069efae02702 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27b8e5c70904405fbafca74eecb263e7, user_id=0e9676c9202a4b54bfab381bc5d534d1, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:56.351679 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404ad37-491f-49b2-a7ff-069efae02702 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:56.361806 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1427/2838] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:19:56 2021] PUT /identity/v3/projects/27b8e5c70904405fbafca74eecb263e7/users/0e9676c9202a4b54bfab381bc5d534d1/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:56.371522 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9caa3-fb0a-4c0a-b851-53bff2206619 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:56.371813 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9caa3-fb0a-4c0a-b851-53bff2206619 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:56.372097 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9caa3-fb0a-4c0a-b851-53bff2206619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:56.397580 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-62b9caa3-fb0a-4c0a-b851-53bff2206619 None None] MFA Rules not processed for user `0e9676c9202a4b54bfab381bc5d534d1`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:56.398800 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-62b9caa3-fb0a-4c0a-b851-53bff2206619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:56.463000 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1412/2839] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:56 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:56.473309 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404ad37-491f-49b2-a7ff-069efae02702 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:56.475651 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-d404ad37-491f-49b2-a7ff-069efae02702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:56.530072 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404ad37-491f-49b2-a7ff-069efae02702 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:56.533718 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa262d7-d403-43ae-953a-302f200712d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:56.534389 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa262d7-d403-43ae-953a-302f200712d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:56.534671 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa262d7-d403-43ae-953a-302f200712d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:56.534946 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa262d7-d403-43ae-953a-302f200712d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:56.544272 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa262d7-d403-43ae-953a-302f200712d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:56.545700 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa262d7-d403-43ae-953a-302f200712d1 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:56.554934 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1428/2840] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:19:56 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:19:56.726370 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9caa3-fb0a-4c0a-b851-53bff2206619 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:56.787193 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9caa3-fb0a-4c0a-b851-53bff2206619 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:56.791731 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a85cd2-1de4-467c-afbe-e7b862eb73aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:56.792577 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a85cd2-1de4-467c-afbe-e7b862eb73aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:56.792857 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a85cd2-1de4-467c-afbe-e7b862eb73aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:56.793129 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a85cd2-1de4-467c-afbe-e7b862eb73aa admin admin] PATH_INFO: `/v3/users/901ccfe014f344a5a3b99e5911bd618d` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:56.794360 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a85cd2-1de4-467c-afbe-e7b862eb73aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=901ccfe014f344a5a3b99e5911bd618d)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:56.796248 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a85cd2-1de4-467c-afbe-e7b862eb73aa admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:56.842696 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a6a85cd2-1de4-467c-afbe-e7b862eb73aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '901ccfe014f344a5a3b99e5911bd618d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:56.849503 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a6a85cd2-1de4-467c-afbe-e7b862eb73aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '901ccfe014f344a5a3b99e5911bd618d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:56.856204 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a6a85cd2-1de4-467c-afbe-e7b862eb73aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '901ccfe014f344a5a3b99e5911bd618d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:56.856830 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a6a85cd2-1de4-467c-afbe-e7b862eb73aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '901ccfe014f344a5a3b99e5911bd618d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:56.868278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-a6a85cd2-1de4-467c-afbe-e7b862eb73aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '901ccfe014f344a5a3b99e5911bd618d'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:56.873938 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1413/2841] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:19:56 2021] DELETE /identity/v3/users/901ccfe014f344a5a3b99e5911bd618d => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 17:19:56.878561 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2aac4-1bb4-4f47-a542-83e34de1d1de None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:56.878851 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2aac4-1bb4-4f47-a542-83e34de1d1de None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:56.879131 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2aac4-1bb4-4f47-a542-83e34de1d1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:56.897197 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-06d2aac4-1bb4-4f47-a542-83e34de1d1de None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:56.898528 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-06d2aac4-1bb4-4f47-a542-83e34de1d1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:56.955665 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1429/2842] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:56.966534 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a85cd2-1de4-467c-afbe-e7b862eb73aa admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:56.967928 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a6a85cd2-1de4-467c-afbe-e7b862eb73aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:57.022992 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a85cd2-1de4-467c-afbe-e7b862eb73aa admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:57.026659 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96dc8fc-4695-4dbc-9e21-33ca36a0c5ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:57.027297 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dc8fc-4695-4dbc-9e21-33ca36a0c5ea service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:57.027581 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dc8fc-4695-4dbc-9e21-33ca36a0c5ea service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:57.027858 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dc8fc-4695-4dbc-9e21-33ca36a0c5ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:57.036625 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96dc8fc-4695-4dbc-9e21-33ca36a0c5ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:57.038081 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96dc8fc-4695-4dbc-9e21-33ca36a0c5ea service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:57.047239 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1414/2843] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:19:56 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:19:57.299963 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2aac4-1bb4-4f47-a542-83e34de1d1de None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:57.301535 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-06d2aac4-1bb4-4f47-a542-83e34de1d1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:57.314521 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d2aac4-1bb4-4f47-a542-83e34de1d1de None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:57.319766 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43f2d2-c146-4cb8-ab3f-c248690b3476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:57.320603 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43f2d2-c146-4cb8-ab3f-c248690b3476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:57.320883 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43f2d2-c146-4cb8-ab3f-c248690b3476 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:57.321286 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f43f2d2-c146-4cb8-ab3f-c248690b3476 admin admin] PATH_INFO: `/v3/projects/4a4ef430bcde4c549f4d73b5d73f35f2` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:57.322603 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43f2d2-c146-4cb8-ab3f-c248690b3476 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a4ef430bcde4c549f4d73b5d73f35f2)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:57.324437 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f43f2d2-c146-4cb8-ab3f-c248690b3476 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:57.368588 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8f43f2d2-c146-4cb8-ab3f-c248690b3476 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a4ef430bcde4c549f4d73b5d73f35f2', 'request_id': 'req-8f43f2d2-c146-4cb8-ab3f-c248690b3476'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:57.373797 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8f43f2d2-c146-4cb8-ab3f-c248690b3476 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a4ef430bcde4c549f4d73b5d73f35f2', 'request_id': 'req-8f43f2d2-c146-4cb8-ab3f-c248690b3476'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:57.380755 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8f43f2d2-c146-4cb8-ab3f-c248690b3476 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a4ef430bcde4c549f4d73b5d73f35f2', 'request_id': 'req-8f43f2d2-c146-4cb8-ab3f-c248690b3476'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:57.391962 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8f43f2d2-c146-4cb8-ab3f-c248690b3476 admin admin] The token cache is being invalidate because project 4a4ef430bcde4c549f4d73b5d73f35f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:19:57.392184 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8f43f2d2-c146-4cb8-ab3f-c248690b3476 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:57.392810 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8f43f2d2-c146-4cb8-ab3f-c248690b3476 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:57.394361 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1430/2844] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:19:57 2021] DELETE /identity/v3/projects/4a4ef430bcde4c549f4d73b5d73f35f2 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:57.398573 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96dc8fc-4695-4dbc-9e21-33ca36a0c5ea service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:57.408028 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96dc8fc-4695-4dbc-9e21-33ca36a0c5ea service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:57.461531 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759afbc-a17b-429b-a58d-c1e7b75f5aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:57.462444 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759afbc-a17b-429b-a58d-c1e7b75f5aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:57.462718 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759afbc-a17b-429b-a58d-c1e7b75f5aba admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:57.462997 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759afbc-a17b-429b-a58d-c1e7b75f5aba admin admin] PATH_INFO: `/v3/users/0e9676c9202a4b54bfab381bc5d534d1` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:57.464189 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759afbc-a17b-429b-a58d-c1e7b75f5aba admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e9676c9202a4b54bfab381bc5d534d1)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:57.466133 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759afbc-a17b-429b-a58d-c1e7b75f5aba admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:57.510076 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d759afbc-a17b-429b-a58d-c1e7b75f5aba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e9676c9202a4b54bfab381bc5d534d1'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:57.517339 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d759afbc-a17b-429b-a58d-c1e7b75f5aba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e9676c9202a4b54bfab381bc5d534d1'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:57.523957 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d759afbc-a17b-429b-a58d-c1e7b75f5aba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e9676c9202a4b54bfab381bc5d534d1'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:57.524586 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d759afbc-a17b-429b-a58d-c1e7b75f5aba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e9676c9202a4b54bfab381bc5d534d1'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:57.536045 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-d759afbc-a17b-429b-a58d-c1e7b75f5aba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e9676c9202a4b54bfab381bc5d534d1'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:57.542236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1415/2845] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:19:57 2021] DELETE /identity/v3/users/0e9676c9202a4b54bfab381bc5d534d1 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:57.801524 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43f2d2-c146-4cb8-ab3f-c248690b3476 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:57.803600 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-8f43f2d2-c146-4cb8-ab3f-c248690b3476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:57.820866 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f43f2d2-c146-4cb8-ab3f-c248690b3476 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:57.877006 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5812b9-a19e-499c-b339-f6fe0e2f3091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:57.877853 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5812b9-a19e-499c-b339-f6fe0e2f3091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:57.878156 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5812b9-a19e-499c-b339-f6fe0e2f3091 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:57.878424 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5812b9-a19e-499c-b339-f6fe0e2f3091 admin admin] PATH_INFO: `/v3/projects/27b8e5c70904405fbafca74eecb263e7` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:57.879590 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5812b9-a19e-499c-b339-f6fe0e2f3091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27b8e5c70904405fbafca74eecb263e7)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:57.881472 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5812b9-a19e-499c-b339-f6fe0e2f3091 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:57.925625 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5f5812b9-a19e-499c-b339-f6fe0e2f3091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27b8e5c70904405fbafca74eecb263e7', 'request_id': 'req-5f5812b9-a19e-499c-b339-f6fe0e2f3091'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:57.930787 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5f5812b9-a19e-499c-b339-f6fe0e2f3091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27b8e5c70904405fbafca74eecb263e7', 'request_id': 'req-5f5812b9-a19e-499c-b339-f6fe0e2f3091'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:57.937297 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5f5812b9-a19e-499c-b339-f6fe0e2f3091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27b8e5c70904405fbafca74eecb263e7', 'request_id': 'req-5f5812b9-a19e-499c-b339-f6fe0e2f3091'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:57.947631 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5f5812b9-a19e-499c-b339-f6fe0e2f3091 admin admin] The token cache is being invalidate because project 27b8e5c70904405fbafca74eecb263e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:19:57.947911 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5f5812b9-a19e-499c-b339-f6fe0e2f3091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:57.948524 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-5f5812b9-a19e-499c-b339-f6fe0e2f3091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:57.950067 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1431/2846] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:19:57 2021] DELETE /identity/v3/projects/27b8e5c70904405fbafca74eecb263e7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:57.955656 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41512b5a-642c-4fc3-8e18-c69dc8eb72ae None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:57.955948 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41512b5a-642c-4fc3-8e18-c69dc8eb72ae None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:57.956225 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41512b5a-642c-4fc3-8e18-c69dc8eb72ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:57.973741 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-41512b5a-642c-4fc3-8e18-c69dc8eb72ae None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:57.975597 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-41512b5a-642c-4fc3-8e18-c69dc8eb72ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:58.030853 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1416/2847] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:58.039180 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926a868-ded2-4708-a037-653702e56c24 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:58.039467 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926a868-ded2-4708-a037-653702e56c24 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:58.039740 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926a868-ded2-4708-a037-653702e56c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:58.057153 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-9926a868-ded2-4708-a037-653702e56c24 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:58.058384 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-9926a868-ded2-4708-a037-653702e56c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:58.066073 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1432/2848] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:58.070033 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41512b5a-642c-4fc3-8e18-c69dc8eb72ae None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:58.079287 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41512b5a-642c-4fc3-8e18-c69dc8eb72ae None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:58.083821 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e007fd-34c8-49c5-8a4c-212cd88f80c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:58.084970 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e007fd-34c8-49c5-8a4c-212cd88f80c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:58.085250 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e007fd-34c8-49c5-8a4c-212cd88f80c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:58.085521 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e007fd-34c8-49c5-8a4c-212cd88f80c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:58.086287 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e007fd-34c8-49c5-8a4c-212cd88f80c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 17:19:58.086593 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e007fd-34c8-49c5-8a4c-212cd88f80c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:58.088166 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e007fd-34c8-49c5-8a4c-212cd88f80c5 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:58.100291 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1417/2849] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 17:19:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 17:19:58.104203 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926a868-ded2-4708-a037-653702e56c24 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:58.113439 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926a868-ded2-4708-a037-653702e56c24 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:58.118135 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e4885-9bf2-493e-9352-7f5d2f7d23f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:58.118780 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e4885-9bf2-493e-9352-7f5d2f7d23f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:58.119059 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e4885-9bf2-493e-9352-7f5d2f7d23f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:58.119333 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354e4885-9bf2-493e-9352-7f5d2f7d23f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:58.120038 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e4885-9bf2-493e-9352-7f5d2f7d23f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:58.121964 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354e4885-9bf2-493e-9352-7f5d2f7d23f0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:58.149372 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1433/2850] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:19:58 2021] POST /identity/v3/projects => generated 387 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:19:58.152424 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e007fd-34c8-49c5-8a4c-212cd88f80c5 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:58.162981 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e007fd-34c8-49c5-8a4c-212cd88f80c5 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:58.218370 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5ffba-dfe6-4d04-87d9-80b22a6bd7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:58.218954 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5ffba-dfe6-4d04-87d9-80b22a6bd7cf admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:58.219236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5ffba-dfe6-4d04-87d9-80b22a6bd7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:58.219512 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5ffba-dfe6-4d04-87d9-80b22a6bd7cf admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:58.220208 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5ffba-dfe6-4d04-87d9-80b22a6bd7cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:58.222136 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5ffba-dfe6-4d04-87d9-80b22a6bd7cf admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:58.240899 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1418/2851] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:19:58 2021] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:19:58.245081 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e4885-9bf2-493e-9352-7f5d2f7d23f0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:58.255285 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354e4885-9bf2-493e-9352-7f5d2f7d23f0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:58.260318 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829814f-fe9e-4977-88be-504dae39bb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:58.260970 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829814f-fe9e-4977-88be-504dae39bb2b admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:58.261253 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829814f-fe9e-4977-88be-504dae39bb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:58.261530 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a829814f-fe9e-4977-88be-504dae39bb2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:58.262316 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829814f-fe9e-4977-88be-504dae39bb2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:58.263917 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a829814f-fe9e-4977-88be-504dae39bb2b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:58.274721 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1434/2852] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 17:19:58.278525 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5ffba-dfe6-4d04-87d9-80b22a6bd7cf admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:58.288259 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5ffba-dfe6-4d04-87d9-80b22a6bd7cf admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:58.292778 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce46e5f-4be2-4258-baf2-65935633dc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:58.293420 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce46e5f-4be2-4258-baf2-65935633dc2d admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:58.293702 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce46e5f-4be2-4258-baf2-65935633dc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:58.294011 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce46e5f-4be2-4258-baf2-65935633dc2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:58.294745 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce46e5f-4be2-4258-baf2-65935633dc2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:58.296327 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce46e5f-4be2-4258-baf2-65935633dc2d admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:58.305852 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1419/2853] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:58 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:19:58.309580 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829814f-fe9e-4977-88be-504dae39bb2b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:58.319738 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a829814f-fe9e-4977-88be-504dae39bb2b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:58.324319 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11180d60-dce7-4c2b-99cb-a21c85a21814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:58.325179 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11180d60-dce7-4c2b-99cb-a21c85a21814 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:58.325463 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11180d60-dce7-4c2b-99cb-a21c85a21814 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:58.325739 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11180d60-dce7-4c2b-99cb-a21c85a21814 admin admin] PATH_INFO: `/v3/projects/067f1e8a1b224616896d03fbd48f6363/users/e91d090342f34aa68d6d863d6e1e0f47/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:58.340231 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11180d60-dce7-4c2b-99cb-a21c85a21814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=067f1e8a1b224616896d03fbd48f6363, user_id=e91d090342f34aa68d6d863d6e1e0f47, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:58.342992 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11180d60-dce7-4c2b-99cb-a21c85a21814 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:58.355135 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1435/2854] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:19:58 2021] PUT /identity/v3/projects/067f1e8a1b224616896d03fbd48f6363/users/e91d090342f34aa68d6d863d6e1e0f47/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 17:19:58.366443 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9f14d-2353-4287-b1fd-d5fdbfe75c6f None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:58.366732 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9f14d-2353-4287-b1fd-d5fdbfe75c6f None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:58.367015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9f14d-2353-4287-b1fd-d5fdbfe75c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:58.392637 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-5ef9f14d-2353-4287-b1fd-d5fdbfe75c6f None None] MFA Rules not processed for user `e91d090342f34aa68d6d863d6e1e0f47`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:58.394044 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-5ef9f14d-2353-4287-b1fd-d5fdbfe75c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:58.456256 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1420/2855] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:58 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:58.461317 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11180d60-dce7-4c2b-99cb-a21c85a21814 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:58.521258 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11180d60-dce7-4c2b-99cb-a21c85a21814 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:58.526485 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a7bde-3f4e-4bf8-894e-a03f2f587d3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:58.527135 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a7bde-3f4e-4bf8-894e-a03f2f587d3b admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:58.527416 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a7bde-3f4e-4bf8-894e-a03f2f587d3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:58.527690 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a7bde-3f4e-4bf8-894e-a03f2f587d3b admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:58.528416 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a7bde-3f4e-4bf8-894e-a03f2f587d3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:58.530329 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71a7bde-3f4e-4bf8-894e-a03f2f587d3b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:58.555177 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1436/2856] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:19:58 2021] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:19:58.559219 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9f14d-2353-4287-b1fd-d5fdbfe75c6f None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:58.570046 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9f14d-2353-4287-b1fd-d5fdbfe75c6f None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:58.624445 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83d473-2bed-4a78-a2d1-4fe85cea2546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:58.625111 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83d473-2bed-4a78-a2d1-4fe85cea2546 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:58.625391 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83d473-2bed-4a78-a2d1-4fe85cea2546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:58.625669 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83d473-2bed-4a78-a2d1-4fe85cea2546 admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:58.626419 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83d473-2bed-4a78-a2d1-4fe85cea2546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:58.628329 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf83d473-2bed-4a78-a2d1-4fe85cea2546 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:58.648276 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1421/2857] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:19:58 2021] POST /identity/v3/users => generated 301 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:19:58.652105 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a7bde-3f4e-4bf8-894e-a03f2f587d3b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:58.662103 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71a7bde-3f4e-4bf8-894e-a03f2f587d3b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:58.666630 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125c0f5-5f03-44df-81f3-06868405b407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:58.667269 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125c0f5-5f03-44df-81f3-06868405b407 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:58.667548 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125c0f5-5f03-44df-81f3-06868405b407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:58.667817 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125c0f5-5f03-44df-81f3-06868405b407 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:58.668539 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125c0f5-5f03-44df-81f3-06868405b407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:58.670147 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125c0f5-5f03-44df-81f3-06868405b407 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:58.680083 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1437/2858] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:58 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 17:19:58.684020 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83d473-2bed-4a78-a2d1-4fe85cea2546 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:58.694423 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf83d473-2bed-4a78-a2d1-4fe85cea2546 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:58.699238 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047a5cb-3d94-4812-b624-5a53e24315a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:58.700102 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047a5cb-3d94-4812-b624-5a53e24315a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:58.700383 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047a5cb-3d94-4812-b624-5a53e24315a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:58.700657 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047a5cb-3d94-4812-b624-5a53e24315a8 admin admin] PATH_INFO: `/v3/projects/2461cc6ff293413d83576ec40cd49f55/users/fde73b644f26481b9ddc1c8947a38cae/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:58.715165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047a5cb-3d94-4812-b624-5a53e24315a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2461cc6ff293413d83576ec40cd49f55, user_id=fde73b644f26481b9ddc1c8947a38cae, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:58.717824 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047a5cb-3d94-4812-b624-5a53e24315a8 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:58.729742 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1422/2859] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:19:58 2021] PUT /identity/v3/projects/2461cc6ff293413d83576ec40cd49f55/users/fde73b644f26481b9ddc1c8947a38cae/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:58.733538 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125c0f5-5f03-44df-81f3-06868405b407 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:58.743832 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125c0f5-5f03-44df-81f3-06868405b407 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:58.797742 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dbc135-e6e7-4f75-930c-ddc64567bd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:58.798440 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbc135-e6e7-4f75-930c-ddc64567bd73 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:58.798738 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbc135-e6e7-4f75-930c-ddc64567bd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:58.798996 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dbc135-e6e7-4f75-930c-ddc64567bd73 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:58.799726 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbc135-e6e7-4f75-930c-ddc64567bd73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:58.801329 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dbc135-e6e7-4f75-930c-ddc64567bd73 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:58.811357 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1438/2860] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:19:58 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:19:58.815485 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047a5cb-3d94-4812-b624-5a53e24315a8 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:58.826041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047a5cb-3d94-4812-b624-5a53e24315a8 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:58.830899 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fa56e-9e4b-4adc-a54c-02141ef4887e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:58.831770 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fa56e-9e4b-4adc-a54c-02141ef4887e admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:58.832049 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fa56e-9e4b-4adc-a54c-02141ef4887e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:58.832322 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691fa56e-9e4b-4adc-a54c-02141ef4887e admin admin] PATH_INFO: `/v3/projects/2461cc6ff293413d83576ec40cd49f55/users/fde73b644f26481b9ddc1c8947a38cae/roles/f28d3f93a0524078a592a15459808378` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:58.834328 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fa56e-9e4b-4adc-a54c-02141ef4887e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2461cc6ff293413d83576ec40cd49f55, user_id=fde73b644f26481b9ddc1c8947a38cae, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:58.836977 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691fa56e-9e4b-4adc-a54c-02141ef4887e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:58.847015 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1423/2861] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:19:58 2021] PUT /identity/v3/projects/2461cc6ff293413d83576ec40cd49f55/users/fde73b644f26481b9ddc1c8947a38cae/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:58.856751 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb091346-fd0b-4c92-b520-a1a58dddb5a5 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:58.857043 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb091346-fd0b-4c92-b520-a1a58dddb5a5 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:58.857324 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb091346-fd0b-4c92-b520-a1a58dddb5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:58.884082 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-bb091346-fd0b-4c92-b520-a1a58dddb5a5 None None] MFA Rules not processed for user `fde73b644f26481b9ddc1c8947a38cae`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:58.885288 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-bb091346-fd0b-4c92-b520-a1a58dddb5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:58.951099 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1439/2862] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:58 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:19:58.960750 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fa56e-9e4b-4adc-a54c-02141ef4887e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:58.962519 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-691fa56e-9e4b-4adc-a54c-02141ef4887e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:59.017331 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691fa56e-9e4b-4adc-a54c-02141ef4887e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:59.021089 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25cca2a-c664-4575-bab2-1340ecea480a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:59.021767 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cca2a-c664-4575-bab2-1340ecea480a service cinder] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:59.022083 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cca2a-c664-4575-bab2-1340ecea480a service cinder] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:59.022358 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25cca2a-c664-4575-bab2-1340ecea480a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:59.032022 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25cca2a-c664-4575-bab2-1340ecea480a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:59.033043 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25cca2a-c664-4575-bab2-1340ecea480a service cinder] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:59.043174 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1424/2863] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:19:58 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:19:59.159636 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb091346-fd0b-4c92-b520-a1a58dddb5a5 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:59.220070 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb091346-fd0b-4c92-b520-a1a58dddb5a5 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:59.225135 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646816a-2a81-40ce-bb40-7b10c6a652e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:59.226013 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646816a-2a81-40ce-bb40-7b10c6a652e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:59.226288 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646816a-2a81-40ce-bb40-7b10c6a652e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:59.226553 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646816a-2a81-40ce-bb40-7b10c6a652e9 admin admin] PATH_INFO: `/v3/users/e91d090342f34aa68d6d863d6e1e0f47` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:59.227720 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646816a-2a81-40ce-bb40-7b10c6a652e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e91d090342f34aa68d6d863d6e1e0f47)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:59.229624 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646816a-2a81-40ce-bb40-7b10c6a652e9 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:59.272782 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7646816a-2a81-40ce-bb40-7b10c6a652e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e91d090342f34aa68d6d863d6e1e0f47'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:59.273454 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7646816a-2a81-40ce-bb40-7b10c6a652e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e91d090342f34aa68d6d863d6e1e0f47'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:59.284882 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7646816a-2a81-40ce-bb40-7b10c6a652e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e91d090342f34aa68d6d863d6e1e0f47'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:59.285479 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7646816a-2a81-40ce-bb40-7b10c6a652e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e91d090342f34aa68d6d863d6e1e0f47'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:59.292986 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-7646816a-2a81-40ce-bb40-7b10c6a652e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e91d090342f34aa68d6d863d6e1e0f47'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:59.305860 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1440/2864] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:19:59 2021] DELETE /identity/v3/users/e91d090342f34aa68d6d863d6e1e0f47 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:59.310530 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22db712-2b14-45aa-aab0-c8e5f089a7d0 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:59.310819 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22db712-2b14-45aa-aab0-c8e5f089a7d0 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:59.311123 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22db712-2b14-45aa-aab0-c8e5f089a7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:59.328047 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-a22db712-2b14-45aa-aab0-c8e5f089a7d0 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:19:59.329233 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a22db712-2b14-45aa-aab0-c8e5f089a7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:59.386043 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1425/2865] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:19:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 17:19:59.395923 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646816a-2a81-40ce-bb40-7b10c6a652e9 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:59.397889 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-7646816a-2a81-40ce-bb40-7b10c6a652e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:59.452895 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646816a-2a81-40ce-bb40-7b10c6a652e9 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:59.456545 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4324901-096d-462d-a093-eb669ebfdc27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:59.457184 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4324901-096d-462d-a093-eb669ebfdc27 service neutron] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:59.457469 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4324901-096d-462d-a093-eb669ebfdc27 service neutron] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:59.457744 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4324901-096d-462d-a093-eb669ebfdc27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:59.467354 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4324901-096d-462d-a093-eb669ebfdc27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:59.468825 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4324901-096d-462d-a093-eb669ebfdc27 service neutron] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:59.479015 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1441/2866] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:19:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:19:59.734895 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22db712-2b14-45aa-aab0-c8e5f089a7d0 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:59.736318 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-a22db712-2b14-45aa-aab0-c8e5f089a7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:19:59.748564 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22db712-2b14-45aa-aab0-c8e5f089a7d0 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:59.753634 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59025b13-8035-4754-8b73-0a223a43f087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:59.754529 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59025b13-8035-4754-8b73-0a223a43f087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:59.755194 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59025b13-8035-4754-8b73-0a223a43f087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:59.755194 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59025b13-8035-4754-8b73-0a223a43f087 admin admin] PATH_INFO: `/v3/projects/067f1e8a1b224616896d03fbd48f6363` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:59.756762 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59025b13-8035-4754-8b73-0a223a43f087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=067f1e8a1b224616896d03fbd48f6363)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:59.758697 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59025b13-8035-4754-8b73-0a223a43f087 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:59.803036 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-59025b13-8035-4754-8b73-0a223a43f087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067f1e8a1b224616896d03fbd48f6363', 'request_id': 'req-59025b13-8035-4754-8b73-0a223a43f087'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:59.808340 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-59025b13-8035-4754-8b73-0a223a43f087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067f1e8a1b224616896d03fbd48f6363', 'request_id': 'req-59025b13-8035-4754-8b73-0a223a43f087'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:59.815095 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-59025b13-8035-4754-8b73-0a223a43f087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067f1e8a1b224616896d03fbd48f6363', 'request_id': 'req-59025b13-8035-4754-8b73-0a223a43f087'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:59.826197 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-59025b13-8035-4754-8b73-0a223a43f087 admin admin] The token cache is being invalidate because project 067f1e8a1b224616896d03fbd48f6363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:19:59.826485 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-59025b13-8035-4754-8b73-0a223a43f087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:59.827099 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-59025b13-8035-4754-8b73-0a223a43f087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:59.828618 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1426/2867] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:19:59 2021] DELETE /identity/v3/projects/067f1e8a1b224616896d03fbd48f6363 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:19:59.832582 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4324901-096d-462d-a093-eb669ebfdc27 service neutron] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:19:59.842901 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4324901-096d-462d-a093-eb669ebfdc27 service neutron] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:19:59.900859 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335b4143-c953-48f9-9cc8-e09e5a1d79aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:19:59.901690 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b4143-c953-48f9-9cc8-e09e5a1d79aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:19:59.901996 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b4143-c953-48f9-9cc8-e09e5a1d79aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:19:59.902274 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335b4143-c953-48f9-9cc8-e09e5a1d79aa admin admin] PATH_INFO: `/v3/users/fde73b644f26481b9ddc1c8947a38cae` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:19:59.903464 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b4143-c953-48f9-9cc8-e09e5a1d79aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde73b644f26481b9ddc1c8947a38cae)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:19:59.905376 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335b4143-c953-48f9-9cc8-e09e5a1d79aa admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:19:59.949877 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-335b4143-c953-48f9-9cc8-e09e5a1d79aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde73b644f26481b9ddc1c8947a38cae'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:59.950619 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-335b4143-c953-48f9-9cc8-e09e5a1d79aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde73b644f26481b9ddc1c8947a38cae'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:59.962423 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-335b4143-c953-48f9-9cc8-e09e5a1d79aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde73b644f26481b9ddc1c8947a38cae'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:59.963066 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-335b4143-c953-48f9-9cc8-e09e5a1d79aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde73b644f26481b9ddc1c8947a38cae'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:59.970034 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-335b4143-c953-48f9-9cc8-e09e5a1d79aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde73b644f26481b9ddc1c8947a38cae'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:19:59.981717 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1442/2868] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:19:59 2021] DELETE /identity/v3/users/fde73b644f26481b9ddc1c8947a38cae => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 17:20:00.235904 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59025b13-8035-4754-8b73-0a223a43f087 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:00.237591 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-59025b13-8035-4754-8b73-0a223a43f087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:20:00.250825 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59025b13-8035-4754-8b73-0a223a43f087 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:00.306491 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97f557d-0ff7-4c1f-b6e7-3755266bd963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:00.307523 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f557d-0ff7-4c1f-b6e7-3755266bd963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:00.307846 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f557d-0ff7-4c1f-b6e7-3755266bd963 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:00.308157 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97f557d-0ff7-4c1f-b6e7-3755266bd963 admin admin] PATH_INFO: `/v3/projects/2461cc6ff293413d83576ec40cd49f55` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:00.309355 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f557d-0ff7-4c1f-b6e7-3755266bd963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2461cc6ff293413d83576ec40cd49f55)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:00.311310 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97f557d-0ff7-4c1f-b6e7-3755266bd963 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:00.354740 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f97f557d-0ff7-4c1f-b6e7-3755266bd963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2461cc6ff293413d83576ec40cd49f55', 'request_id': 'req-f97f557d-0ff7-4c1f-b6e7-3755266bd963'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:00.360042 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f97f557d-0ff7-4c1f-b6e7-3755266bd963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2461cc6ff293413d83576ec40cd49f55', 'request_id': 'req-f97f557d-0ff7-4c1f-b6e7-3755266bd963'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:00.367653 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f97f557d-0ff7-4c1f-b6e7-3755266bd963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2461cc6ff293413d83576ec40cd49f55', 'request_id': 'req-f97f557d-0ff7-4c1f-b6e7-3755266bd963'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:00.378041 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f97f557d-0ff7-4c1f-b6e7-3755266bd963 admin admin] The token cache is being invalidate because project 2461cc6ff293413d83576ec40cd49f55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79610) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:20:00.378332 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f97f557d-0ff7-4c1f-b6e7-3755266bd963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:00.378951 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-f97f557d-0ff7-4c1f-b6e7-3755266bd963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:00.380448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1427/2869] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:20:00 2021] DELETE /identity/v3/projects/2461cc6ff293413d83576ec40cd49f55 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:20:00.386663 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187c480-7b66-4296-878f-344b93cbea7c None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:00.386955 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187c480-7b66-4296-878f-344b93cbea7c None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:00.387262 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e187c480-7b66-4296-878f-344b93cbea7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:00.405123 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-e187c480-7b66-4296-878f-344b93cbea7c None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:20:00.406347 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-e187c480-7b66-4296-878f-344b93cbea7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:20:00.461015 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1443/2870] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:20:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:20:00.468580 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17247c-9c54-446f-9bb7-2e6ff08f5974 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:00.468871 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17247c-9c54-446f-9bb7-2e6ff08f5974 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:00.469149 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b17247c-9c54-446f-9bb7-2e6ff08f5974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:00.487536 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-7b17247c-9c54-446f-9bb7-2e6ff08f5974 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:20:00.488721 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-7b17247c-9c54-446f-9bb7-2e6ff08f5974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:20:00.497097 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1428/2871] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:20:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:20:00.501018 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187c480-7b66-4296-878f-344b93cbea7c None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:00.510296 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e187c480-7b66-4296-878f-344b93cbea7c None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:00.514756 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe0bbc-3cd2-4465-b9bd-6e1b3c2265e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:00.515395 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe0bbc-3cd2-4465-b9bd-6e1b3c2265e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:00.515671 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe0bbc-3cd2-4465-b9bd-6e1b3c2265e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:00.515938 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fe0bbc-3cd2-4465-b9bd-6e1b3c2265e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:00.516660 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe0bbc-3cd2-4465-b9bd-6e1b3c2265e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79609) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 17:20:00.516959 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe0bbc-3cd2-4465-b9bd-6e1b3c2265e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:00.518594 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fe0bbc-3cd2-4465-b9bd-6e1b3c2265e0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:00.529549 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1444/2872] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 17:20:00 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 17:20:00.533533 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17247c-9c54-446f-9bb7-2e6ff08f5974 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:00.542947 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b17247c-9c54-446f-9bb7-2e6ff08f5974 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:00.547531 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9fb56-3645-4df7-991f-9ccf2a97ad12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:00.548165 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9fb56-3645-4df7-991f-9ccf2a97ad12 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:00.548446 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9fb56-3645-4df7-991f-9ccf2a97ad12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:00.548722 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9fb56-3645-4df7-991f-9ccf2a97ad12 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:00.549429 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9fb56-3645-4df7-991f-9ccf2a97ad12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:00.551344 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9fb56-3645-4df7-991f-9ccf2a97ad12 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:00.576179 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1429/2873] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:20:00 2021] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:20:00.580161 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe0bbc-3cd2-4465-b9bd-6e1b3c2265e0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:00.589635 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fe0bbc-3cd2-4465-b9bd-6e1b3c2265e0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:00.642544 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ef3da-1361-4a2d-b8bd-410332a1b07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:00.643124 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ef3da-1361-4a2d-b8bd-410332a1b07b admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:00.643405 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ef3da-1361-4a2d-b8bd-410332a1b07b admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:00.643675 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70ef3da-1361-4a2d-b8bd-410332a1b07b admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:00.644363 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ef3da-1361-4a2d-b8bd-410332a1b07b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:00.646280 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70ef3da-1361-4a2d-b8bd-410332a1b07b admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:00.665722 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1445/2874] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:20:00 2021] POST /identity/v3/users => generated 293 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:20:00.669249 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9fb56-3645-4df7-991f-9ccf2a97ad12 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:00.679801 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9fb56-3645-4df7-991f-9ccf2a97ad12 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:00.684365 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42db18a-f8a8-4427-9a2d-1a9e135b1b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:00.685012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42db18a-f8a8-4427-9a2d-1a9e135b1b19 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:00.685297 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42db18a-f8a8-4427-9a2d-1a9e135b1b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:00.685575 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42db18a-f8a8-4427-9a2d-1a9e135b1b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:00.686352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42db18a-f8a8-4427-9a2d-1a9e135b1b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:00.687938 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42db18a-f8a8-4427-9a2d-1a9e135b1b19 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:00.698128 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1430/2875] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:20:00 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:20:00.701969 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ef3da-1361-4a2d-b8bd-410332a1b07b admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:00.711882 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70ef3da-1361-4a2d-b8bd-410332a1b07b admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:00.716468 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b540635-ed2d-4098-9a86-67bf7bebe3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:00.717112 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b540635-ed2d-4098-9a86-67bf7bebe3ff admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:00.717394 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b540635-ed2d-4098-9a86-67bf7bebe3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:00.717668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b540635-ed2d-4098-9a86-67bf7bebe3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:00.718424 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b540635-ed2d-4098-9a86-67bf7bebe3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:00.720023 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b540635-ed2d-4098-9a86-67bf7bebe3ff admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:00.732118 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1446/2876] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:20:00 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:20:00.736073 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42db18a-f8a8-4427-9a2d-1a9e135b1b19 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:00.746729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42db18a-f8a8-4427-9a2d-1a9e135b1b19 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:00.751631 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a0bbf-5ebc-4e1b-8954-1c5499bc4e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:00.752537 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a0bbf-5ebc-4e1b-8954-1c5499bc4e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:00.752822 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a0bbf-5ebc-4e1b-8954-1c5499bc4e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:00.753101 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a0bbf-5ebc-4e1b-8954-1c5499bc4e7f admin admin] PATH_INFO: `/v3/projects/62aaafd66ba84ba9b605b19094ac6820/users/b56e2fc2bbe948baaadc90ef8d156ad3/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:00.767496 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a0bbf-5ebc-4e1b-8954-1c5499bc4e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=62aaafd66ba84ba9b605b19094ac6820, user_id=b56e2fc2bbe948baaadc90ef8d156ad3, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:00.770405 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a0bbf-5ebc-4e1b-8954-1c5499bc4e7f admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:00.783674 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1431/2877] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:20:00 2021] PUT /identity/v3/projects/62aaafd66ba84ba9b605b19094ac6820/users/b56e2fc2bbe948baaadc90ef8d156ad3/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 17:20:00.795226 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c075c-c11c-4d4a-8a3b-a8a7c581cc57 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:00.795511 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c075c-c11c-4d4a-8a3b-a8a7c581cc57 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:00.795783 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c075c-c11c-4d4a-8a3b-a8a7c581cc57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:00.821360 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-c01c075c-c11c-4d4a-8a3b-a8a7c581cc57 None None] MFA Rules not processed for user `b56e2fc2bbe948baaadc90ef8d156ad3`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:20:00.822590 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c01c075c-c11c-4d4a-8a3b-a8a7c581cc57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:20:00.883395 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1447/2878] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:20:00 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:20:00.887819 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a0bbf-5ebc-4e1b-8954-1c5499bc4e7f admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:00.946902 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a0bbf-5ebc-4e1b-8954-1c5499bc4e7f admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:00.951415 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5fd5a-d271-49bb-86c2-5611fe606762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:00.952062 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5fd5a-d271-49bb-86c2-5611fe606762 admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:00.952344 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5fd5a-d271-49bb-86c2-5611fe606762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:00.952620 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc5fd5a-d271-49bb-86c2-5611fe606762 admin admin] PATH_INFO: `/v3/projects` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:00.953330 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5fd5a-d271-49bb-86c2-5611fe606762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:00.955352 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc5fd5a-d271-49bb-86c2-5611fe606762 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:00.979978 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1432/2879] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:20:00 2021] POST /identity/v3/projects => generated 387 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:20:00.983960 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c075c-c11c-4d4a-8a3b-a8a7c581cc57 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:00.994637 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c075c-c11c-4d4a-8a3b-a8a7c581cc57 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:01.047507 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad907d7b-4869-4b8f-8232-108eea191e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:01.048200 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad907d7b-4869-4b8f-8232-108eea191e0d admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:01.048486 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad907d7b-4869-4b8f-8232-108eea191e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:01.048763 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad907d7b-4869-4b8f-8232-108eea191e0d admin admin] PATH_INFO: `/v3/users` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:01.049457 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad907d7b-4869-4b8f-8232-108eea191e0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:01.051399 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad907d7b-4869-4b8f-8232-108eea191e0d admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:01.069220 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1448/2880] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:20:00 2021] POST /identity/v3/users => generated 300 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 29 17:20:01.073120 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5fd5a-d271-49bb-86c2-5611fe606762 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:01.083185 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc5fd5a-d271-49bb-86c2-5611fe606762 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:01.088232 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb129631-27cf-4361-b786-8fbbb9cb01dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:01.088878 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb129631-27cf-4361-b786-8fbbb9cb01dd admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:01.089160 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb129631-27cf-4361-b786-8fbbb9cb01dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:01.089440 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb129631-27cf-4361-b786-8fbbb9cb01dd admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:01.090203 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb129631-27cf-4361-b786-8fbbb9cb01dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:01.091782 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb129631-27cf-4361-b786-8fbbb9cb01dd admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:01.102728 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1433/2881] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:20:01 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:20:01.106847 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad907d7b-4869-4b8f-8232-108eea191e0d admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:01.116765 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad907d7b-4869-4b8f-8232-108eea191e0d admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:01.121343 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd3be1-5f4e-4f49-9f31-1ab8bf6b58b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:01.122238 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd3be1-5f4e-4f49-9f31-1ab8bf6b58b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:01.122527 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd3be1-5f4e-4f49-9f31-1ab8bf6b58b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:01.122800 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd3be1-5f4e-4f49-9f31-1ab8bf6b58b8 admin admin] PATH_INFO: `/v3/projects/403342b20be14233936173032766b4f6/users/ac33a910fd67483d812331c5832f332f/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:01.136752 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd3be1-5f4e-4f49-9f31-1ab8bf6b58b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=403342b20be14233936173032766b4f6, user_id=ac33a910fd67483d812331c5832f332f, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:01.139422 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd3be1-5f4e-4f49-9f31-1ab8bf6b58b8 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:01.152314 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1449/2882] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:20:01 2021] PUT /identity/v3/projects/403342b20be14233936173032766b4f6/users/ac33a910fd67483d812331c5832f332f/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:20:01.156278 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb129631-27cf-4361-b786-8fbbb9cb01dd admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:01.166598 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb129631-27cf-4361-b786-8fbbb9cb01dd admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:01.220554 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c6b5d-e5a6-4386-89f5-c8714b212f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:01.221141 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c6b5d-e5a6-4386-89f5-c8714b212f13 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:01.221427 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c6b5d-e5a6-4386-89f5-c8714b212f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:01.221707 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c6b5d-e5a6-4386-89f5-c8714b212f13 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:01.222487 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c6b5d-e5a6-4386-89f5-c8714b212f13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:01.224069 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c6b5d-e5a6-4386-89f5-c8714b212f13 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:01.233514 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1434/2883] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:20:01 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:20:01.237905 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd3be1-5f4e-4f49-9f31-1ab8bf6b58b8 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:01.247915 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd3be1-5f4e-4f49-9f31-1ab8bf6b58b8 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:01.252631 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acc68c-e94d-4d53-98c6-1e5f801b8a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:01.253500 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acc68c-e94d-4d53-98c6-1e5f801b8a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:01.253784 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acc68c-e94d-4d53-98c6-1e5f801b8a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:01.254104 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acc68c-e94d-4d53-98c6-1e5f801b8a2c admin admin] PATH_INFO: `/v3/projects/403342b20be14233936173032766b4f6/users/ac33a910fd67483d812331c5832f332f/roles/f28d3f93a0524078a592a15459808378` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:01.256589 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acc68c-e94d-4d53-98c6-1e5f801b8a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=403342b20be14233936173032766b4f6, user_id=ac33a910fd67483d812331c5832f332f, role_id=f28d3f93a0524078a592a15459808378)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:01.259300 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acc68c-e94d-4d53-98c6-1e5f801b8a2c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:01.269320 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1450/2884] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:20:01 2021] PUT /identity/v3/projects/403342b20be14233936173032766b4f6/users/ac33a910fd67483d812331c5832f332f/roles/f28d3f93a0524078a592a15459808378 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:20:01.279735 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e3c03-3dc0-4dfb-806f-3f442773d612 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:01.280024 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e3c03-3dc0-4dfb-806f-3f442773d612 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:01.280303 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e3c03-3dc0-4dfb-806f-3f442773d612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:01.305687 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-ea8e3c03-3dc0-4dfb-806f-3f442773d612 None None] MFA Rules not processed for user `ac33a910fd67483d812331c5832f332f`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:20:01.306920 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-ea8e3c03-3dc0-4dfb-806f-3f442773d612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:20:01.372843 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1435/2885] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:20:01 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:20:01.382986 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acc68c-e94d-4d53-98c6-1e5f801b8a2c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:01.384677 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-a4acc68c-e94d-4d53-98c6-1e5f801b8a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:20:01.438282 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acc68c-e94d-4d53-98c6-1e5f801b8a2c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:01.442011 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc276b0-7662-4f1e-beae-a3959cd03879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9652ec3b44ee410dba2491c8f9795e20', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:01.442659 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc276b0-7662-4f1e-beae-a3959cd03879 service cinder] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:01.442949 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc276b0-7662-4f1e-beae-a3959cd03879 service cinder] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:01.443226 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc276b0-7662-4f1e-beae-a3959cd03879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:01.453065 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc276b0-7662-4f1e-beae-a3959cd03879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:01.454569 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc276b0-7662-4f1e-beae-a3959cd03879 service cinder] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:01.464491 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1451/2886] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:20:01 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 29 17:20:01.944792 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e3c03-3dc0-4dfb-806f-3f442773d612 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:02.004435 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e3c03-3dc0-4dfb-806f-3f442773d612 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:02.008955 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49547f87-53e7-4a80-9787-edc949d1a4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:02.009803 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49547f87-53e7-4a80-9787-edc949d1a4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:02.010124 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49547f87-53e7-4a80-9787-edc949d1a4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:02.010405 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49547f87-53e7-4a80-9787-edc949d1a4e0 admin admin] PATH_INFO: `/v3/users/b56e2fc2bbe948baaadc90ef8d156ad3` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:02.011605 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49547f87-53e7-4a80-9787-edc949d1a4e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b56e2fc2bbe948baaadc90ef8d156ad3)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:02.013503 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49547f87-53e7-4a80-9787-edc949d1a4e0 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:02.056566 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-49547f87-53e7-4a80-9787-edc949d1a4e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b56e2fc2bbe948baaadc90ef8d156ad3'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:02.063265 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-49547f87-53e7-4a80-9787-edc949d1a4e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b56e2fc2bbe948baaadc90ef8d156ad3'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:02.070059 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-49547f87-53e7-4a80-9787-edc949d1a4e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b56e2fc2bbe948baaadc90ef8d156ad3'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:02.070694 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-49547f87-53e7-4a80-9787-edc949d1a4e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b56e2fc2bbe948baaadc90ef8d156ad3'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:02.081868 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-49547f87-53e7-4a80-9787-edc949d1a4e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b56e2fc2bbe948baaadc90ef8d156ad3'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:02.089980 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1436/2887] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:20:01 2021] DELETE /identity/v3/users/b56e2fc2bbe948baaadc90ef8d156ad3 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:20:02.092663 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0d854-54d2-4c7f-a629-d3896d9663a1 None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:02.093133 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0d854-54d2-4c7f-a629-d3896d9663a1 None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:02.093237 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0d854-54d2-4c7f-a629-d3896d9663a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:02.111148 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-1da0d854-54d2-4c7f-a629-d3896d9663a1 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:20:02.112603 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-1da0d854-54d2-4c7f-a629-d3896d9663a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:20:02.167887 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1452/2888] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:20:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:20:02.177620 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49547f87-53e7-4a80-9787-edc949d1a4e0 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:02.179700 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-49547f87-53e7-4a80-9787-edc949d1a4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:20:02.234781 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49547f87-53e7-4a80-9787-edc949d1a4e0 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:02.238734 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83fda8-e72f-43e7-a0dd-abc3aee0c4e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:02.239373 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83fda8-e72f-43e7-a0dd-abc3aee0c4e1 service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:02.239658 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83fda8-e72f-43e7-a0dd-abc3aee0c4e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:02.239934 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd83fda8-e72f-43e7-a0dd-abc3aee0c4e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:02.249571 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83fda8-e72f-43e7-a0dd-abc3aee0c4e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:02.251027 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd83fda8-e72f-43e7-a0dd-abc3aee0c4e1 service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:02.260565 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1437/2889] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:20:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:20:02.514230 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0d854-54d2-4c7f-a629-d3896d9663a1 None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:02.515829 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-1da0d854-54d2-4c7f-a629-d3896d9663a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:20:02.530759 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0d854-54d2-4c7f-a629-d3896d9663a1 None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:02.536059 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87789bc2-05f2-4c67-a2ba-2feee542b824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:02.536919 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87789bc2-05f2-4c67-a2ba-2feee542b824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:02.537779 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87789bc2-05f2-4c67-a2ba-2feee542b824 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:02.538094 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87789bc2-05f2-4c67-a2ba-2feee542b824 admin admin] PATH_INFO: `/v3/projects/62aaafd66ba84ba9b605b19094ac6820` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:02.539289 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87789bc2-05f2-4c67-a2ba-2feee542b824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62aaafd66ba84ba9b605b19094ac6820)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:02.541189 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87789bc2-05f2-4c67-a2ba-2feee542b824 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:02.584716 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-87789bc2-05f2-4c67-a2ba-2feee542b824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62aaafd66ba84ba9b605b19094ac6820', 'request_id': 'req-87789bc2-05f2-4c67-a2ba-2feee542b824'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:02.589758 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-87789bc2-05f2-4c67-a2ba-2feee542b824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62aaafd66ba84ba9b605b19094ac6820', 'request_id': 'req-87789bc2-05f2-4c67-a2ba-2feee542b824'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:02.596454 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-87789bc2-05f2-4c67-a2ba-2feee542b824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62aaafd66ba84ba9b605b19094ac6820', 'request_id': 'req-87789bc2-05f2-4c67-a2ba-2feee542b824'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:02.608389 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-87789bc2-05f2-4c67-a2ba-2feee542b824 admin admin] The token cache is being invalidate because project 62aaafd66ba84ba9b605b19094ac6820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:20:02.608678 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-87789bc2-05f2-4c67-a2ba-2feee542b824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:02.609308 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-87789bc2-05f2-4c67-a2ba-2feee542b824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:02.610861 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1453/2890] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:20:02 2021] DELETE /identity/v3/projects/62aaafd66ba84ba9b605b19094ac6820 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:20:02.615213 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83fda8-e72f-43e7-a0dd-abc3aee0c4e1 service neutron] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:02.624731 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd83fda8-e72f-43e7-a0dd-abc3aee0c4e1 service neutron] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:02.677845 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42113a28-e259-42c3-995d-d893b1761885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:02.678729 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42113a28-e259-42c3-995d-d893b1761885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:02.679012 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42113a28-e259-42c3-995d-d893b1761885 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:02.679293 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42113a28-e259-42c3-995d-d893b1761885 admin admin] PATH_INFO: `/v3/users/ac33a910fd67483d812331c5832f332f` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:02.680485 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42113a28-e259-42c3-995d-d893b1761885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac33a910fd67483d812331c5832f332f)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:02.682428 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42113a28-e259-42c3-995d-d893b1761885 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:02.726861 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-42113a28-e259-42c3-995d-d893b1761885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac33a910fd67483d812331c5832f332f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:02.733802 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-42113a28-e259-42c3-995d-d893b1761885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac33a910fd67483d812331c5832f332f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:02.740917 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-42113a28-e259-42c3-995d-d893b1761885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac33a910fd67483d812331c5832f332f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:02.741551 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-42113a28-e259-42c3-995d-d893b1761885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac33a910fd67483d812331c5832f332f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:02.753017 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-42113a28-e259-42c3-995d-d893b1761885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac33a910fd67483d812331c5832f332f'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:02.759409 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1438/2891] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:20:02 2021] DELETE /identity/v3/users/ac33a910fd67483d812331c5832f332f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:20:03.017412 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87789bc2-05f2-4c67-a2ba-2feee542b824 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:03.018894 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-87789bc2-05f2-4c67-a2ba-2feee542b824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:20:03.032508 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87789bc2-05f2-4c67-a2ba-2feee542b824 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:03.087478 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3cb5ab-e79e-4cf6-811c-bf46d93486ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:03.088332 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cb5ab-e79e-4cf6-811c-bf46d93486ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:03.088612 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cb5ab-e79e-4cf6-811c-bf46d93486ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:03.088883 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3cb5ab-e79e-4cf6-811c-bf46d93486ce admin admin] PATH_INFO: `/v3/projects/403342b20be14233936173032766b4f6` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:03.090090 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cb5ab-e79e-4cf6-811c-bf46d93486ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=403342b20be14233936173032766b4f6)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:03.091999 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3cb5ab-e79e-4cf6-811c-bf46d93486ce admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:03.135326 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-af3cb5ab-e79e-4cf6-811c-bf46d93486ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '403342b20be14233936173032766b4f6', 'request_id': 'req-af3cb5ab-e79e-4cf6-811c-bf46d93486ce'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:03.140604 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-af3cb5ab-e79e-4cf6-811c-bf46d93486ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '403342b20be14233936173032766b4f6', 'request_id': 'req-af3cb5ab-e79e-4cf6-811c-bf46d93486ce'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:03.147980 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-af3cb5ab-e79e-4cf6-811c-bf46d93486ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '403342b20be14233936173032766b4f6', 'request_id': 'req-af3cb5ab-e79e-4cf6-811c-bf46d93486ce'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:03.158526 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-af3cb5ab-e79e-4cf6-811c-bf46d93486ce admin admin] The token cache is being invalidate because project 403342b20be14233936173032766b4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:20:03.158871 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-af3cb5ab-e79e-4cf6-811c-bf46d93486ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:03.159417 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-af3cb5ab-e79e-4cf6-811c-bf46d93486ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:03.160959 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1454/2892] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:20:03 2021] DELETE /identity/v3/projects/403342b20be14233936173032766b4f6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:20:03.167236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c747674-ff3e-4a6e-aa94-1a75949ebe58 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:03.167686 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c747674-ff3e-4a6e-aa94-1a75949ebe58 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:03.167817 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c747674-ff3e-4a6e-aa94-1a75949ebe58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:03.185091 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-2c747674-ff3e-4a6e-aa94-1a75949ebe58 None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:20:03.186320 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-2c747674-ff3e-4a6e-aa94-1a75949ebe58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:20:03.243655 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1439/2893] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:20:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 29 17:20:03.251389 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4713a7-88c8-4cb5-baa0-4ea1b671290b None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:03.251677 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4713a7-88c8-4cb5-baa0-4ea1b671290b None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:03.251950 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4713a7-88c8-4cb5-baa0-4ea1b671290b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:03.269770 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-da4713a7-88c8-4cb5-baa0-4ea1b671290b None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:20:03.271007 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-da4713a7-88c8-4cb5-baa0-4ea1b671290b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:20:03.279476 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1455/2894] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:20:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:20:03.283480 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c747674-ff3e-4a6e-aa94-1a75949ebe58 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:03.293455 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c747674-ff3e-4a6e-aa94-1a75949ebe58 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:03.298022 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc48a4-b430-46b0-9e04-1af715f3190e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:03.298665 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc48a4-b430-46b0-9e04-1af715f3190e admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:03.298948 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc48a4-b430-46b0-9e04-1af715f3190e admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:03.299227 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc48a4-b430-46b0-9e04-1af715f3190e admin admin] PATH_INFO: `/v3/domains` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:03.299989 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc48a4-b430-46b0-9e04-1af715f3190e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79610) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 29 17:20:03.300276 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc48a4-b430-46b0-9e04-1af715f3190e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:03.301868 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbc48a4-b430-46b0-9e04-1af715f3190e admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:03.312973 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1440/2895] 10.222.0.41 () {58 vars in 1152 bytes} [Fri Oct 29 17:20:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 29 17:20:03.318137 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4713a7-88c8-4cb5-baa0-4ea1b671290b None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:03.327205 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4713a7-88c8-4cb5-baa0-4ea1b671290b None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:03.331882 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfdffe-01c9-411e-9642-19358369d5ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:03.332531 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfdffe-01c9-411e-9642-19358369d5ac admin admin] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:03.332815 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfdffe-01c9-411e-9642-19358369d5ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:03.333092 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfdffe-01c9-411e-9642-19358369d5ac admin admin] PATH_INFO: `/v3/projects` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:03.334314 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfdffe-01c9-411e-9642-19358369d5ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:03.336218 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfdffe-01c9-411e-9642-19358369d5ac admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:03.361238 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1456/2896] 10.222.0.41 () {60 vars in 1152 bytes} [Fri Oct 29 17:20:03 2021] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:20:03.365863 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc48a4-b430-46b0-9e04-1af715f3190e admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:03.375634 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbc48a4-b430-46b0-9e04-1af715f3190e admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:03.429497 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beec2eb-ffa1-4c6d-84b2-0e428be457ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:03.430177 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beec2eb-ffa1-4c6d-84b2-0e428be457ad admin admin] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:03.430461 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beec2eb-ffa1-4c6d-84b2-0e428be457ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:03.430739 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beec2eb-ffa1-4c6d-84b2-0e428be457ad admin admin] PATH_INFO: `/v3/users` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:03.431448 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beec2eb-ffa1-4c6d-84b2-0e428be457ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:03.433385 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beec2eb-ffa1-4c6d-84b2-0e428be457ad admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:03.452494 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1441/2897] 10.222.0.41 () {60 vars in 1143 bytes} [Fri Oct 29 17:20:03 2021] POST /identity/v3/users => generated 285 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 29 17:20:03.456551 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfdffe-01c9-411e-9642-19358369d5ac admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:03.467286 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfdffe-01c9-411e-9642-19358369d5ac admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:03.471877 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a300b-e8ee-40bc-a09f-48cc677640c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:03.472526 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a300b-e8ee-40bc-a09f-48cc677640c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:03.472810 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a300b-e8ee-40bc-a09f-48cc677640c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:03.473084 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008a300b-e8ee-40bc-a09f-48cc677640c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:03.473824 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a300b-e8ee-40bc-a09f-48cc677640c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:03.475444 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008a300b-e8ee-40bc-a09f-48cc677640c0 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:03.487127 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1457/2898] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:20:03 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 29 17:20:03.491014 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beec2eb-ffa1-4c6d-84b2-0e428be457ad admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:03.500848 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beec2eb-ffa1-4c6d-84b2-0e428be457ad admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:03.505418 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a159212-fbb8-487a-bdb8-687ab067e9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:03.506604 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a159212-fbb8-487a-bdb8-687ab067e9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:03.506888 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a159212-fbb8-487a-bdb8-687ab067e9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:03.507218 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a159212-fbb8-487a-bdb8-687ab067e9d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:03.507900 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a159212-fbb8-487a-bdb8-687ab067e9d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:03.509474 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a159212-fbb8-487a-bdb8-687ab067e9d3 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:03.519132 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1442/2899] 10.222.0.41 () {58 vars in 1121 bytes} [Fri Oct 29 17:20:03 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 29 17:20:03.523658 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a300b-e8ee-40bc-a09f-48cc677640c0 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:03.533627 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008a300b-e8ee-40bc-a09f-48cc677640c0 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:03.538210 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f0fe8-1604-4210-9b16-0518126dffa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:03.539102 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f0fe8-1604-4210-9b16-0518126dffa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:03.539382 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f0fe8-1604-4210-9b16-0518126dffa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:03.539658 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3f0fe8-1604-4210-9b16-0518126dffa5 admin admin] PATH_INFO: `/v3/projects/3b23f637562c4d54bc18af628106765e/users/094ce537f44e4f7aa02bfb8dd8f48fdf/roles/4a1afb6391114961afeec5c1d72563f0` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:03.553640 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f0fe8-1604-4210-9b16-0518126dffa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b23f637562c4d54bc18af628106765e, user_id=094ce537f44e4f7aa02bfb8dd8f48fdf, role_id=4a1afb6391114961afeec5c1d72563f0)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:03.556332 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3f0fe8-1604-4210-9b16-0518126dffa5 admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:03.569095 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1458/2900] 10.222.0.41 () {60 vars in 1482 bytes} [Fri Oct 29 17:20:03 2021] PUT /identity/v3/projects/3b23f637562c4d54bc18af628106765e/users/094ce537f44e4f7aa02bfb8dd8f48fdf/roles/4a1afb6391114961afeec5c1d72563f0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 17:20:03.579868 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7d10e-3177-4886-b046-3f3425114980 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:03.580163 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7d10e-3177-4886-b046-3f3425114980 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:03.580445 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7d10e-3177-4886-b046-3f3425114980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:03.608721 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-edb7d10e-3177-4886-b046-3f3425114980 None None] MFA Rules not processed for user `094ce537f44e4f7aa02bfb8dd8f48fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:20:03.609938 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-edb7d10e-3177-4886-b046-3f3425114980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:20:03.671438 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1443/2901] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:20:03 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:20:03.683295 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f0fe8-1604-4210-9b16-0518126dffa5 admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:03.684944 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-4a3f0fe8-1604-4210-9b16-0518126dffa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:20:03.739716 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3f0fe8-1604-4210-9b16-0518126dffa5 admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:03.743341 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f2d68-c0ce-4e6b-89a5-b40da30c431a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e27a0c9ae2bf40caa92e9dbceff8d68b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:03.743979 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f2d68-c0ce-4e6b-89a5-b40da30c431a service glance] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:03.744264 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f2d68-c0ce-4e6b-89a5-b40da30c431a service glance] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:03.744541 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276f2d68-c0ce-4e6b-89a5-b40da30c431a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:03.752689 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f2d68-c0ce-4e6b-89a5-b40da30c431a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:03.754176 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276f2d68-c0ce-4e6b-89a5-b40da30c431a service glance] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:03.763348 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1459/2902] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:20:03 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:20:36.894680 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f36c69-16a0-4cc2-a927-186e9b981f45 None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:36.895146 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f36c69-16a0-4cc2-a927-186e9b981f45 None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:36.895511 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f36c69-16a0-4cc2-a927-186e9b981f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:36.964471 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-e2f36c69-16a0-4cc2-a927-186e9b981f45 None None] MFA Rules not processed for user `34c34efa8fd24230aa45e0f67209260e`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:20:36.965674 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-e2f36c69-16a0-4cc2-a927-186e9b981f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:20:37.043427 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1444/2903] 10.222.0.41 () {58 vars in 1057 bytes} [Fri Oct 29 17:20:36 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:20:37.049884 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f2d68-c0ce-4e6b-89a5-b40da30c431a service glance] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:37.070383 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276f2d68-c0ce-4e6b-89a5-b40da30c431a service glance] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:37.075290 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eea8056-5215-4d43-ae04-083f1a49b981 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:37.075923 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea8056-5215-4d43-ae04-083f1a49b981 service placement] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:37.076204 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea8056-5215-4d43-ae04-083f1a49b981 service placement] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:37.076479 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eea8056-5215-4d43-ae04-083f1a49b981 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:37.078268 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-5eea8056-5215-4d43-ae04-083f1a49b981 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:20:37.089779 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea8056-5215-4d43-ae04-083f1a49b981 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:37.091374 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eea8056-5215-4d43-ae04-083f1a49b981 service placement] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:37.101808 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1460/2904] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:20:37 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:20:37.740611 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f36c69-16a0-4cc2-a927-186e9b981f45 None None] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:37.801683 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f36c69-16a0-4cc2-a927-186e9b981f45 None None] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:37.806810 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b454462-316c-4e70-b055-ff769c17d0b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:37.807695 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b454462-316c-4e70-b055-ff769c17d0b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:37.807980 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b454462-316c-4e70-b055-ff769c17d0b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:37.808256 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b454462-316c-4e70-b055-ff769c17d0b8 admin admin] PATH_INFO: `/v3/users/094ce537f44e4f7aa02bfb8dd8f48fdf` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:37.809445 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b454462-316c-4e70-b055-ff769c17d0b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=094ce537f44e4f7aa02bfb8dd8f48fdf)` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:37.811388 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b454462-316c-4e70-b055-ff769c17d0b8 admin admin] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:37.854771 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-3b454462-316c-4e70-b055-ff769c17d0b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '094ce537f44e4f7aa02bfb8dd8f48fdf'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:37.861459 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-3b454462-316c-4e70-b055-ff769c17d0b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '094ce537f44e4f7aa02bfb8dd8f48fdf'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:37.868872 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-3b454462-316c-4e70-b055-ff769c17d0b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '094ce537f44e4f7aa02bfb8dd8f48fdf'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:37.869491 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-3b454462-316c-4e70-b055-ff769c17d0b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '094ce537f44e4f7aa02bfb8dd8f48fdf'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:37.880531 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.notifications [None req-3b454462-316c-4e70-b055-ff769c17d0b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '094ce537f44e4f7aa02bfb8dd8f48fdf'} {{(pid=79610) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:37.886840 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1445/2905] 10.222.0.41 () {58 vars in 1223 bytes} [Fri Oct 29 17:20:37 2021] DELETE /identity/v3/users/094ce537f44e4f7aa02bfb8dd8f48fdf => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 29 17:20:37.891309 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b76cf9-edd3-409d-8189-7a1ac2bc323e None None] REQUEST_METHOD: `POST` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:37.891600 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b76cf9-edd3-409d-8189-7a1ac2bc323e None None] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:37.891881 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b76cf9-edd3-409d-8189-7a1ac2bc323e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:37.909031 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.auth.core [None req-c4b76cf9-edd3-409d-8189-7a1ac2bc323e None None] MFA Rules not processed for user `bfeda756d5b84f81aba1c8d226cdac52`. Rule list: `[]` (Enabled: `True`). {{(pid=79609) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:20:37.910251 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c4b76cf9-edd3-409d-8189-7a1ac2bc323e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:20:37.966001 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1461/2906] 10.222.0.41 () {58 vars in 957 bytes} [Fri Oct 29 17:20:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:20:37.976287 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b454462-316c-4e70-b055-ff769c17d0b8 admin admin] Authenticating user token {{(pid=79610) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:37.977630 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-3b454462-316c-4e70-b055-ff769c17d0b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:20:38.032602 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b454462-316c-4e70-b055-ff769c17d0b8 admin admin] Validating token access rules against request {{(pid=79610) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:38.036236 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c99c90-19f2-4073-b10b-580d3f8fa98f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3bb8aa43328d4be08455441d0ffa4e8a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79610) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:38.036871 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c99c90-19f2-4073-b10b-580d3f8fa98f service neutron] REQUEST_METHOD: `GET` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:38.037154 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c99c90-19f2-4073-b10b-580d3f8fa98f service neutron] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:38.037456 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c99c90-19f2-4073-b10b-580d3f8fa98f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:38.046787 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c99c90-19f2-4073-b10b-580d3f8fa98f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:38.048208 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c99c90-19f2-4073-b10b-580d3f8fa98f service neutron] RBAC: Authorization granted {{(pid=79610) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:38.057999 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1446/2907] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:20:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 29 17:20:38.319668 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b76cf9-edd3-409d-8189-7a1ac2bc323e None None] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:20:38.321146 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-c4b76cf9-edd3-409d-8189-7a1ac2bc323e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:20:38.333175 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b76cf9-edd3-409d-8189-7a1ac2bc323e None None] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:20:38.339833 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe5cfb-e2b2-4be1-83ec-680c44e1921c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfeda756d5b84f81aba1c8d226cdac52', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fe31d02174b84ed29a89c0315c571a54', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:20:38.340624 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe5cfb-e2b2-4be1-83ec-680c44e1921c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:20:38.341019 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe5cfb-e2b2-4be1-83ec-680c44e1921c admin admin] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:20:38.341239 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfe5cfb-e2b2-4be1-83ec-680c44e1921c admin admin] PATH_INFO: `/v3/projects/3b23f637562c4d54bc18af628106765e` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:20:38.343209 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe5cfb-e2b2-4be1-83ec-680c44e1921c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b23f637562c4d54bc18af628106765e)` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:20:38.345304 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfe5cfb-e2b2-4be1-83ec-680c44e1921c admin admin] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:20:38.390818 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8cfe5cfb-e2b2-4be1-83ec-680c44e1921c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b23f637562c4d54bc18af628106765e', 'request_id': 'req-8cfe5cfb-e2b2-4be1-83ec-680c44e1921c'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:38.396230 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8cfe5cfb-e2b2-4be1-83ec-680c44e1921c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b23f637562c4d54bc18af628106765e', 'request_id': 'req-8cfe5cfb-e2b2-4be1-83ec-680c44e1921c'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:38.403903 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8cfe5cfb-e2b2-4be1-83ec-680c44e1921c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b23f637562c4d54bc18af628106765e', 'request_id': 'req-8cfe5cfb-e2b2-4be1-83ec-680c44e1921c'} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:38.415145 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8cfe5cfb-e2b2-4be1-83ec-680c44e1921c admin admin] The token cache is being invalidate because project 3b23f637562c4d54bc18af628106765e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79609) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 29 17:20:38.415434 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8cfe5cfb-e2b2-4be1-83ec-680c44e1921c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:38.416080 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.notifications [None req-8cfe5cfb-e2b2-4be1-83ec-680c44e1921c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79609) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 29 17:20:38.417726 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1462/2908] 10.222.0.41 () {58 vars in 1232 bytes} [Fri Oct 29 17:20:38 2021] DELETE /identity/v3/projects/3b23f637562c4d54bc18af628106765e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 29 17:25:40.872540 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a883937-272e-4dfe-983a-988883a100ae None None] REQUEST_METHOD: `POST` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:25:40.872986 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a883937-272e-4dfe-983a-988883a100ae None None] SCRIPT_NAME: `/identity` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:25:40.873096 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a883937-272e-4dfe-983a-988883a100ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79610) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:25:40.890475 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.auth.core [None req-1a883937-272e-4dfe-983a-988883a100ae None None] MFA Rules not processed for user `34c34efa8fd24230aa45e0f67209260e`. Rule list: `[]` (Enabled: `True`). {{(pid=79610) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 29 17:25:40.891648 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: DEBUG keystone.common.fernet_utils [None req-1a883937-272e-4dfe-983a-988883a100ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79610) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:25:40.952145 dv-cinder-815848-2-iscsi devstack@keystone.service[79610]: [pid: 79610|app: 0|req: 1447/2909] 10.222.0.41 () {58 vars in 1057 bytes} [Fri Oct 29 17:25:40 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 29 17:25:40.958710 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe5cfb-e2b2-4be1-83ec-680c44e1921c admin admin] Authenticating user token {{(pid=79609) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 29 17:25:40.970429 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfe5cfb-e2b2-4be1-83ec-680c44e1921c admin admin] Validating token access rules against request {{(pid=79609) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 29 17:25:40.975364 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28cb31-6897-486f-bb52-367e40110d51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '34c34efa8fd24230aa45e0f67209260e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4939afba2b604181b67577f309c9550a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79609) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 29 17:25:40.976026 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28cb31-6897-486f-bb52-367e40110d51 service placement] REQUEST_METHOD: `GET` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 29 17:25:40.976309 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28cb31-6897-486f-bb52-367e40110d51 service placement] SCRIPT_NAME: `/identity` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 29 17:25:40.976585 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28cb31-6897-486f-bb52-367e40110d51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79609) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 29 17:25:40.978359 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.fernet_utils [None req-be28cb31-6897-486f-bb52-367e40110d51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79609) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 29 17:25:40.990219 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28cb31-6897-486f-bb52-367e40110d51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 29 17:25:40.991791 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be28cb31-6897-486f-bb52-367e40110d51 service placement] RBAC: Authorization granted {{(pid=79609) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 29 17:25:41.001556 dv-cinder-815848-2-iscsi devstack@keystone.service[79609]: [pid: 79609|app: 0|req: 1463/2910] 10.222.0.41 () {60 vars in 1365 bytes} [Fri Oct 29 17:25:40 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)